Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
2026-08-10T13:53:10Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-10T13:53:10Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260810 13:53:10.788816 12432 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
/tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.36.62:33317
--webserver_interface=127.12.36.62
--webserver_port=0
--builtin_ntp_servers=127.12.36.20:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260810 13:53:11.116320 12449 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 13:53:11.117041 12449 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 13:53:11.117512 12449 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 13:53:11.150748 12449 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 13:53:11.151109 12449 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 13:53:11.151407 12449 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 13:53:11.151680 12449 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 13:53:11.200276 12449 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.36.20:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.36.62:33317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.36.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 13:43:20 UTC on e7f111948823
build id 13275
TSAN enabled
I20260810 13:53:11.203207 12449 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 13:53:11.206801 12449 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 13:53:11.228307 12460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:11.228368 12459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:12.553987 12449 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.328s user 0.559s sys 0.768s
W20260810 13:53:12.554414 12449 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.329s user 0.559s sys 0.768s
I20260810 13:53:12.555764 12449 server_base.cc:1061] running on GCE node
W20260810 13:53:12.557727 12464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:12.559239 12449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 13:53:12.562714 12449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 13:53:12.566274 12449 hybrid_clock.cc:648] HybridClock initialized: now 1786369992566183 us; error 136 us; skew 500 ppm
I20260810 13:53:12.567639 12449 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 13:53:12.577363 12449 webserver.cc:533] Webserver started at http://127.12.36.62:34329/ using document root <none> and password file <none>
I20260810 13:53:12.579008 12449 fs_manager.cc:362] Metadata directory not provided
I20260810 13:53:12.579294 12449 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 13:53:12.580013 12449 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 13:53:12.586086 12449 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/data/instance:
uuid: "d9666026fb7e4c85b46c6aab952932fb"
format_stamp: "Formatted at 2026-08-10 13:53:12 on dist-test-slave-s11t"
I20260810 13:53:12.587433 12449 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/wal/instance:
uuid: "d9666026fb7e4c85b46c6aab952932fb"
format_stamp: "Formatted at 2026-08-10 13:53:12 on dist-test-slave-s11t"
I20260810 13:53:12.598428 12449 fs_manager.cc:696] Time spent creating directory manager: real 0.010s user 0.010s sys 0.002s
I20260810 13:53:12.607252 12470 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:12.609189 12449 fs_manager.cc:730] Time spent opening block manager: real 0.007s user 0.005s sys 0.000s
I20260810 13:53:12.609687 12449 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/data,/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/wal
uuid: "d9666026fb7e4c85b46c6aab952932fb"
format_stamp: "Formatted at 2026-08-10 13:53:12 on dist-test-slave-s11t"
I20260810 13:53:12.610157 12449 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 13:53:12.692873 12449 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 13:53:12.694660 12449 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 13:53:12.695182 12449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 13:53:12.778592 12449 rpc_server.cc:307] RPC server started. Bound to: 127.12.36.62:33317
I20260810 13:53:12.778726 12557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.36.62:33317 every 8 connection(s)
I20260810 13:53:12.782131 12449 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/data/info.pb
I20260810 13:53:12.790208 12432 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu as pid 12449
I20260810 13:53:12.790998 12432 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-0/wal/instance
I20260810 13:53:12.794526 12558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:12.798087 12432 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
/tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.36.61:35861
--webserver_interface=127.12.36.61
--webserver_port=0
--builtin_ntp_servers=127.12.36.20:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 13:53:12.810894 12558 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } has no permanent_uuid. Determining permanent_uuid...
I20260810 13:53:12.845005 12558 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } has no permanent_uuid. Determining permanent_uuid...
W20260810 13:53:12.847752 12473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
W20260810 13:53:12.852591 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.61:35861: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
I20260810 13:53:12.902192 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } attempt: 1
W20260810 13:53:12.907883 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.61:35861: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
I20260810 13:53:12.976312 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } attempt: 2
W20260810 13:53:12.981326 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.61:35861: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
I20260810 13:53:13.072788 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } attempt: 3
W20260810 13:53:13.077803 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.61:35861: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
W20260810 13:53:13.120258 12560 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 13:53:13.120942 12560 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 13:53:13.121415 12560 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 13:53:13.154050 12560 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 13:53:13.154419 12560 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 13:53:13.154697 12560 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 13:53:13.154978 12560 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 13:53:13.193774 12560 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.36.20:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.36.61:35861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.36.61
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 13:43:20 UTC on e7f111948823
build id 13275
TSAN enabled
I20260810 13:53:13.195230 12560 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 13:53:13.196995 12560 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 13:53:13.208164 12572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:13.221244 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } attempt: 4
W20260810 13:53:13.227504 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.61:35861: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
I20260810 13:53:13.527079 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } attempt: 5
W20260810 13:53:13.534080 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.61:35861: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
I20260810 13:53:14.081779 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } attempt: 6
W20260810 13:53:14.098695 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.61:35861: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
W20260810 13:53:13.209889 12573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:14.428851 12576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:14.431159 12575 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1217 milliseconds
I20260810 13:53:14.431267 12560 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260810 13:53:14.432546 12560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 13:53:14.436029 12560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 13:53:14.437497 12560 hybrid_clock.cc:648] HybridClock initialized: now 1786369994437436 us; error 67 us; skew 500 ppm
I20260810 13:53:14.438354 12560 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 13:53:14.445658 12560 webserver.cc:533] Webserver started at http://127.12.36.61:36613/ using document root <none> and password file <none>
I20260810 13:53:14.446657 12560 fs_manager.cc:362] Metadata directory not provided
I20260810 13:53:14.446877 12560 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 13:53:14.447338 12560 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 13:53:14.452000 12560 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data/instance:
uuid: "2928f7d4503145b182d99007d240334d"
format_stamp: "Formatted at 2026-08-10 13:53:14 on dist-test-slave-s11t"
I20260810 13:53:14.453356 12560 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal/instance:
uuid: "2928f7d4503145b182d99007d240334d"
format_stamp: "Formatted at 2026-08-10 13:53:14 on dist-test-slave-s11t"
I20260810 13:53:14.461333 12560 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260810 13:53:14.467612 12587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:14.468832 12560 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260810 13:53:14.469141 12560 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data,/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
uuid: "2928f7d4503145b182d99007d240334d"
format_stamp: "Formatted at 2026-08-10 13:53:14 on dist-test-slave-s11t"
I20260810 13:53:14.469455 12560 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 13:53:14.540475 12560 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 13:53:14.541988 12560 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 13:53:14.542418 12560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 13:53:14.616369 12560 rpc_server.cc:307] RPC server started. Bound to: 127.12.36.61:35861
I20260810 13:53:14.616410 12670 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.36.61:35861 every 8 connection(s)
I20260810 13:53:14.619177 12560 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data/info.pb
I20260810 13:53:14.625079 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:14.628479 12432 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu as pid 12560
I20260810 13:53:14.629022 12432 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal/instance
I20260810 13:53:14.632229 12432 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
/tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.36.60:38017
--webserver_interface=127.12.36.60
--webserver_port=0
--builtin_ntp_servers=127.12.36.20:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 13:53:14.640254 12671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } has no permanent_uuid. Determining permanent_uuid...
I20260810 13:53:14.661989 12671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } has no permanent_uuid. Determining permanent_uuid...
I20260810 13:53:14.676859 12671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } has no permanent_uuid. Determining permanent_uuid...
W20260810 13:53:14.679636 12588 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
W20260810 13:53:14.684270 12671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:14.733836 12671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 1
W20260810 13:53:14.739188 12671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:14.807652 12671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 2
W20260810 13:53:14.812489 12671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:14.904016 12671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 3
W20260810 13:53:14.908742 12671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
W20260810 13:53:14.957729 12675 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 13:53:14.958362 12675 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 13:53:14.958799 12675 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 13:53:14.992158 12675 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 13:53:14.992488 12675 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 13:53:14.992823 12675 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 13:53:14.993099 12675 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 13:53:15.029704 12675 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.36.20:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.36.60:38017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.36.60
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 13:43:20 UTC on e7f111948823
build id 13275
TSAN enabled
I20260810 13:53:15.031118 12675 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 13:53:15.032799 12675 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 13:53:15.043412 12691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:15.052212 12671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 4
W20260810 13:53:15.056540 12671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:15.159332 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } attempt: 7
I20260810 13:53:15.177996 12558 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } has no permanent_uuid. Determining permanent_uuid...
W20260810 13:53:15.187109 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:15.245719 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 1
W20260810 13:53:15.252869 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:15.334458 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 2
W20260810 13:53:15.341625 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:15.356096 12671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 5
W20260810 13:53:15.363415 12671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:15.427210 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 3
W20260810 13:53:15.434343 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:15.574932 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 4
W20260810 13:53:15.582185 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:15.865784 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 5
W20260810 13:53:15.873118 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:15.910991 12671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 6
W20260810 13:53:15.924664 12671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
W20260810 13:53:15.044973 12693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:16.323796 12695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:16.326122 12694 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1276 milliseconds
I20260810 13:53:16.326210 12675 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260810 13:53:16.327535 12675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 13:53:16.330711 12675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 13:53:16.332142 12675 hybrid_clock.cc:648] HybridClock initialized: now 1786369996332093 us; error 55 us; skew 500 ppm
I20260810 13:53:16.333029 12675 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 13:53:16.339677 12675 webserver.cc:533] Webserver started at http://127.12.36.60:39999/ using document root <none> and password file <none>
I20260810 13:53:16.340641 12675 fs_manager.cc:362] Metadata directory not provided
I20260810 13:53:16.340937 12675 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 13:53:16.341425 12675 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 13:53:16.345829 12675 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/data/instance:
uuid: "1298bde14cec4cd3a9d6338c7d47f0b7"
format_stamp: "Formatted at 2026-08-10 13:53:16 on dist-test-slave-s11t"
I20260810 13:53:16.346932 12675 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/wal/instance:
uuid: "1298bde14cec4cd3a9d6338c7d47f0b7"
format_stamp: "Formatted at 2026-08-10 13:53:16 on dist-test-slave-s11t"
I20260810 13:53:16.354526 12675 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.003s
I20260810 13:53:16.360381 12715 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:16.361555 12675 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260810 13:53:16.361892 12675 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/data,/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/wal
uuid: "1298bde14cec4cd3a9d6338c7d47f0b7"
format_stamp: "Formatted at 2026-08-10 13:53:16 on dist-test-slave-s11t"
I20260810 13:53:16.362200 12675 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 13:53:16.416247 12675 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 13:53:16.417809 12675 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 13:53:16.418277 12675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 13:53:16.425715 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 6
W20260810 13:53:16.433516 12558 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.12.36.60:38017: Network error: Client connection negotiation failed: client connection to 127.12.36.60:38017: connect: Connection refused (error 111)
I20260810 13:53:16.493306 12675 rpc_server.cc:307] RPC server started. Bound to: 127.12.36.60:38017
I20260810 13:53:16.493393 12801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.36.60:38017 every 8 connection(s)
I20260810 13:53:16.496124 12675 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/data/info.pb
I20260810 13:53:16.502550 12802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:16.502691 12432 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu as pid 12675
I20260810 13:53:16.503144 12432 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-2/wal/instance
I20260810 13:53:16.517094 12802 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } has no permanent_uuid. Determining permanent_uuid...
I20260810 13:53:16.549289 12802 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } has no permanent_uuid. Determining permanent_uuid...
I20260810 13:53:16.561476 12802 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } has no permanent_uuid. Determining permanent_uuid...
I20260810 13:53:16.581789 12802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Bootstrap starting.
I20260810 13:53:16.589830 12802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:16.593101 12802 log.cc:826] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Log is configured to *not* fsync() on all Append() calls
I20260810 13:53:16.598403 12802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: No bootstrap required, opened a new log
I20260810 13:53:16.620209 12802 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:16.621031 12802 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:16.621315 12802 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1298bde14cec4cd3a9d6338c7d47f0b7, State: Initialized, Role: FOLLOWER
I20260810 13:53:16.622498 12802 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:16.625509 12819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:16.626628 12819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:53:16.627621 12802 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: configured and running, proceeding with master startup.
W20260810 13:53:16.659180 12836 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 13:53:16.659904 12836 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260810 13:53:16.673676 12733 tablet.cc:2406] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:53:16.652750 12675 master_runner.cc:187] Error getting master registration for 127.12.36.62:33317: OK, instance_id { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" instance_seqno: 1786369992756410 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 13:53:16.680893 12675 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260810 13:53:16.712497 12819 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:16.713110 12819 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:16.715888 12819 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:53:16.985257 12671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 7
I20260810 13:53:17.006582 12671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Bootstrap starting.
I20260810 13:53:17.015524 12671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:17.017974 12671 log.cc:826] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Log is configured to *not* fsync() on all Append() calls
I20260810 13:53:17.023551 12671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: No bootstrap required, opened a new log
I20260810 13:53:17.044020 12671 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:17.045025 12671 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:17.045356 12671 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2928f7d4503145b182d99007d240334d, State: Initialized, Role: FOLLOWER
I20260810 13:53:17.046358 12671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:17.050213 12842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:17.051028 12842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:53:17.052196 12671 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 13:53:17.052407 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:53:17.053572 12631 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1298bde14cec4cd3a9d6338c7d47f0b7 in term 0.
I20260810 13:53:17.056221 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d; no voters:
I20260810 13:53:17.057736 12819 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:17.058190 12819 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:17.058620 12819 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:17.068985 12819 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:17.074703 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d"
I20260810 13:53:17.075312 12631 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:17.083015 12631 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1298bde14cec4cd3a9d6338c7d47f0b7 in term 1.
I20260810 13:53:17.071544 12819 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 1 election: Requested vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:53:17.084602 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d; no voters:
I20260810 13:53:17.085551 12819 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:17.091751 12819 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 1 LEADER]: Becoming Leader. State: Replica: 1298bde14cec4cd3a9d6338c7d47f0b7, State: Running, Role: LEADER
I20260810 13:53:17.093057 12819 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:17.107059 12848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1298bde14cec4cd3a9d6338c7d47f0b7. Latest consensus state: current_term: 1 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:17.107904 12848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: This master's current role is: LEADER
I20260810 13:53:17.115736 12857 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260810 13:53:17.123863 12857 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260810 13:53:17.151356 12631 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Refusing update from remote peer 1298bde14cec4cd3a9d6338c7d47f0b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 13:53:17.153366 12848 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:53:17.156200 12860 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 13:53:17.156566 12860 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 13:53:17.126196 12560 master_runner.cc:187] Error getting master registration for 127.12.36.62:33317: OK, instance_id { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" instance_seqno: 1786369992756410 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 13:53:17.168197 12560 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
I20260810 13:53:17.189244 12842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1298bde14cec4cd3a9d6338c7d47f0b7. Latest consensus state: current_term: 1 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:17.190129 12842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:53:17.196230 12857 catalog_manager.cc:1383] Generated new cluster ID: 13e3d414686543de8210a2d9c5898299
I20260810 13:53:17.196522 12857 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260810 13:53:17.200639 12819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:17.201512 12819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: This master's current role is: LEADER
I20260810 13:53:17.204473 12842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:17.205175 12842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: This master's current role is: FOLLOWER
W20260810 13:53:17.245738 12729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 0.528s (SENT)
I20260810 13:53:17.249511 12857 catalog_manager.cc:1406] Generated new certificate authority record
I20260810 13:53:17.253795 12857 catalog_manager.cc:1540] Loading token signing keys...
I20260810 13:53:17.294117 12857 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Generated new TSK 0
I20260810 13:53:17.295683 12857 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260810 13:53:17.328789 12432 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
/tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.36.1:0
--local_ip_for_outbound_sockets=127.12.36.1
--webserver_interface=127.12.36.1
--webserver_port=0
--tserver_master_addrs=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--builtin_ntp_servers=127.12.36.20:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260810 13:53:17.466920 12558 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } attempt: 7
I20260810 13:53:17.523839 12558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Bootstrap starting.
I20260810 13:53:17.543421 12558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:17.545760 12558 log.cc:826] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Log is configured to *not* fsync() on all Append() calls
I20260810 13:53:17.561323 12558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: No bootstrap required, opened a new log
I20260810 13:53:17.625248 12558 raft_consensus.cc:359] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:17.626068 12558 raft_consensus.cc:385] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:17.626381 12558 raft_consensus.cc:740] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9666026fb7e4c85b46c6aab952932fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:17.627377 12558 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:17.633279 12879 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:17.639340 12879 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:53:17.647127 12558 sys_catalog.cc:565] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: configured and running, proceeding with master startup.
I20260810 13:53:17.647315 12513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:53:17.648233 12513 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1298bde14cec4cd3a9d6338c7d47f0b7 in term 0.
I20260810 13:53:17.649073 12512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb"
I20260810 13:53:17.649670 12512 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:17.652999 12510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
W20260810 13:53:17.654119 12510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 5) took 400 ms (client timeout 528 ms). Trace:
W20260810 13:53:17.654461 12510 rpcz_store.cc:269] 0810 13:53:17.253300 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:17.253460 (+ 160us) service_pool.cc:224] Handling call
0810 13:53:17.654037 (+400577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:17.657466 12506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb"
W20260810 13:53:17.661108 12513 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 2) took 944 ms (client timeout 528 ms). Trace:
W20260810 13:53:17.661470 12513 rpcz_store.cc:269] 0810 13:53:16.716227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:16.716387 (+ 160us) service_pool.cc:224] Handling call
0810 13:53:17.661035 (+944648us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:17.667344 12512 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1298bde14cec4cd3a9d6338c7d47f0b7 in term 1.
I20260810 13:53:17.668553 12511 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Refusing update from remote peer 1298bde14cec4cd3a9d6338c7d47f0b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 13:53:17.674454 12512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 3) took 603 ms (client timeout 508 ms). Trace:
I20260810 13:53:17.674284 12819 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:53:17.674839 12512 rpcz_store.cc:269] 0810 13:53:17.071572 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:17.071774 (+ 202us) service_pool.cc:224] Handling call
0810 13:53:17.674381 (+602607us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:53:17.707955 12478 tablet.cc:2406] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:53:17.740839 12879 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1298bde14cec4cd3a9d6338c7d47f0b7. Latest consensus state: current_term: 1 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:17.741542 12879 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:53:17.742779 12896 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:17.743918 12896 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:53:17.797619 12910 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 13:53:17.801376 12912 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:17.801971 12912 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:17.805652 12512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:53:17.808477 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:17.810477 12912 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:17.810793 12588 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:53:17.812840 12912 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:53:17.882316 12875 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 13:53:17.883103 12875 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 13:53:17.884203 12875 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 13:53:17.923369 12875 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 13:53:17.924474 12875 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.36.1
I20260810 13:53:17.963405 12875 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.36.20:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.36.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.36.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.36.1
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 13:43:20 UTC on e7f111948823
build id 13275
TSAN enabled
I20260810 13:53:17.965092 12875 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 13:53:17.966782 12875 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 13:53:17.981774 12915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:18.169275 12860 catalog_manager.cc:1295] Loaded cluster ID: 13e3d414686543de8210a2d9c5898299
I20260810 13:53:18.169596 12860 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: loading cluster ID for follower catalog manager: success
I20260810 13:53:18.182022 12896 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:18.182700 12860 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: acquiring CA information for follower catalog manager: success
I20260810 13:53:18.182821 12896 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:18.187470 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:53:18.190546 12896 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:18.192008 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:18.194305 12471 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:18.195412 12896 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:18.200199 12860 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 13:53:18.203939 12819 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:18.205408 12819 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: This master's current role is: LEADER
I20260810 13:53:18.395740 12930 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:18.397964 12930 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:18.404911 12512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:53:18.409265 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:18.411280 12588 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:53:18.416661 12930 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:18.418030 12930 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:18.713362 12932 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:18.713914 12932 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:18.715808 12932 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:18.716717 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:53:18.716842 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:18.718472 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:18.719758 12932 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:18.828763 12910 catalog_manager.cc:1295] Loaded cluster ID: 13e3d414686543de8210a2d9c5898299
I20260810 13:53:18.829162 12910 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: loading cluster ID for follower catalog manager: success
I20260810 13:53:18.836455 12910 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: acquiring CA information for follower catalog manager: success
I20260810 13:53:18.858304 12910 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 13:53:19.402248 12934 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:19.403276 12934 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:19.407372 12512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:53:19.416441 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:19.418757 12588 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:53:19.428771 12934 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:19.430820 12934 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:19.809894 12936 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:19.815629 12936 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:19.827824 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:53:19.827936 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:19.829631 12471 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:19.839051 12936 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:19.840394 12936 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:53:19.386057 12914 debug-util.cc:398] Leaking SignalData structure 0x7b0800037500 after lost signal to thread 12875
W20260810 13:53:20.240885 12875 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.257s user 0.681s sys 1.278s
W20260810 13:53:20.241341 12875 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.258s user 0.681s sys 1.278s
W20260810 13:53:17.985544 12918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:20.272058 12875 server_base.cc:1061] running on GCE node
W20260810 13:53:20.273663 12938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:20.275076 12875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 13:53:20.278097 12875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 13:53:20.279592 12875 hybrid_clock.cc:648] HybridClock initialized: now 1786370000279521 us; error 73 us; skew 500 ppm
I20260810 13:53:20.280447 12875 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 13:53:20.288172 12875 webserver.cc:533] Webserver started at http://127.12.36.1:34617/ using document root <none> and password file <none>
I20260810 13:53:20.289276 12875 fs_manager.cc:362] Metadata directory not provided
I20260810 13:53:20.289539 12875 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 13:53:20.290079 12875 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 13:53:20.294564 12875 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/data/instance:
uuid: "88ed04d733ec447583fc897e233dd4b3"
format_stamp: "Formatted at 2026-08-10 13:53:20 on dist-test-slave-s11t"
I20260810 13:53:20.295768 12875 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/instance:
uuid: "88ed04d733ec447583fc897e233dd4b3"
format_stamp: "Formatted at 2026-08-10 13:53:20 on dist-test-slave-s11t"
I20260810 13:53:20.304358 12875 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.009s sys 0.001s
I20260810 13:53:20.310832 12950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:20.312950 12875 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260810 13:53:20.313293 12875 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/data,/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal
uuid: "88ed04d733ec447583fc897e233dd4b3"
format_stamp: "Formatted at 2026-08-10 13:53:20 on dist-test-slave-s11t"
I20260810 13:53:20.313637 12875 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 13:53:20.366473 12875 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 13:53:20.368052 12875 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 13:53:20.368535 12875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 13:53:20.372277 12875 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 13:53:20.377530 12875 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 13:53:20.377808 12875 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:20.378098 12875 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 13:53:20.378284 12875 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:20.671160 12875 rpc_server.cc:307] RPC server started. Bound to: 127.12.36.1:35237
I20260810 13:53:20.671309 13119 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.36.1:35237 every 8 connection(s)
I20260810 13:53:20.675097 12875 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/data/info.pb
I20260810 13:53:20.684590 12432 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu as pid 12875
I20260810 13:53:20.685086 12432 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/instance
I20260810 13:53:20.705292 12432 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
/tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.36.2:0
--local_ip_for_outbound_sockets=127.12.36.2
--webserver_interface=127.12.36.2
--webserver_port=0
--tserver_master_addrs=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--builtin_ntp_servers=127.12.36.20:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260810 13:53:20.779271 13120 heartbeater.cc:344] Connected to a master server at 127.12.36.60:38017
I20260810 13:53:20.779834 13120 heartbeater.cc:461] Registering TS with master...
I20260810 13:53:20.781379 13120 heartbeater.cc:507] Master 127.12.36.60:38017 requested a full tablet report, sending...
I20260810 13:53:20.787426 12750 ts_manager.cc:194] Registered new tserver with Master: 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:20.789742 13124 heartbeater.cc:344] Connected to a master server at 127.12.36.62:33317
I20260810 13:53:20.790122 13124 heartbeater.cc:461] Registering TS with master...
I20260810 13:53:20.791078 13124 heartbeater.cc:507] Master 127.12.36.62:33317 requested a full tablet report, sending...
I20260810 13:53:20.791579 12750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.36.1:47731
I20260810 13:53:20.794947 12495 ts_manager.cc:194] Registered new tserver with Master: 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:20.802703 13121 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:53:20.803066 13121 heartbeater.cc:461] Registering TS with master...
I20260810 13:53:20.803817 13121 heartbeater.cc:507] Master 127.12.36.61:35861 requested a full tablet report, sending...
I20260810 13:53:20.807313 12612 ts_manager.cc:194] Registered new tserver with Master: 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:20.886202 13134 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:20.886776 13134 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:20.889743 13134 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:20.890573 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:53:20.890616 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:20.892447 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:20.893473 13134 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:53:21.145897 13129 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 13:53:21.146538 13129 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 13:53:21.147153 13129 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 13:53:21.182093 13129 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 13:53:21.183147 13129 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.36.2
I20260810 13:53:21.221865 13129 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.36.20:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.36.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.36.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.36.2
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 13:43:20 UTC on e7f111948823
build id 13275
TSAN enabled
I20260810 13:53:21.223307 13129 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 13:53:21.225214 13129 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 13:53:21.241832 13144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:21.300633 13120 heartbeater.cc:499] Master 127.12.36.60:38017 was elected leader, sending a full tablet report...
I20260810 13:53:21.502121 13153 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:21.503254 13153 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:21.506762 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:53:21.511222 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:21.513381 12471 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:21.522459 13153 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:21.529490 13153 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:22.912920 13155 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:22.913735 13155 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:22.917675 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:53:22.922437 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:22.925206 12471 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:22.928539 13155 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:22.929811 13155 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:23.102662 13157 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:23.103626 13157 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:23.108069 12512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:53:23.112795 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:23.119669 13157 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:23.145979 12588 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:53:23.151227 13157 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:53:22.643113 13142 debug-util.cc:398] Leaking SignalData structure 0x7b0800037500 after lost signal to thread 13129
W20260810 13:53:23.216033 13142 kernel_stack_watchdog.cc:198] Thread 13129 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 397ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260810 13:53:21.246341 13146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:23.216521 13129 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.973s user 0.780s sys 1.120s
W20260810 13:53:23.216903 13129 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.974s user 0.780s sys 1.120s
W20260810 13:53:23.219193 13148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:23.221191 13147 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1973 milliseconds
I20260810 13:53:23.221232 13129 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260810 13:53:23.222532 13129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 13:53:23.224854 13129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 13:53:23.226258 13129 hybrid_clock.cc:648] HybridClock initialized: now 1786370003226223 us; error 35 us; skew 500 ppm
I20260810 13:53:23.227125 13129 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 13:53:23.233979 13129 webserver.cc:533] Webserver started at http://127.12.36.2:46413/ using document root <none> and password file <none>
I20260810 13:53:23.234980 13129 fs_manager.cc:362] Metadata directory not provided
I20260810 13:53:23.235222 13129 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 13:53:23.235702 13129 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 13:53:23.240185 13129 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/data/instance:
uuid: "218e946161f64d1d92427684ac15e4fb"
format_stamp: "Formatted at 2026-08-10 13:53:23 on dist-test-slave-s11t"
I20260810 13:53:23.241698 13129 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/instance:
uuid: "218e946161f64d1d92427684ac15e4fb"
format_stamp: "Formatted at 2026-08-10 13:53:23 on dist-test-slave-s11t"
I20260810 13:53:23.249153 13129 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260810 13:53:23.255252 13163 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:23.256407 13129 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260810 13:53:23.256735 13129 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/data,/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal
uuid: "218e946161f64d1d92427684ac15e4fb"
format_stamp: "Formatted at 2026-08-10 13:53:23 on dist-test-slave-s11t"
I20260810 13:53:23.257134 13129 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 13:53:23.307889 13129 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 13:53:23.309461 13129 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 13:53:23.309855 13129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 13:53:23.312830 13129 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 13:53:23.317260 13129 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 13:53:23.317458 13129 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:23.317662 13129 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 13:53:23.317793 13129 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:23.466187 13129 rpc_server.cc:307] RPC server started. Bound to: 127.12.36.2:35799
I20260810 13:53:23.466331 13338 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.36.2:35799 every 8 connection(s)
I20260810 13:53:23.468089 13339 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:23.468582 13339 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:23.469576 13129 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/data/info.pb
I20260810 13:53:23.470644 13339 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:23.472072 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:23.472071 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:53:23.474332 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:23.475363 13339 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:23.477758 12432 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu as pid 13129
I20260810 13:53:23.478542 12432 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/instance
I20260810 13:53:23.509889 12432 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
/tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.36.3:0
--local_ip_for_outbound_sockets=127.12.36.3
--webserver_interface=127.12.36.3
--webserver_port=0
--tserver_master_addrs=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--builtin_ntp_servers=127.12.36.20:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260810 13:53:23.520740 13340 heartbeater.cc:344] Connected to a master server at 127.12.36.60:38017
I20260810 13:53:23.521368 13340 heartbeater.cc:461] Registering TS with master...
I20260810 13:53:23.522336 13343 heartbeater.cc:344] Connected to a master server at 127.12.36.62:33317
I20260810 13:53:23.522781 13343 heartbeater.cc:461] Registering TS with master...
I20260810 13:53:23.523043 13340 heartbeater.cc:507] Master 127.12.36.60:38017 requested a full tablet report, sending...
I20260810 13:53:23.524199 13343 heartbeater.cc:507] Master 127.12.36.62:33317 requested a full tablet report, sending...
I20260810 13:53:23.526082 12750 ts_manager.cc:194] Registered new tserver with Master: 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:23.527463 12495 ts_manager.cc:194] Registered new tserver with Master: 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:23.528393 12750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.36.2:48345
I20260810 13:53:23.534770 13342 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:53:23.535223 13342 heartbeater.cc:461] Registering TS with master...
I20260810 13:53:23.535993 13342 heartbeater.cc:507] Master 127.12.36.61:35861 requested a full tablet report, sending...
I20260810 13:53:23.538758 12612 ts_manager.cc:194] Registered new tserver with Master: 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:23.700357 13353 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:23.700917 13353 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:23.703096 13353 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:23.703955 12512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:53:23.704348 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:23.705945 12588 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:53:23.706769 13353 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:53:23.882768 13352 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 13:53:23.883477 13352 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 13:53:23.884109 13352 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260810 13:53:23.917987 13352 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 13:53:23.918951 13352 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.36.3
I20260810 13:53:23.956101 13352 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.36.20:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.36.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.36.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.36.3
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 13:43:20 UTC on e7f111948823
build id 13275
TSAN enabled
I20260810 13:53:23.957612 13352 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 13:53:23.959299 13352 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260810 13:53:23.971711 13363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:24.032972 13340 heartbeater.cc:499] Master 127.12.36.60:38017 was elected leader, sending a full tablet report...
I20260810 13:53:24.494491 13371 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:24.495110 13371 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:24.497305 13371 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:24.498993 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:24.498878 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:53:24.501330 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:24.502453 13371 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:53:23.973528 13364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:23.977295 13367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:25.207206 13365 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260810 13:53:25.207331 13352 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260810 13:53:25.211772 13352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 13:53:25.214885 13352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 13:53:25.216358 13352 hybrid_clock.cc:648] HybridClock initialized: now 1786370005216295 us; error 74 us; skew 500 ppm
I20260810 13:53:25.217485 13352 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 13:53:25.224851 13352 webserver.cc:533] Webserver started at http://127.12.36.3:41137/ using document root <none> and password file <none>
I20260810 13:53:25.225911 13352 fs_manager.cc:362] Metadata directory not provided
I20260810 13:53:25.226125 13352 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 13:53:25.226684 13352 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 13:53:25.231423 13352 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/data/instance:
uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
format_stamp: "Formatted at 2026-08-10 13:53:25 on dist-test-slave-s11t"
I20260810 13:53:25.232642 13352 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/instance:
uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
format_stamp: "Formatted at 2026-08-10 13:53:25 on dist-test-slave-s11t"
I20260810 13:53:25.240442 13352 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260810 13:53:25.246500 13379 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:25.247689 13352 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260810 13:53:25.248049 13352 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/data,/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal
uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
format_stamp: "Formatted at 2026-08-10 13:53:25 on dist-test-slave-s11t"
I20260810 13:53:25.248410 13352 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 13:53:25.311415 13352 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 13:53:25.313280 13352 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 13:53:25.313776 13352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 13:53:25.316506 13352 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260810 13:53:25.321033 13352 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 13:53:25.321269 13352 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:25.321554 13352 ts_tablet_manager.cc:616] Registered 0 tablets
I20260810 13:53:25.321723 13352 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:25.482733 13352 rpc_server.cc:307] RPC server started. Bound to: 127.12.36.3:36001
I20260810 13:53:25.482957 13549 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.36.3:36001 every 8 connection(s)
I20260810 13:53:25.485615 13352 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/data/info.pb
I20260810 13:53:25.495451 12432 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu as pid 13352
I20260810 13:53:25.495934 12432 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/instance
I20260810 13:53:25.552181 13550 heartbeater.cc:344] Connected to a master server at 127.12.36.60:38017
I20260810 13:53:25.552538 13552 heartbeater.cc:344] Connected to a master server at 127.12.36.62:33317
I20260810 13:53:25.552804 13550 heartbeater.cc:461] Registering TS with master...
I20260810 13:53:25.552997 13552 heartbeater.cc:461] Registering TS with master...
I20260810 13:53:25.554540 13552 heartbeater.cc:507] Master 127.12.36.62:33317 requested a full tablet report, sending...
I20260810 13:53:25.557150 13550 heartbeater.cc:507] Master 127.12.36.60:38017 requested a full tablet report, sending...
I20260810 13:53:25.557899 12495 ts_manager.cc:194] Registered new tserver with Master: 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:25.559885 12750 ts_manager.cc:194] Registered new tserver with Master: 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:25.561143 13551 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:53:25.561488 13551 heartbeater.cc:461] Registering TS with master...
I20260810 13:53:25.561970 12750 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.36.3:34657
I20260810 13:53:25.562391 13551 heartbeater.cc:507] Master 127.12.36.61:35861 requested a full tablet report, sending...
I20260810 13:53:25.565213 12612 ts_manager.cc:194] Registered new tserver with Master: 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:25.571158 12432 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260810 13:53:25.598356 13568 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:25.603062 13568 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:25.606777 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:25.609361 13568 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:25.609345 12512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:53:25.611181 12591 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:53:25.612286 13568 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:25.650162 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c3a52188eb474082b919c356f9aadfb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:25.652099 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c09fe6b0bdc144ec9c3830e86252e974"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:25.653577 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_71ac9cc8052d4fd88f7c9927f25e447f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:25.658955 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71ac9cc8052d4fd88f7c9927f25e447f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:25.659014 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c09fe6b0bdc144ec9c3830e86252e974 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:25.663365 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3a52188eb474082b919c356f9aadfb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:25.682139 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6e1eefb8f7bc4038a6c054f1b1fddc99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:25.684446 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e1eefb8f7bc4038a6c054f1b1fddc99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:25.747901 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_71ac9cc8052d4fd88f7c9927f25e447f" } new_table_name: "default.Table_4f138df89fef4ed2a9c5d12c80a75ea1" modify_external_catalogs: true
I20260810 13:53:25.761739 12432 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu with pid 12560
I20260810 13:53:25.782158 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c3a52188eb474082b919c356f9aadfb3" } new_table_name: "default.Table_d6a35ebd63dc4eb3a1376a9f5c146ee9" modify_external_catalogs: true
I20260810 13:53:25.785351 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c09fe6b0bdc144ec9c3830e86252e974" } modify_external_catalogs: true
I20260810 13:53:25.786232 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c09fe6b0bdc144ec9c3830e86252e974" } modify_external_catalogs: true
I20260810 13:53:25.802868 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6e1eefb8f7bc4038a6c054f1b1fddc99" } modify_external_catalogs: true
I20260810 13:53:25.803514 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6e1eefb8f7bc4038a6c054f1b1fddc99" } modify_external_catalogs: true
W20260810 13:53:25.823161 12728 connection.cc:573] client connection to 127.12.36.61:35861 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 13:53:25.823621 12728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 1 similar messages]
W20260810 13:53:25.844209 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 465063c8535141babc56e282aeb1123b consensus state has no leader
I20260810 13:53:25.845435 12750 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet bb9ffeb7e3bb4233bf2b8a09b0976752
W20260810 13:53:25.846073 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b4a3bdfd610415ca52aa6eaef015c1e has no consensus state
I20260810 13:53:25.858736 12746 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet de6c96d117ef43839750fa6074522e1a
W20260810 13:53:25.868206 13121 heartbeater.cc:646] Failed to heartbeat to 127.12.36.61:35861 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
W20260810 13:53:25.894610 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 70997.1us
W20260810 13:53:25.898087 12728 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 -> Peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Couldn't send request to peer 2928f7d4503145b182d99007d240334d. Status: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:25.898738 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 465063c8535141babc56e282aeb1123b (DEFAULT_TABLE table=default.Table_71ac9cc8052d4fd88f7c9927f25e447f [id=e5f2a566d27f4740bbc22013fa97ffbb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:25.903370 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 465063c8535141babc56e282aeb1123b consensus state has no leader
I20260810 13:53:25.904897 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (DEFAULT_TABLE table=default.Table_d6a35ebd63dc4eb3a1376a9f5c146ee9 [id=16ae437e3ead46bf9b523ac06f73efe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:25.906647 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465063c8535141babc56e282aeb1123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:25.907526 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4a3bdfd610415ca52aa6eaef015c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:25.909956 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 465063c8535141babc56e282aeb1123b (DEFAULT_TABLE table=default.Table_71ac9cc8052d4fd88f7c9927f25e447f [id=e5f2a566d27f4740bbc22013fa97ffbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:25.913869 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (DEFAULT_TABLE table=default.Table_d6a35ebd63dc4eb3a1376a9f5c146ee9 [id=16ae437e3ead46bf9b523ac06f73efe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:25.915452 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4a3bdfd610415ca52aa6eaef015c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:25.915473 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 465063c8535141babc56e282aeb1123b (DEFAULT_TABLE table=default.Table_71ac9cc8052d4fd88f7c9927f25e447f [id=e5f2a566d27f4740bbc22013fa97ffbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:25.917445 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465063c8535141babc56e282aeb1123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:25.917204 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (DEFAULT_TABLE table=default.Table_d6a35ebd63dc4eb3a1376a9f5c146ee9 [id=16ae437e3ead46bf9b523ac06f73efe2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:25.918324 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4a3bdfd610415ca52aa6eaef015c1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:25.923978 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465063c8535141babc56e282aeb1123b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:25.948303 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_628b33635c22408a808a1c792b9b38df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:25.950156 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_628b33635c22408a808a1c792b9b38df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:25.974642 13638 tablet_bootstrap.cc:492] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:25.982318 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_03c3e8cdb25c4e74b95448bb04852e4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:25.982368 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5f1e5ca2b3e44e11830eac76731bb6ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:25.984201 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f1e5ca2b3e44e11830eac76731bb6ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:25.987200 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03c3e8cdb25c4e74b95448bb04852e4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:25.990284 13639 tablet_bootstrap.cc:492] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:26.003629 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_35fba6a38ac84093a01caadced2cab4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:26.006084 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35fba6a38ac84093a01caadced2cab4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.007668 13021 tablet_service.cc:1511] Processing CreateTablet for tablet e103757fbb0443f4bd686dfa27d395c8 (DEFAULT_TABLE table=default.Table_628b33635c22408a808a1c792b9b38df [id=e9f23d43853244cda1cf4f52cc3876c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.009691 13638 tablet_bootstrap.cc:654] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.009892 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e103757fbb0443f4bd686dfa27d395c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.009809 13448 tablet_service.cc:1511] Processing CreateTablet for tablet e103757fbb0443f4bd686dfa27d395c8 (DEFAULT_TABLE table=default.Table_628b33635c22408a808a1c792b9b38df [id=e9f23d43853244cda1cf4f52cc3876c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.015239 13639 tablet_bootstrap.cc:654] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.016258 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e103757fbb0443f4bd686dfa27d395c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.016855 13638 log.cc:826] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: Log is configured to *not* fsync() on all Append() calls
I20260810 13:53:26.017565 13239 tablet_service.cc:1511] Processing CreateTablet for tablet e103757fbb0443f4bd686dfa27d395c8 (DEFAULT_TABLE table=default.Table_628b33635c22408a808a1c792b9b38df [id=e9f23d43853244cda1cf4f52cc3876c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.018698 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e103757fbb0443f4bd686dfa27d395c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.022347 13639 log.cc:826] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Log is configured to *not* fsync() on all Append() calls
I20260810 13:53:26.040598 13640 tablet_bootstrap.cc:492] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:26.044131 13639 tablet_bootstrap.cc:492] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:26.044871 13639 ts_tablet_manager.cc:1403] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.055s user 0.019s sys 0.000s
I20260810 13:53:26.058643 13640 tablet_bootstrap.cc:654] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.061234 13640 log.cc:826] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Log is configured to *not* fsync() on all Append() calls
I20260810 13:53:26.066192 13550 heartbeater.cc:499] Master 127.12.36.60:38017 was elected leader, sending a full tablet report...
I20260810 13:53:26.067480 13638 tablet_bootstrap.cc:492] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
W20260810 13:53:26.081097 13342 heartbeater.cc:646] Failed to heartbeat to 127.12.36.61:35861 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
I20260810 13:53:26.068043 13638 ts_tablet_manager.cc:1403] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.094s user 0.022s sys 0.001s
W20260810 13:53:26.086593 13551 heartbeater.cc:646] Failed to heartbeat to 127.12.36.61:35861 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
I20260810 13:53:26.086196 13639 raft_consensus.cc:359] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.087335 13639 raft_consensus.cc:385] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.087724 13639 raft_consensus.cc:740] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.089162 13639 consensus_queue.cc:260] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.107605 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_d6a35ebd63dc4eb3a1376a9f5c146ee9 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 1 got 0
I20260810 13:53:26.113724 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 2dd00107ea47488cba5307085ac1d4ea (DEFAULT_TABLE table=default.Table_03c3e8cdb25c4e74b95448bb04852e4e [id=668fe64db5944e3386a28cdc01def6c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.114079 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 394e07c2950c49a88e189e61e87ba0be (DEFAULT_TABLE table=default.Table_5f1e5ca2b3e44e11830eac76731bb6ac [id=5d7232c0c2264e4ba251264718d41676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.114916 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dd00107ea47488cba5307085ac1d4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.115443 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394e07c2950c49a88e189e61e87ba0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.120054 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 2dd00107ea47488cba5307085ac1d4ea (DEFAULT_TABLE table=default.Table_03c3e8cdb25c4e74b95448bb04852e4e [id=668fe64db5944e3386a28cdc01def6c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.121237 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dd00107ea47488cba5307085ac1d4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.124492 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 394e07c2950c49a88e189e61e87ba0be (DEFAULT_TABLE table=default.Table_5f1e5ca2b3e44e11830eac76731bb6ac [id=5d7232c0c2264e4ba251264718d41676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.127691 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 394e07c2950c49a88e189e61e87ba0be (DEFAULT_TABLE table=default.Table_5f1e5ca2b3e44e11830eac76731bb6ac [id=5d7232c0c2264e4ba251264718d41676]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.128855 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394e07c2950c49a88e189e61e87ba0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.129590 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 2dd00107ea47488cba5307085ac1d4ea (DEFAULT_TABLE table=default.Table_03c3e8cdb25c4e74b95448bb04852e4e [id=668fe64db5944e3386a28cdc01def6c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.130618 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dd00107ea47488cba5307085ac1d4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.134091 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394e07c2950c49a88e189e61e87ba0be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.114100 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_628b33635c22408a808a1c792b9b38df" } modify_external_catalogs: true
I20260810 13:53:26.138675 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_628b33635c22408a808a1c792b9b38df" } modify_external_catalogs: true
I20260810 13:53:26.114897 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_35fba6a38ac84093a01caadced2cab4c" } new_table_name: "default.Table_34ce7facbd6249d58cc61cf48ca51445" modify_external_catalogs: true
I20260810 13:53:26.115715 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d6a35ebd63dc4eb3a1376a9f5c146ee9" } new_table_name: "default.Table_df76b2220c764fa2aa344370813be7a3" modify_external_catalogs: true
I20260810 13:53:26.116662 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_03c3e8cdb25c4e74b95448bb04852e4e" } modify_external_catalogs: true
I20260810 13:53:26.146704 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_03c3e8cdb25c4e74b95448bb04852e4e" } modify_external_catalogs: true
I20260810 13:53:26.153044 13639 ts_tablet_manager.cc:1434] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.107s user 0.027s sys 0.031s
I20260810 13:53:26.158881 13639 tablet_bootstrap.cc:492] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:26.159047 13638 raft_consensus.cc:359] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:26.159988 13638 raft_consensus.cc:385] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.160285 13638 raft_consensus.cc:740] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.161933 13638 consensus_queue.cc:260] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:26.173071 13639 tablet_bootstrap.cc:654] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.174300 13638 ts_tablet_manager.cc:1434] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.091s user 0.036s sys 0.012s
W20260810 13:53:26.179446 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a47b0b44837544e48e6d63b491180480 has no consensus state
I20260810 13:53:26.181843 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb]). Expected version 1 got 0
I20260810 13:53:26.190056 13638 tablet_bootstrap.cc:492] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:26.195386 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b7844744ce554875a74995b2371a5e24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:26.197165 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_d6a35ebd63dc4eb3a1376a9f5c146ee9 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 1 got 0
W20260810 13:53:26.197508 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7844744ce554875a74995b2371a5e24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.200730 13638 tablet_bootstrap.cc:654] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.209013 13639 tablet_bootstrap.cc:492] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:26.209697 13639 ts_tablet_manager.cc:1403] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.051s user 0.015s sys 0.025s
I20260810 13:53:26.214226 13639 raft_consensus.cc:359] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:26.217043 13598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:53:26.217839 13598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: This master's current role is: LEADER
I20260810 13:53:26.219233 13638 tablet_bootstrap.cc:492] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:26.219691 13638 ts_tablet_manager.cc:1403] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.007s
I20260810 13:53:26.222956 13638 raft_consensus.cc:359] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.224263 13639 raft_consensus.cc:385] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.224843 13639 raft_consensus.cc:740] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.225929 13639 consensus_queue.cc:260] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
W20260810 13:53:26.227113 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b4a3bdfd610415ca52aa6eaef015c1e consensus state has no leader
I20260810 13:53:26.228507 13638 raft_consensus.cc:385] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.228977 13638 raft_consensus.cc:740] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.229954 13638 consensus_queue.cc:260] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.232570 13639 ts_tablet_manager.cc:1434] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.022s user 0.000s sys 0.007s
I20260810 13:53:26.233482 13639 tablet_bootstrap.cc:492] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:26.236370 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d9f2e640274346958d290a6a77b1a515"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:26.234412 13640 tablet_bootstrap.cc:492] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
W20260810 13:53:26.238251 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9f2e640274346958d290a6a77b1a515 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.238615 13640 ts_tablet_manager.cc:1403] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.199s user 0.022s sys 0.022s
I20260810 13:53:26.241631 13638 ts_tablet_manager.cc:1434] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.022s user 0.009s sys 0.001s
I20260810 13:53:26.251343 13638 tablet_bootstrap.cc:492] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:53:26.252975 13345 tablet.cc:2406] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:53:26.254423 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d5cdc422c7d54e0191f33637f3a9822d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:26.256186 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5cdc422c7d54e0191f33637f3a9822d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.269484 13638 tablet_bootstrap.cc:654] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.273458 13639 tablet_bootstrap.cc:654] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.277843 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet e103757fbb0443f4bd686dfa27d395c8
W20260810 13:53:26.278003 13130 tablet.cc:2406] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:53:26.283900 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet e103757fbb0443f4bd686dfa27d395c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:26.284754 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet e103757fbb0443f4bd686dfa27d395c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:26.287016 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_254925321ada4ac0a5d1d64433f511ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:26.290424 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_254925321ada4ac0a5d1d64433f511ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.296391 13638 tablet_bootstrap.cc:492] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:26.297796 13638 ts_tablet_manager.cc:1403] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.047s user 0.014s sys 0.007s
W20260810 13:53:26.300598 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet e103757fbb0443f4bd686dfa27d395c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e103757fbb0443f4bd686dfa27d395c8 already in progress: creating tablet
I20260810 13:53:26.303117 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet e103757fbb0443f4bd686dfa27d395c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:26.305259 13638 raft_consensus.cc:359] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.306349 13638 raft_consensus.cc:385] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.306749 13638 raft_consensus.cc:740] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:26.309499 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet e103757fbb0443f4bd686dfa27d395c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e103757fbb0443f4bd686dfa27d395c8 already in progress: creating tablet
W20260810 13:53:26.312795 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet e103757fbb0443f4bd686dfa27d395c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e103757fbb0443f4bd686dfa27d395c8 already in progress: creating tablet
I20260810 13:53:26.313828 13638 consensus_queue.cc:260] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.332461 13639 tablet_bootstrap.cc:492] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:26.333184 13639 ts_tablet_manager.cc:1403] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.100s user 0.021s sys 0.008s
I20260810 13:53:26.335080 13640 raft_consensus.cc:359] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.336149 13640 raft_consensus.cc:385] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.336525 13640 raft_consensus.cc:740] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.337647 13640 consensus_queue.cc:260] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.338433 13638 ts_tablet_manager.cc:1434] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.040s user 0.004s sys 0.005s
I20260810 13:53:26.344650 13638 tablet_bootstrap.cc:492] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:26.345619 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb]). Expected version 1 got 0
I20260810 13:53:26.353324 13639 raft_consensus.cc:359] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.354391 13639 raft_consensus.cc:385] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.354815 13639 raft_consensus.cc:740] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.356091 13639 consensus_queue.cc:260] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.359148 13640 ts_tablet_manager.cc:1434] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.120s user 0.034s sys 0.012s
I20260810 13:53:26.359797 13647 raft_consensus.cc:493] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:26.360357 13647 raft_consensus.cc:515] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.363262 13640 tablet_bootstrap.cc:492] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:26.368183 13647 leader_election.cc:290] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:26.373575 13639 ts_tablet_manager.cc:1434] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.040s user 0.002s sys 0.007s
I20260810 13:53:26.375116 13639 tablet_bootstrap.cc:492] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:26.377621 13638 tablet_bootstrap.cc:654] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.380230 13238 tablet_service.cc:1511] Processing CreateTablet for tablet a47b0b44837544e48e6d63b491180480 (DEFAULT_TABLE table=default.Table_34ce7facbd6249d58cc61cf48ca51445 [id=6a58f36b9cc94db892c400b918a3d6ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.381464 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47b0b44837544e48e6d63b491180480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.382321 12747 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_df76b2220c764fa2aa344370813be7a3 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 2 got 0
I20260810 13:53:26.383004 12747 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb]). Expected version 1 got 0
I20260810 13:53:26.385555 13448 tablet_service.cc:1511] Processing CreateTablet for tablet a47b0b44837544e48e6d63b491180480 (DEFAULT_TABLE table=default.Table_34ce7facbd6249d58cc61cf48ca51445 [id=6a58f36b9cc94db892c400b918a3d6ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.386665 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47b0b44837544e48e6d63b491180480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.386550 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d9f2e640274346958d290a6a77b1a515" } new_table_name: "default.Table_74e65082c82a41da9e49bc004e93a539" modify_external_catalogs: true
I20260810 13:53:26.388834 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_df76b2220c764fa2aa344370813be7a3 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 2 got 0
I20260810 13:53:26.389129 13639 tablet_bootstrap.cc:654] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.395880 12746 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_df76b2220c764fa2aa344370813be7a3 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 2 got 0
I20260810 13:53:26.397874 13638 tablet_bootstrap.cc:492] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:26.398552 13638 ts_tablet_manager.cc:1403] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.008s
I20260810 13:53:26.402444 13638 raft_consensus.cc:359] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:26.403407 13638 raft_consensus.cc:385] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.403815 13638 raft_consensus.cc:740] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.406227 13638 consensus_queue.cc:260] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:26.416232 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e103757fbb0443f4bd686dfa27d395c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:26.416885 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_df76b2220c764fa2aa344370813be7a3 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 2 got 0
I20260810 13:53:26.417200 13269 raft_consensus.cc:2468] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:26.424795 13639 tablet_bootstrap.cc:492] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:26.425252 13639 ts_tablet_manager.cc:1403] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.012s
I20260810 13:53:26.425385 13649 raft_consensus.cc:493] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:26.425905 13649 raft_consensus.cc:515] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:26.428158 13639 raft_consensus.cc:359] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.428926 13639 raft_consensus.cc:385] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.429574 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet e103757fbb0443f4bd686dfa27d395c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:26.429754 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 2dd00107ea47488cba5307085ac1d4ea
I20260810 13:53:26.429224 13639 raft_consensus.cc:740] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.430763 13659 tablet_replica.cc:333] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:26.430540 13639 consensus_queue.cc:260] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.431674 13659 raft_consensus.cc:2243] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:26.432257 13659 raft_consensus.cc:2272] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:26.433244 13639 ts_tablet_manager.cc:1434] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
I20260810 13:53:26.434217 13639 tablet_bootstrap.cc:492] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:26.437922 12952 leader_election.cc:304] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:26.438973 13647 raft_consensus.cc:2804] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:26.439400 13647 raft_consensus.cc:493] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:26.439771 13647 raft_consensus.cc:3060] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:26.446703 13640 tablet_bootstrap.cc:654] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.447172 13647 raft_consensus.cc:515] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.449810 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dd00107ea47488cba5307085ac1d4ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:26.450621 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b7844744ce554875a74995b2371a5e24" } new_table_name: "default.Table_6d1ac1ffe2c3491eacaca400fa77e02e" modify_external_catalogs: true
I20260810 13:53:26.453009 13649 leader_election.cc:290] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:26.453702 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e103757fbb0443f4bd686dfa27d395c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
W20260810 13:53:26.456346 12952 leader_election.cc:343] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:26.458210 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 has no consensus state
I20260810 13:53:26.458709 13659 ts_tablet_manager.cc:1916] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:26.463857 13638 ts_tablet_manager.cc:1434] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.065s user 0.009s sys 0.001s
I20260810 13:53:26.468006 13638 tablet_bootstrap.cc:492] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:26.478778 13639 tablet_bootstrap.cc:654] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.481827 13647 leader_election.cc:290] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:26.481666 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_da31a6414de0420797bc02d5aae29cfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:26.483372 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da31a6414de0420797bc02d5aae29cfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.491120 12749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5f1e5ca2b3e44e11830eac76731bb6ac" } modify_external_catalogs: true
I20260810 13:53:26.491773 12749 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5f1e5ca2b3e44e11830eac76731bb6ac" } modify_external_catalogs: true
I20260810 13:53:26.506035 13639 tablet_bootstrap.cc:492] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:26.506544 13639 ts_tablet_manager.cc:1403] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.073s user 0.008s sys 0.003s
I20260810 13:53:26.517758 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465063c8535141babc56e282aeb1123b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:26.521777 13558 tablet.cc:2406] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:53:26.522631 13649 raft_consensus.cc:493] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:53:26.523241 13164 leader_election.cc:343] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:26.523105 13649 raft_consensus.cc:515] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.525308 13649 leader_election.cc:290] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:26.526310 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dd00107ea47488cba5307085ac1d4ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:26.526814 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4a3bdfd610415ca52aa6eaef015c1e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:26.527515 13480 raft_consensus.cc:2468] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:26.527930 13639 raft_consensus.cc:359] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:26.528707 13639 raft_consensus.cc:385] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:53:26.528825 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 2dd00107ea47488cba5307085ac1d4ea because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2dd00107ea47488cba5307085ac1d4ea already in progress: creating tablet
I20260810 13:53:26.528992 13164 leader_election.cc:304] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:26.529984 13649 raft_consensus.cc:2804] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:26.530337 13649 raft_consensus.cc:493] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:26.530671 13649 raft_consensus.cc:3060] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:26.529016 13639 raft_consensus.cc:740] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.535995 13639 consensus_queue.cc:260] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:26.536350 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b28133509ac340049d7fb72f0e2290bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:26.538105 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b28133509ac340049d7fb72f0e2290bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.551388 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_73d7514d0db94180a653017132899f14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:26.562269 13649 raft_consensus.cc:515] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.523079 13638 tablet_bootstrap.cc:654] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:26.570803 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 753ce298de754598b0cde6a4d5f38df1 has no consensus state
W20260810 13:53:26.573503 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73d7514d0db94180a653017132899f14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.585147 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4a3bdfd610415ca52aa6eaef015c1e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:26.586380 13480 raft_consensus.cc:3060] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:26.595151 13639 ts_tablet_manager.cc:1434] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.088s user 0.017s sys 0.013s
I20260810 13:53:26.596347 13480 raft_consensus.cc:2468] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:26.597636 13164 leader_election.cc:304] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:26.609159 13647 raft_consensus.cc:493] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:26.609887 13647 raft_consensus.cc:515] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:26.614928 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_182e1475c2d24f46a16c26910ea781f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:26.617321 13647 leader_election.cc:290] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:26.626168 13640 tablet_bootstrap.cc:492] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:26.626889 13640 ts_tablet_manager.cc:1403] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.264s user 0.022s sys 0.018s
I20260810 13:53:26.625988 13649 leader_election.cc:290] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:26.627897 13675 raft_consensus.cc:2804] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:26.632095 13640 raft_consensus.cc:359] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:26.633260 13640 raft_consensus.cc:385] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.633706 13640 raft_consensus.cc:740] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.634620 13640 consensus_queue.cc:260] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:26.636075 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_da31a6414de0420797bc02d5aae29cfd" } modify_external_catalogs: true
I20260810 13:53:26.636857 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_da31a6414de0420797bc02d5aae29cfd" } modify_external_catalogs: true
W20260810 13:53:26.645174 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_182e1475c2d24f46a16c26910ea781f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.653426 13640 ts_tablet_manager.cc:1434] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.026s user 0.010s sys 0.001s
I20260810 13:53:26.667313 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b28133509ac340049d7fb72f0e2290bd" } new_table_name: "default.Table_97c5eb6773e04cb680d7e463b5b77bc8" modify_external_catalogs: true
I20260810 13:53:26.673439 13640 tablet_bootstrap.cc:492] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:26.679826 12743 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet f0af5c72fdd64e42a8e811a748459fd2
I20260810 13:53:26.686884 13640 tablet_bootstrap.cc:654] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:26.702246 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e23454581a9a4b55b0756ef890dee7fb has no consensus state
I20260810 13:53:26.702852 13640 tablet_bootstrap.cc:492] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:26.703456 13640 ts_tablet_manager.cc:1403] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.030s user 0.016s sys 0.005s
I20260810 13:53:26.707136 13640 raft_consensus.cc:359] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.708211 13640 raft_consensus.cc:385] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.708668 13640 raft_consensus.cc:740] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.710177 13640 consensus_queue.cc:260] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.725735 13640 ts_tablet_manager.cc:1434] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.022s user 0.010s sys 0.001s
I20260810 13:53:26.728273 13638 tablet_bootstrap.cc:492] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:26.734200 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465063c8535141babc56e282aeb1123b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:26.734828 13269 raft_consensus.cc:2468] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:26.736258 12952 leader_election.cc:304] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:26.737576 13647 raft_consensus.cc:2804] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:26.738054 13647 raft_consensus.cc:493] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:26.738543 13647 raft_consensus.cc:3060] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:26.729627 13638 ts_tablet_manager.cc:1403] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.262s user 0.018s sys 0.000s
I20260810 13:53:26.748163 13647 raft_consensus.cc:515] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:26.748263 13021 tablet_service.cc:1511] Processing CreateTablet for tablet a47b0b44837544e48e6d63b491180480 (DEFAULT_TABLE table=default.Table_34ce7facbd6249d58cc61cf48ca51445 [id=6a58f36b9cc94db892c400b918a3d6ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.750052 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47b0b44837544e48e6d63b491180480. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.756009 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dd00107ea47488cba5307085ac1d4ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:26.757061 13658 tablet_replica.cc:333] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:26.757980 13658 raft_consensus.cc:2243] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:26.758545 13658 raft_consensus.cc:2272] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:26.761840 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9f1a4614abb8413abe5d5ce8191cf755"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:26.762535 13658 ts_tablet_manager.cc:1916] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:26.763305 13640 tablet_bootstrap.cc:492] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:53:26.763680 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f1a4614abb8413abe5d5ce8191cf755 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.771616 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465063c8535141babc56e282aeb1123b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:26.772622 13057 raft_consensus.cc:2393] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:53:26.773993 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4a3bdfd610415ca52aa6eaef015c1e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:26.774362 13647 leader_election.cc:290] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:26.774740 13056 raft_consensus.cc:2468] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:26.776393 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b4a3bdfd610415ca52aa6eaef015c1e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:26.777108 13054 raft_consensus.cc:3060] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:26.781150 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e103757fbb0443f4bd686dfa27d395c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:26.781903 13480 raft_consensus.cc:2468] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:26.783075 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e103757fbb0443f4bd686dfa27d395c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:26.783691 13477 raft_consensus.cc:3060] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:26.744652 13659 ts_tablet_manager.cc:1929] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:26.761490 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465063c8535141babc56e282aeb1123b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:26.786106 13269 raft_consensus.cc:3060] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:26.789233 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465063c8535141babc56e282aeb1123b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:26.789856 13476 raft_consensus.cc:2468] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:26.790966 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465063c8535141babc56e282aeb1123b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:26.791540 13475 raft_consensus.cc:3060] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:26.784888 13675 raft_consensus.cc:697] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:26.793725 13675 consensus_queue.cc:237] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.747243 13638 raft_consensus.cc:359] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.799579 13238 tablet_service.cc:1511] Processing CreateTablet for tablet fdb4301bda1c457eb99de7e99263da41 (DEFAULT_TABLE table=default.Table_254925321ada4ac0a5d1d64433f511ec [id=351ef27fc29d4ac48362d1c1ce7aa3ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.800719 13239 tablet_service.cc:1511] Processing CreateTablet for tablet e4f7173588194000bb6ff0e9f72ced98 (DEFAULT_TABLE table=default.Table_d5cdc422c7d54e0191f33637f3a9822d [id=5c116d56fd00422f80495064d32a7f4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.801491 13269 raft_consensus.cc:2468] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:26.801962 13640 tablet_bootstrap.cc:654] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:26.802721 12952 leader_election.cc:304] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:26.802697 13236 tablet_service.cc:1511] Processing CreateTablet for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 (DEFAULT_TABLE table=default.Table_74e65082c82a41da9e49bc004e93a539 [id=3223eee4aaa74b849772949d52da374b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.803864 13647 raft_consensus.cc:2804] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:26.804821 12747 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb]). Expected version 1 got 0
I20260810 13:53:26.805200 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_182e1475c2d24f46a16c26910ea781f7" } new_table_name: "default.Table_9fcafa456d124c5d95b8e9e9f76dba13" modify_external_catalogs: true
I20260810 13:53:26.808981 13448 tablet_service.cc:1511] Processing CreateTablet for tablet fdb4301bda1c457eb99de7e99263da41 (DEFAULT_TABLE table=default.Table_254925321ada4ac0a5d1d64433f511ec [id=351ef27fc29d4ac48362d1c1ce7aa3ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.810456 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb4301bda1c457eb99de7e99263da41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.813767 13445 tablet_service.cc:1511] Processing CreateTablet for tablet e4f7173588194000bb6ff0e9f72ced98 (DEFAULT_TABLE table=default.Table_d5cdc422c7d54e0191f33637f3a9822d [id=5c116d56fd00422f80495064d32a7f4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.814859 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f7173588194000bb6ff0e9f72ced98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.814790 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ab738697d8ab40ea911724a98689bcf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:26.816581 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab738697d8ab40ea911724a98689bcf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.817729 13442 tablet_service.cc:1511] Processing CreateTablet for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 (DEFAULT_TABLE table=default.Table_74e65082c82a41da9e49bc004e93a539 [id=3223eee4aaa74b849772949d52da374b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.819131 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.821686 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 753ce298de754598b0cde6a4d5f38df1 (DEFAULT_TABLE table=default.Table_6d1ac1ffe2c3491eacaca400fa77e02e [id=499867c6462c4d07bc1e9ade02170394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.822829 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753ce298de754598b0cde6a4d5f38df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.800737 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb4301bda1c457eb99de7e99263da41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.829110 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f7173588194000bb6ff0e9f72ced98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.799597 13659 log.cc:1199] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/e103757fbb0443f4bd686dfa27d395c8
I20260810 13:53:26.834822 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.836747 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5920060ddbce482392401dc8c24f703f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:26.838539 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5920060ddbce482392401dc8c24f703f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.844939 12750 catalog_manager.cc:5719] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:26.847388 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_df76b2220c764fa2aa344370813be7a3 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 2 got 0
I20260810 13:53:26.856050 13022 tablet_service.cc:1511] Processing CreateTablet for tablet fdb4301bda1c457eb99de7e99263da41 (DEFAULT_TABLE table=default.Table_254925321ada4ac0a5d1d64433f511ec [id=351ef27fc29d4ac48362d1c1ce7aa3ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.857234 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb4301bda1c457eb99de7e99263da41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.867707 13477 raft_consensus.cc:2468] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:26.870927 13020 tablet_service.cc:1511] Processing CreateTablet for tablet e4f7173588194000bb6ff0e9f72ced98 (DEFAULT_TABLE table=default.Table_d5cdc422c7d54e0191f33637f3a9822d [id=5c116d56fd00422f80495064d32a7f4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.872193 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f7173588194000bb6ff0e9f72ced98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.872991 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 753ce298de754598b0cde6a4d5f38df1 (DEFAULT_TABLE table=default.Table_6d1ac1ffe2c3491eacaca400fa77e02e [id=499867c6462c4d07bc1e9ade02170394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.880934 13167 leader_election.cc:304] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:26.881950 13675 raft_consensus.cc:2749] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:26.884755 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753ce298de754598b0cde6a4d5f38df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.886703 13019 tablet_service.cc:1511] Processing CreateTablet for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 (DEFAULT_TABLE table=default.Table_74e65082c82a41da9e49bc004e93a539 [id=3223eee4aaa74b849772949d52da374b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.888104 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:26.894249 13054 raft_consensus.cc:2468] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:26.899417 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_254925321ada4ac0a5d1d64433f511ec" } modify_external_catalogs: true
I20260810 13:53:26.899983 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_254925321ada4ac0a5d1d64433f511ec" } modify_external_catalogs: true
I20260810 13:53:26.799575 13638 raft_consensus.cc:385] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.903079 13638 raft_consensus.cc:740] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.903374 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6d712ead31884c588f5b2596ab077be7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:26.905208 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d712ead31884c588f5b2596ab077be7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:26.906625 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9f1a4614abb8413abe5d5ce8191cf755" } new_table_name: "default.Table_04c2694cab1b4e1ea553387407cd2ac3" modify_external_catalogs: true
I20260810 13:53:26.909348 13659 ts_tablet_manager.cc:1950] T e103757fbb0443f4bd686dfa27d395c8 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:26.902448 13475 raft_consensus.cc:2468] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:26.914013 13640 tablet_bootstrap.cc:492] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:26.914595 13640 ts_tablet_manager.cc:1403] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.152s user 0.011s sys 0.001s
I20260810 13:53:26.927138 13640 raft_consensus.cc:359] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:26.928056 13640 raft_consensus.cc:385] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:26.928574 13640 raft_consensus.cc:740] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:26.931593 13640 consensus_queue.cc:260] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:26.911432 13638 consensus_queue.cc:260] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.947636 13640 ts_tablet_manager.cc:1434] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.033s user 0.005s sys 0.006s
I20260810 13:53:26.950837 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 753ce298de754598b0cde6a4d5f38df1 (DEFAULT_TABLE table=default.Table_6d1ac1ffe2c3491eacaca400fa77e02e [id=499867c6462c4d07bc1e9ade02170394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:26.952819 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753ce298de754598b0cde6a4d5f38df1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:26.958252 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 15149232bd7645be840c1d223a829eb4 has no consensus state
I20260810 13:53:26.968004 13691 raft_consensus.cc:493] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:26.976878 13647 raft_consensus.cc:697] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:26.978670 13647 consensus_queue.cc:237] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:26.968506 13691 raft_consensus.cc:515] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:26.985291 13691 leader_election.cc:290] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:26.988466 13638 ts_tablet_manager.cc:1434] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.249s user 0.008s sys 0.000s
I20260810 13:53:26.989746 13638 tablet_bootstrap.cc:492] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:26.990729 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e07c2950c49a88e189e61e87ba0be" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:26.991521 13269 raft_consensus.cc:2468] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:26.993332 12952 leader_election.cc:304] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:26.994558 13691 raft_consensus.cc:2804] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:26.995586 13691 raft_consensus.cc:493] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:26.996243 13691 raft_consensus.cc:3060] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:26.996878 13640 tablet_bootstrap.cc:492] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:53:26.996676 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 15149232bd7645be840c1d223a829eb4 has no consensus state
I20260810 13:53:26.993832 13658 ts_tablet_manager.cc:1929] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:26.997865 13658 log.cc:1199] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/2dd00107ea47488cba5307085ac1d4ea
I20260810 13:53:26.999502 13658 ts_tablet_manager.cc:1950] T 2dd00107ea47488cba5307085ac1d4ea P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:27.032548 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet fdb4301bda1c457eb99de7e99263da41
I20260810 13:53:27.038125 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet e103757fbb0443f4bd686dfa27d395c8 (table default.Table_628b33635c22408a808a1c792b9b38df [id=e9f23d43853244cda1cf4f52cc3876c4]) successfully deleted
I20260810 13:53:27.039165 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb4301bda1c457eb99de7e99263da41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:27.041010 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb4301bda1c457eb99de7e99263da41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:27.061889 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46c08ec290e447678084964c23a930ad has no consensus state
I20260810 13:53:27.052485 13639 tablet_bootstrap.cc:492] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:27.063805 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_45bae94be351453bbeaf8295bf88f5ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:27.070655 13640 tablet_bootstrap.cc:654] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:27.076151 13659 tablet_replica.cc:333] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:27.086768 12951 leader_election.cc:304] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:53:27.093109 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45bae94be351453bbeaf8295bf88f5ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:27.101177 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet fdb4301bda1c457eb99de7e99263da41 because the tablet was not found. No further retry: Not found: Tablet not found: fdb4301bda1c457eb99de7e99263da41
I20260810 13:53:27.102316 13659 raft_consensus.cc:2243] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:27.103029 13659 raft_consensus.cc:2272] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:27.106431 13659 ts_tablet_manager.cc:1916] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:27.108958 13688 raft_consensus.cc:2804] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 13:53:27.113788 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 104133us
I20260810 13:53:27.117895 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e07c2950c49a88e189e61e87ba0be" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:27.121934 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 2dd00107ea47488cba5307085ac1d4ea (table default.Table_03c3e8cdb25c4e74b95448bb04852e4e [id=668fe64db5944e3386a28cdc01def6c1]) successfully deleted
I20260810 13:53:27.122705 13638 tablet_bootstrap.cc:654] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:27.128918 13475 raft_consensus.cc:1275] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 13:53:27.131297 13675 consensus_queue.cc:1048] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:27.134152 13691 raft_consensus.cc:515] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:27.145416 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb4301bda1c457eb99de7e99263da41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:27.137696 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb]). Expected version 1 got 0
I20260810 13:53:27.139725 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 394e07c2950c49a88e189e61e87ba0be
I20260810 13:53:27.156447 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 15149232bd7645be840c1d223a829eb4 (DEFAULT_TABLE table=default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.158782 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 394e07c2950c49a88e189e61e87ba0be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:27.159226 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15149232bd7645be840c1d223a829eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.162937 13639 tablet_bootstrap.cc:654] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:27.167245 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 394e07c2950c49a88e189e61e87ba0be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:27.168460 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 394e07c2950c49a88e189e61e87ba0be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 394e07c2950c49a88e189e61e87ba0be already in progress: creating tablet
I20260810 13:53:27.172248 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet e103757fbb0443f4bd686dfa27d395c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:27.173801 13695 tablet_replica.cc:333] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:27.175186 13695 raft_consensus.cc:2243] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:27.175802 13695 raft_consensus.cc:2272] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:27.177917 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_34ce7facbd6249d58cc61cf48ca51445" } new_table_name: "default.Table_af3b17037c8442559ad5c099a9370b2d" modify_external_catalogs: true
I20260810 13:53:27.182062 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 15149232bd7645be840c1d223a829eb4 (DEFAULT_TABLE table=default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.183426 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15149232bd7645be840c1d223a829eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.187104 13640 tablet_bootstrap.cc:492] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:27.187668 13640 ts_tablet_manager.cc:1403] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.191s user 0.016s sys 0.006s
I20260810 13:53:27.187747 13442 tablet_service.cc:1511] Processing CreateTablet for tablet e23454581a9a4b55b0756ef890dee7fb (DEFAULT_TABLE table=default.Table_97c5eb6773e04cb680d7e463b5b77bc8 [id=590b98307a364781a383eb9a072bb4d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.189798 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23454581a9a4b55b0756ef890dee7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.192821 13695 ts_tablet_manager.cc:1916] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:27.187755 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ee68a2d145ba40c4a469a9ee06d0ea05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:27.193854 13640 raft_consensus.cc:359] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:27.194895 13640 raft_consensus.cc:385] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:27.195361 13640 raft_consensus.cc:740] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:27.197118 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e (DEFAULT_TABLE table=default.Table_73d7514d0db94180a653017132899f14 [id=c6652acc3d524807ab8be29692f07874]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:27.148262 12951 leader_election.cc:343] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:27.204304 13640 consensus_queue.cc:260] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:27.210557 13688 raft_consensus.cc:697] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:27.211774 13688 consensus_queue.cc:237] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:27.215615 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 67412.7us
I20260810 13:53:27.220273 13054 raft_consensus.cc:1275] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260810 13:53:27.196661 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee68a2d145ba40c4a469a9ee06d0ea05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.223500 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 15149232bd7645be840c1d223a829eb4 (DEFAULT_TABLE table=default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.225461 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15149232bd7645be840c1d223a829eb4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:27.207010 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet fdb4301bda1c457eb99de7e99263da41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdb4301bda1c457eb99de7e99263da41 already in progress: creating tablet
I20260810 13:53:27.233623 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_bcd4624cfe8441918229192ed0a7d742"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:27.235333 13691 leader_election.cc:290] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:27.236980 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcd4624cfe8441918229192ed0a7d742 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.241449 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ec9b2dcf4f4096b27f7122fedaa33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.241338 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_4f138df89fef4ed2a9c5d12c80a75ea1" } modify_external_catalogs: true
I20260810 13:53:27.242064 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_4f138df89fef4ed2a9c5d12c80a75ea1" } modify_external_catalogs: true
I20260810 13:53:27.253794 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 394e07c2950c49a88e189e61e87ba0be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:27.255172 13236 tablet_service.cc:1511] Processing CreateTablet for tablet e23454581a9a4b55b0756ef890dee7fb (DEFAULT_TABLE table=default.Table_97c5eb6773e04cb680d7e463b5b77bc8 [id=590b98307a364781a383eb9a072bb4d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.255625 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e (DEFAULT_TABLE table=default.Table_73d7514d0db94180a653017132899f14 [id=c6652acc3d524807ab8be29692f07874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.256821 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 394e07c2950c49a88e189e61e87ba0be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:27.258605 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet e103757fbb0443f4bd686dfa27d395c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:27.260217 13658 tablet_replica.cc:333] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:27.261209 13658 raft_consensus.cc:2243] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:27.261824 13658 raft_consensus.cc:2272] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:27.256837 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e07c2950c49a88e189e61e87ba0be" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:27.265321 13269 raft_consensus.cc:3060] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:27.268057 13658 ts_tablet_manager.cc:1916] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:27.258759 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23454581a9a4b55b0756ef890dee7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.269385 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 394e07c2950c49a88e189e61e87ba0be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:27.269451 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ec9b2dcf4f4096b27f7122fedaa33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.286816 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e9033f340a474a419492b9db68676dbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:27.289458 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_73d7514d0db94180a653017132899f14" } new_table_name: "default.Table_3177f4d8098a4c45b437b8e6021b0820" modify_external_catalogs: true
W20260810 13:53:27.293462 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9033f340a474a419492b9db68676dbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.301064 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e (DEFAULT_TABLE table=default.Table_73d7514d0db94180a653017132899f14 [id=c6652acc3d524807ab8be29692f07874]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.305150 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "394e07c2950c49a88e189e61e87ba0be" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:27.305922 13477 raft_consensus.cc:3060] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:27.310395 13269 raft_consensus.cc:2468] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:27.311875 12952 leader_election.cc:304] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:53:27.312779 12952 raft_consensus.cc:2686] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:27.313050 13660 raft_consensus.cc:493] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:27.313719 13660 raft_consensus.cc:515] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:27.316557 13675 consensus_queue.cc:1048] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:53:27.326067 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 36ec9b2dcf4f4096b27f7122fedaa33e consensus state has no leader
I20260810 13:53:27.323282 13660 leader_election.cc:290] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:27.333158 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36ec9b2dcf4f4096b27f7122fedaa33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.339668 13638 tablet_bootstrap.cc:492] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:27.342885 13638 ts_tablet_manager.cc:1403] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.353s user 0.017s sys 0.009s
W20260810 13:53:27.357496 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a47b0b44837544e48e6d63b491180480 consensus state has no leader
I20260810 13:53:27.369522 13477 raft_consensus.cc:2468] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:27.371425 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5920060ddbce482392401dc8c24f703f" } modify_external_catalogs: true
I20260810 13:53:27.372334 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5920060ddbce482392401dc8c24f703f" } modify_external_catalogs: true
I20260810 13:53:27.375259 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f688a5d2568d4835bc32eb6cc9533ef9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:27.385270 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f688a5d2568d4835bc32eb6cc9533ef9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.388165 13639 tablet_bootstrap.cc:492] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:27.388681 13639 ts_tablet_manager.cc:1403] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.337s user 0.010s sys 0.010s
I20260810 13:53:27.392761 13640 ts_tablet_manager.cc:1434] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.053s user 0.003s sys 0.011s
I20260810 13:53:27.394469 13640 tablet_bootstrap.cc:492] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:27.396297 13020 tablet_service.cc:1511] Processing CreateTablet for tablet e23454581a9a4b55b0756ef890dee7fb (DEFAULT_TABLE table=default.Table_97c5eb6773e04cb680d7e463b5b77bc8 [id=590b98307a364781a383eb9a072bb4d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.401568 13659 ts_tablet_manager.cc:1929] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:27.402130 13659 log.cc:1199] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/2dd00107ea47488cba5307085ac1d4ea
I20260810 13:53:27.403287 13659 ts_tablet_manager.cc:1950] T 2dd00107ea47488cba5307085ac1d4ea P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:27.408650 13638 raft_consensus.cc:359] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:27.409629 13638 raft_consensus.cc:385] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:27.409993 13638 raft_consensus.cc:740] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:27.411160 13638 consensus_queue.cc:260] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:27.407408 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 2dd00107ea47488cba5307085ac1d4ea (table default.Table_03c3e8cdb25c4e74b95448bb04852e4e [id=668fe64db5944e3386a28cdc01def6c1]) successfully deleted
I20260810 13:53:27.418695 13639 raft_consensus.cc:359] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:27.419504 13639 raft_consensus.cc:385] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:27.419849 13639 raft_consensus.cc:740] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:27.424482 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23454581a9a4b55b0756ef890dee7fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.431090 13659 tablet_replica.cc:333] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:27.431996 13659 raft_consensus.cc:2243] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:27.447779 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_df76b2220c764fa2aa344370813be7a3 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 2 got 0
I20260810 13:53:27.458828 13659 raft_consensus.cc:2272] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:27.464012 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet fdb4301bda1c457eb99de7e99263da41 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fdb4301bda1c457eb99de7e99263da41 already in progress: creating tablet
I20260810 13:53:27.429172 13639 consensus_queue.cc:260] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:27.469990 13639 ts_tablet_manager.cc:1434] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.081s user 0.007s sys 0.003s
I20260810 13:53:27.471583 13639 tablet_bootstrap.cc:492] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:27.484526 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 394e07c2950c49a88e189e61e87ba0be with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:27.499704 13436 tablet_service.cc:1558] Processing DeleteTablet for tablet 2dd00107ea47488cba5307085ac1d4ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:27.538051 13658 ts_tablet_manager.cc:1929] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:27.538728 13658 log.cc:1199] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/394e07c2950c49a88e189e61e87ba0be
I20260810 13:53:27.539702 13658 ts_tablet_manager.cc:1950] T 394e07c2950c49a88e189e61e87ba0be P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:27.540885 13545 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad060 after lost signal to thread 13354
I20260810 13:53:27.541056 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_3358f077962d46eabe9b4a3760e186a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:27.543525 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3358f077962d46eabe9b4a3760e186a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.548494 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_45bae94be351453bbeaf8295bf88f5ec" } new_table_name: "default.Table_09b06bf2510640cbb56513f266611e9d" modify_external_catalogs: true
I20260810 13:53:27.550973 13658 tablet_replica.cc:333] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:27.552747 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6d2d5952d6e14e5f9d5b3cd2f0a29477"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:27.554641 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d2d5952d6e14e5f9d5b3cd2f0a29477 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.556032 13721 mvcc.cc:204] Tried to move back new op lower bound from 7316971549140951040 to 7316971547839070208. Current Snapshot: MvccSnapshot[applied={T|T < 7316971549140951040}]
I20260810 13:53:27.560803 13658 raft_consensus.cc:2243] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:27.561777 13658 pending_rounds.cc:70] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:53:27.562064 13658 pending_rounds.cc:77] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971549640409088 op_type: NO_OP noop_request { }
I20260810 13:53:27.562463 13658 raft_consensus.cc:2889] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260810 13:53:27.562319 13382 leader_election.cc:343] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 2dd00107ea47488cba5307085ac1d4ea
I20260810 13:53:27.562810 13658 raft_consensus.cc:2272] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:27.568141 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_df76b2220c764fa2aa344370813be7a3" } new_table_name: "default.Table_315a5491e0d94b63bc40f67a7c9b637c" modify_external_catalogs: true
W20260810 13:53:27.574616 13545 debug-util.cc:398] Leaking SignalData structure 0x7b08000adf40 after lost signal to thread 13549
I20260810 13:53:27.577828 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 394e07c2950c49a88e189e61e87ba0be (table default.Table_5f1e5ca2b3e44e11830eac76731bb6ac [id=5d7232c0c2264e4ba251264718d41676]) successfully deleted
I20260810 13:53:27.578414 13658 ts_tablet_manager.cc:1916] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:27.583109 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_33fa161792134dfcbfe20c4dafd2feb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:27.583483 13695 ts_tablet_manager.cc:1929] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 13:53:27.585068 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33fa161792134dfcbfe20c4dafd2feb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.587072 13732 tablet.cc:1724] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:27.598199 13638 ts_tablet_manager.cc:1434] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.239s user 0.010s sys 0.020s
I20260810 13:53:27.568440 13639 tablet_bootstrap.cc:654] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:27.604743 13638 tablet_bootstrap.cc:492] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:27.608179 13659 ts_tablet_manager.cc:1916] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:27.608657 13382 leader_election.cc:343] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 2dd00107ea47488cba5307085ac1d4ea
I20260810 13:53:27.609361 13382 leader_election.cc:304] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:27.613968 13660 raft_consensus.cc:2749] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:27.613426 13640 tablet_bootstrap.cc:654] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:27.621294 13727 tablet.cc:1724] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:27.583995 13695 log.cc:1199] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/e103757fbb0443f4bd686dfa27d395c8
I20260810 13:53:27.629460 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_df76b2220c764fa2aa344370813be7a3 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 2 got 0
I20260810 13:53:27.632921 13695 ts_tablet_manager.cc:1950] T e103757fbb0443f4bd686dfa27d395c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:27.640975 13639 tablet_bootstrap.cc:492] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:27.641522 13639 ts_tablet_manager.cc:1403] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.170s user 0.007s sys 0.010s
I20260810 13:53:27.642709 13638 tablet_bootstrap.cc:654] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:27.645648 13639 raft_consensus.cc:359] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:27.646427 13639 raft_consensus.cc:385] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:27.646690 13639 raft_consensus.cc:740] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:27.647408 13639 consensus_queue.cc:260] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:27.648916 13729 tablet.cc:1724] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:27.660351 13658 ts_tablet_manager.cc:1929] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:27.671737 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]). Expected version 2 got 0
I20260810 13:53:27.687107 13695 tablet_replica.cc:333] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:27.688014 13695 raft_consensus.cc:2243] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:27.688645 13695 raft_consensus.cc:2272] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:27.690498 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet e103757fbb0443f4bd686dfa27d395c8 (table default.Table_628b33635c22408a808a1c792b9b38df [id=e9f23d43853244cda1cf4f52cc3876c4]) successfully deleted
I20260810 13:53:27.691440 13695 ts_tablet_manager.cc:1916] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:27.691581 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_12936f29bc9845f4ba89e5d3fbd68a01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:27.693162 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 6cdab6f2407d4545bf6bbd81917b3434 (DEFAULT_TABLE table=default.Table_6d712ead31884c588f5b2596ab077be7 [id=a434c4a0963d4968a692435c738d2383]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.698349 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cdab6f2407d4545bf6bbd81917b3434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.705368 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 6cdab6f2407d4545bf6bbd81917b3434 (DEFAULT_TABLE table=default.Table_6d712ead31884c588f5b2596ab077be7 [id=a434c4a0963d4968a692435c738d2383]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.706847 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cdab6f2407d4545bf6bbd81917b3434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.712927 13445 tablet_service.cc:1511] Processing CreateTablet for tablet a58df75cb91544ef863a09f4d6004da0 (DEFAULT_TABLE table=default.Table_ab738697d8ab40ea911724a98689bcf1 [id=01496bab35984719a64ca2ee8e8324dd]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:27.713352 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12936f29bc9845f4ba89e5d3fbd68a01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.714819 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58df75cb91544ef863a09f4d6004da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.728159 13239 tablet_service.cc:1511] Processing CreateTablet for tablet a58df75cb91544ef863a09f4d6004da0 (DEFAULT_TABLE table=default.Table_ab738697d8ab40ea911724a98689bcf1 [id=01496bab35984719a64ca2ee8e8324dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.729799 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58df75cb91544ef863a09f4d6004da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.744940 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 46c08ec290e447678084964c23a930ad (DEFAULT_TABLE table=default.Table_04c2694cab1b4e1ea553387407cd2ac3 [id=b560a46577fe4470bc512466f972a18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.747038 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c08ec290e447678084964c23a930ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.758978 13638 tablet_bootstrap.cc:492] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:27.699004 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 6cdab6f2407d4545bf6bbd81917b3434 (DEFAULT_TABLE table=default.Table_6d712ead31884c588f5b2596ab077be7 [id=a434c4a0963d4968a692435c738d2383]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.709578 13022 tablet_service.cc:1511] Processing CreateTablet for tablet a58df75cb91544ef863a09f4d6004da0 (DEFAULT_TABLE table=default.Table_ab738697d8ab40ea911724a98689bcf1 [id=01496bab35984719a64ca2ee8e8324dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.717854 13639 ts_tablet_manager.cc:1434] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.076s user 0.007s sys 0.001s
I20260810 13:53:27.733942 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 46c08ec290e447678084964c23a930ad (DEFAULT_TABLE table=default.Table_04c2694cab1b4e1ea553387407cd2ac3 [id=b560a46577fe4470bc512466f972a18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.770864 13659 ts_tablet_manager.cc:1929] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:27.771003 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cdab6f2407d4545bf6bbd81917b3434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.771281 13659 log.cc:1199] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/394e07c2950c49a88e189e61e87ba0be
I20260810 13:53:27.771873 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c08ec290e447678084964c23a930ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.772244 13659 ts_tablet_manager.cc:1950] T 394e07c2950c49a88e189e61e87ba0be P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:27.772805 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58df75cb91544ef863a09f4d6004da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.775596 13701 mvcc.cc:204] Tried to move back new op lower bound from 7316971549140951040 to 7316971547839070208. Current Snapshot: MvccSnapshot[applied={T|T < 7316971549140951040}]
I20260810 13:53:27.792312 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 46c08ec290e447678084964c23a930ad (DEFAULT_TABLE table=default.Table_04c2694cab1b4e1ea553387407cd2ac3 [id=b560a46577fe4470bc512466f972a18c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.792758 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 394e07c2950c49a88e189e61e87ba0be (table default.Table_5f1e5ca2b3e44e11830eac76731bb6ac [id=5d7232c0c2264e4ba251264718d41676]) successfully deleted
I20260810 13:53:27.755769 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 803a6a0a86a343b4a23f37d8317d5d0d (DEFAULT_TABLE table=default.Table_45bae94be351453bbeaf8295bf88f5ec [id=383c0c58e7b047589f6b496ba8f4ecb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.795951 13640 tablet_bootstrap.cc:492] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:27.796397 13640 ts_tablet_manager.cc:1403] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.403s user 0.015s sys 0.008s
I20260810 13:53:27.796590 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 803a6a0a86a343b4a23f37d8317d5d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.793958 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c08ec290e447678084964c23a930ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.798388 13638 ts_tablet_manager.cc:1403] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.194s user 0.011s sys 0.011s
I20260810 13:53:27.792061 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 803a6a0a86a343b4a23f37d8317d5d0d (DEFAULT_TABLE table=default.Table_45bae94be351453bbeaf8295bf88f5ec [id=383c0c58e7b047589f6b496ba8f4ecb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.801259 13638 raft_consensus.cc:359] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:27.801867 13638 raft_consensus.cc:385] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:27.802096 13638 raft_consensus.cc:740] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:27.805557 13639 tablet_bootstrap.cc:492] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:27.805627 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 803a6a0a86a343b4a23f37d8317d5d0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:27.806793 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 394e07c2950c49a88e189e61e87ba0be because the tablet was not found. No further retry: Not found: Tablet not found: 394e07c2950c49a88e189e61e87ba0be
I20260810 13:53:27.804663 13640 raft_consensus.cc:359] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:27.809537 13640 raft_consensus.cc:385] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:27.809854 13640 raft_consensus.cc:740] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:27.811044 13727 tablet.cc:1719] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Skipping requested alter to schema version 2, tablet already version 2
W20260810 13:53:27.822225 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 803a6a0a86a343b4a23f37d8317d5d0d consensus state has no leader
I20260810 13:53:27.823983 13729 tablet.cc:1719] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Skipping requested alter to schema version 2, tablet already version 2
I20260810 13:53:27.830997 13640 consensus_queue.cc:260] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:27.840950 13640 ts_tablet_manager.cc:1434] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.044s user 0.003s sys 0.007s
I20260810 13:53:27.841498 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]). Expected version 2 got 0
I20260810 13:53:27.842787 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_315a5491e0d94b63bc40f67a7c9b637c [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 3 got 2
I20260810 13:53:27.852947 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 803a6a0a86a343b4a23f37d8317d5d0d (DEFAULT_TABLE table=default.Table_09b06bf2510640cbb56513f266611e9d [id=383c0c58e7b047589f6b496ba8f4ecb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.855037 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 803a6a0a86a343b4a23f37d8317d5d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.862105 13727 tablet.cc:1724] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:27.863068 13729 tablet.cc:1724] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:27.865408 13640 tablet_bootstrap.cc:492] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:27.880553 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_315a5491e0d94b63bc40f67a7c9b637c [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 3 got 2
I20260810 13:53:27.888650 13021 tablet_service.cc:1511] Processing CreateTablet for tablet dbc8028d03464b138c1f1e6f682f8b88 (DEFAULT_TABLE table=default.Table_5920060ddbce482392401dc8c24f703f [id=307895865f6346a192129d3b938f3f4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.889865 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc8028d03464b138c1f1e6f682f8b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.895193 13436 tablet_service.cc:1511] Processing CreateTablet for tablet dbc8028d03464b138c1f1e6f682f8b88 (DEFAULT_TABLE table=default.Table_5920060ddbce482392401dc8c24f703f [id=307895865f6346a192129d3b938f3f4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.896509 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc8028d03464b138c1f1e6f682f8b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.898309 13638 consensus_queue.cc:260] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:27.906172 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]). Expected version 2 got 0
I20260810 13:53:27.921494 13638 ts_tablet_manager.cc:1434] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.123s user 0.006s sys 0.001s
I20260810 13:53:27.928465 13732 tablet.cc:1719] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Skipping requested alter to schema version 2, tablet already version 2
I20260810 13:53:27.876479 13658 log.cc:1199] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/e103757fbb0443f4bd686dfa27d395c8
I20260810 13:53:27.934290 13658 ts_tablet_manager.cc:1950] T e103757fbb0443f4bd686dfa27d395c8 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:27.901908 13236 tablet_service.cc:1511] Processing CreateTablet for tablet dbc8028d03464b138c1f1e6f682f8b88 (DEFAULT_TABLE table=default.Table_5920060ddbce482392401dc8c24f703f [id=307895865f6346a192129d3b938f3f4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:27.940124 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc8028d03464b138c1f1e6f682f8b88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:27.919019 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet dbc8028d03464b138c1f1e6f682f8b88
I20260810 13:53:27.921010 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 465063c8535141babc56e282aeb1123b
I20260810 13:53:27.947566 13732 tablet.cc:1724] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:27.949054 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet dbc8028d03464b138c1f1e6f682f8b88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:27.950278 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 465063c8535141babc56e282aeb1123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:27.951303 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a572dd11a8794addbea28628bb878131"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:27.952338 13659 tablet_replica.cc:333] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
W20260810 13:53:27.953644 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a572dd11a8794addbea28628bb878131 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.953946 13659 raft_consensus.cc:2243] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:27.955077 13659 raft_consensus.cc:2272] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:27.957527 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet dbc8028d03464b138c1f1e6f682f8b88 because the tablet was not found. No further retry: Not found: Tablet not found: dbc8028d03464b138c1f1e6f682f8b88
I20260810 13:53:27.961308 13638 tablet_bootstrap.cc:492] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:27.964962 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_0682d4d59c234e6f8c2e1f986ec9796e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:27.966750 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0682d4d59c234e6f8c2e1f986ec9796e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:27.976867 13659 ts_tablet_manager.cc:1916] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:27.989784 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 (table default.Table_74e65082c82a41da9e49bc004e93a539 [id=3223eee4aaa74b849772949d52da374b]). Expected version 1 got 0
I20260810 13:53:28.021934 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_74e65082c82a41da9e49bc004e93a539" } new_table_name: "default.Table_f1eafd41cfde48f9a72a916f057f85de" modify_external_catalogs: true
I20260810 13:53:28.027186 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_33fa161792134dfcbfe20c4dafd2feb3" } new_table_name: "default.Table_948d3130a68a44d2aed5a39238172b01" modify_external_catalogs: true
W20260810 13:53:28.038964 12728 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 -> Peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Couldn't send request to peer 2928f7d4503145b182d99007d240334d. Status: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260810 13:53:28.045573 13638 tablet_bootstrap.cc:654] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:28.054991 13435 tablet_service.cc:1558] Processing DeleteTablet for tablet 465063c8535141babc56e282aeb1123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:28.059644 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e7825c3e642745fb9b951ec09cb8820a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:28.090521 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7825c3e642745fb9b951ec09cb8820a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:28.090760 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 465063c8535141babc56e282aeb1123b consensus state has no leader
I20260810 13:53:28.094542 12747 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_315a5491e0d94b63bc40f67a7c9b637c [id=16ae437e3ead46bf9b523ac06f73efe2] alter complete (version 3)
I20260810 13:53:28.101706 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet dbc8028d03464b138c1f1e6f682f8b88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:28.109719 13640 tablet_bootstrap.cc:654] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:28.084934 13660 raft_consensus.cc:493] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:28.119439 13675 raft_consensus.cc:493] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:28.113336 13660 raft_consensus.cc:515] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:28.119944 13675 raft_consensus.cc:515] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:28.121688 13660 leader_election.cc:290] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:28.125475 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:28.126281 13269 raft_consensus.cc:2468] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:28.127453 13675 leader_election.cc:290] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:28.129117 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:28.129973 13475 raft_consensus.cc:2468] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:28.130376 13640 tablet_bootstrap.cc:492] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:28.130817 13640 ts_tablet_manager.cc:1403] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.266s user 0.011s sys 0.005s
I20260810 13:53:28.129618 13659 ts_tablet_manager.cc:1929] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:28.134773 13659 log.cc:1199] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/465063c8535141babc56e282aeb1123b
I20260810 13:53:28.136530 13659 ts_tablet_manager.cc:1950] T 465063c8535141babc56e282aeb1123b P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:28.132320 13382 leader_election.cc:304] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:28.137667 13164 leader_election.cc:304] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:28.139158 13660 raft_consensus.cc:2804] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:28.139605 13660 raft_consensus.cc:493] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:28.140136 13660 raft_consensus.cc:3060] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:28.140486 13640 raft_consensus.cc:359] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.141189 13640 raft_consensus.cc:385] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:28.141531 13640 raft_consensus.cc:740] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:28.141607 13675 raft_consensus.cc:2804] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:28.143041 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb]) successfully deleted
I20260810 13:53:28.142059 13675 raft_consensus.cc:493] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:28.144052 13675 raft_consensus.cc:3060] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:28.152434 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cea93840561c4cb3b90d46e4aa70f542 has no consensus state
W20260810 13:53:28.158352 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 consensus state has no leader
I20260810 13:53:28.155287 13640 consensus_queue.cc:260] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.163300 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6d712ead31884c588f5b2596ab077be7" } modify_external_catalogs: true
I20260810 13:53:28.164103 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6d712ead31884c588f5b2596ab077be7" } modify_external_catalogs: true
I20260810 13:53:28.164548 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a572dd11a8794addbea28628bb878131" } modify_external_catalogs: true
I20260810 13:53:28.165324 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a572dd11a8794addbea28628bb878131" } modify_external_catalogs: true
I20260810 13:53:28.141134 13695 ts_tablet_manager.cc:1929] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:28.198231 13695 log.cc:1199] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/2dd00107ea47488cba5307085ac1d4ea
I20260810 13:53:28.199196 13695 ts_tablet_manager.cc:1950] T 2dd00107ea47488cba5307085ac1d4ea P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:28.213488 13638 tablet_bootstrap.cc:492] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:28.213980 13638 ts_tablet_manager.cc:1403] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.275s user 0.009s sys 0.005s
I20260810 13:53:28.217103 13638 raft_consensus.cc:359] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.217821 13638 raft_consensus.cc:385] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:28.218106 13638 raft_consensus.cc:740] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:28.218941 13638 consensus_queue.cc:260] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.233812 13675 raft_consensus.cc:515] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:28.245288 13675 leader_election.cc:290] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:28.251368 12750 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 869174b88cf2445da1a2d0cc2d4dd20a
I20260810 13:53:28.254629 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_3de1b4c6b1424eb0ab2183f39131ed74"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:28.256632 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3de1b4c6b1424eb0ab2183f39131ed74 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.265763 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:28.267673 13695 tablet_replica.cc:333] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:28.269395 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 2dd00107ea47488cba5307085ac1d4ea (table default.Table_03c3e8cdb25c4e74b95448bb04852e4e [id=668fe64db5944e3386a28cdc01def6c1]) successfully deleted
I20260810 13:53:28.269526 13236 tablet_service.cc:1511] Processing CreateTablet for tablet da664a1596554ee3890f58f0c54521a6 (DEFAULT_TABLE table=default.Table_3358f077962d46eabe9b4a3760e186a1 [id=c9ebbfcd82964aa798abcf82aaf3e881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.268494 13695 raft_consensus.cc:2243] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:28.270310 13695 raft_consensus.cc:2272] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:28.270769 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da664a1596554ee3890f58f0c54521a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.272279 13695 ts_tablet_manager.cc:1916] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:28.273676 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 753ce298de754598b0cde6a4d5f38df1 (table default.Table_6d1ac1ffe2c3491eacaca400fa77e02e [id=499867c6462c4d07bc1e9ade02170394]). Expected version 1 got 0
I20260810 13:53:28.280007 13438 tablet_service.cc:1511] Processing CreateTablet for tablet da664a1596554ee3890f58f0c54521a6 (DEFAULT_TABLE table=default.Table_3358f077962d46eabe9b4a3760e186a1 [id=c9ebbfcd82964aa798abcf82aaf3e881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.281253 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da664a1596554ee3890f58f0c54521a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.283152 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 3066b475871c45fdbe585947fd6800c9 (DEFAULT_TABLE table=default.Table_6d2d5952d6e14e5f9d5b3cd2f0a29477 [id=9c99ad2364cc45fba0746cbae06deeeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.284305 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3066b475871c45fdbe585947fd6800c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.293287 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_62fb6098d2ab4e7e87f381440fd0e1f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:28.295308 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62fb6098d2ab4e7e87f381440fd0e1f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.297432 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_99416f24ad8b403a93f75579664ab8a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:28.299134 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99416f24ad8b403a93f75579664ab8a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.308650 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 6cdab6f2407d4545bf6bbd81917b3434
I20260810 13:53:28.311626 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cdab6f2407d4545bf6bbd81917b3434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:28.313560 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 6cdab6f2407d4545bf6bbd81917b3434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cdab6f2407d4545bf6bbd81917b3434 already in progress: creating tablet
I20260810 13:53:28.317934 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 9081f957f5824ed29603b1d84eff6906 (DEFAULT_TABLE table=default.Table_bcd4624cfe8441918229192ed0a7d742 [id=a18b953f33b14259a0b180987321ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.319056 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9081f957f5824ed29603b1d84eff6906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.325440 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cdab6f2407d4545bf6bbd81917b3434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:28.326254 13436 tablet_service.cc:1511] Processing CreateTablet for tablet 3066b475871c45fdbe585947fd6800c9 (DEFAULT_TABLE table=default.Table_6d2d5952d6e14e5f9d5b3cd2f0a29477 [id=9c99ad2364cc45fba0746cbae06deeeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.327379 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3066b475871c45fdbe585947fd6800c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.349212 13638 ts_tablet_manager.cc:1434] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.135s user 0.008s sys 0.000s
I20260810 13:53:28.350180 13638 tablet_bootstrap.cc:492] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:28.354540 13640 ts_tablet_manager.cc:1434] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.223s user 0.017s sys 0.043s
I20260810 13:53:28.367677 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6d1ac1ffe2c3491eacaca400fa77e02e" } new_table_name: "default.Table_f4652ba122584895bb5457b896c8221f" modify_external_catalogs: true
I20260810 13:53:28.364632 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 753ce298de754598b0cde6a4d5f38df1 (table default.Table_6d1ac1ffe2c3491eacaca400fa77e02e [id=499867c6462c4d07bc1e9ade02170394]). Expected version 1 got 0
I20260810 13:53:28.373034 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_12936f29bc9845f4ba89e5d3fbd68a01" } new_table_name: "default.Table_845b7e0e51384b20b1eac181c1e04ddf" modify_external_catalogs: true
I20260810 13:53:28.336135 13660 raft_consensus.cc:515] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:28.376653 13475 raft_consensus.cc:2393] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:28.380513 13640 tablet_bootstrap.cc:492] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:28.386108 13436 tablet_service.cc:1511] Processing CreateTablet for tablet 9081f957f5824ed29603b1d84eff6906 (DEFAULT_TABLE table=default.Table_bcd4624cfe8441918229192ed0a7d742 [id=a18b953f33b14259a0b180987321ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.387207 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9081f957f5824ed29603b1d84eff6906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.391794 13695 ts_tablet_manager.cc:1929] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:28.392211 13695 log.cc:1199] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/394e07c2950c49a88e189e61e87ba0be
I20260810 13:53:28.393000 13695 ts_tablet_manager.cc:1950] T 394e07c2950c49a88e189e61e87ba0be P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:28.395059 13640 tablet_bootstrap.cc:654] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:28.396903 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 753ce298de754598b0cde6a4d5f38df1 consensus state has no leader
I20260810 13:53:28.403292 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 394e07c2950c49a88e189e61e87ba0be (table default.Table_5f1e5ca2b3e44e11830eac76731bb6ac [id=5d7232c0c2264e4ba251264718d41676]) successfully deleted
I20260810 13:53:28.403903 13695 tablet_replica.cc:333] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:28.404884 13695 raft_consensus.cc:2243] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:28.405462 13695 raft_consensus.cc:2272] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:28.409504 13236 tablet_service.cc:1511] Processing CreateTablet for tablet a67cf93d78254f15a1b89c99048110c8 (DEFAULT_TABLE table=default.Table_ee68a2d145ba40c4a469a9ee06d0ea05 [id=5b919872756647048ea2e4fecbe78537]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:28.409819 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d9ada39233e9421d9870565c73f2ee16 has no consensus state
I20260810 13:53:28.410627 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67cf93d78254f15a1b89c99048110c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.408134 13695 ts_tablet_manager.cc:1916] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:28.423061 13675 raft_consensus.cc:493] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:28.423619 13675 raft_consensus.cc:515] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.425774 13675 leader_election.cc:290] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:28.432082 13438 tablet_service.cc:1511] Processing CreateTablet for tablet a67cf93d78254f15a1b89c99048110c8 (DEFAULT_TABLE table=default.Table_ee68a2d145ba40c4a469a9ee06d0ea05 [id=5b919872756647048ea2e4fecbe78537]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.433262 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67cf93d78254f15a1b89c99048110c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.434960 13640 tablet_bootstrap.cc:492] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:28.435369 13640 ts_tablet_manager.cc:1403] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.004s
I20260810 13:53:28.438597 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4c8d7fb84d92ae6ba72d53d266e0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:28.439355 13640 raft_consensus.cc:359] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:28.440479 13164 leader_election.cc:343] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:28.440711 13640 raft_consensus.cc:385] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:28.440989 13640 raft_consensus.cc:740] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:28.441087 13236 tablet_service.cc:1511] Processing CreateTablet for tablet d2f8801796064c39ba1c81c64d622d68 (DEFAULT_TABLE table=default.Table_e9033f340a474a419492b9db68676dbe [id=beff34142f7b47628583cb5290552648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.441702 13640 consensus_queue.cc:260] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.442648 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f8801796064c39ba1c81c64d622d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.447552 13658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 15) took 1189 ms. Trace:
I20260810 13:53:28.455384 13660 leader_election.cc:290] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:28.457854 13759 raft_consensus.cc:493] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:28.458832 13759 raft_consensus.cc:515] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:28.459877 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 753ce298de754598b0cde6a4d5f38df1 (table default.Table_f4652ba122584895bb5457b896c8221f [id=499867c6462c4d07bc1e9ade02170394]). Expected version 2 got 0
I20260810 13:53:28.461066 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ae5a7110be7d4f6d81477dec588d4b64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:28.462838 13759 leader_election.cc:290] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:28.463352 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae5a7110be7d4f6d81477dec588d4b64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.465476 13759 raft_consensus.cc:493] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:28.466029 13759 raft_consensus.cc:515] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.467797 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f1eafd41cfde48f9a72a916f057f85de" } modify_external_catalogs: true
I20260810 13:53:28.469409 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 266e949bbf6d4a558d73e3cb2efec490 (DEFAULT_TABLE table=default.Table_f688a5d2568d4835bc32eb6cc9533ef9 [id=539325ee3b9c41609568f2e02f54dc02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.469862 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:28.470585 13054 raft_consensus.cc:2468] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:28.470605 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f1eafd41cfde48f9a72a916f057f85de" } modify_external_catalogs: true
I20260810 13:53:28.474771 13639 tablet_bootstrap.cc:654] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:28.476027 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266e949bbf6d4a558d73e3cb2efec490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.480914 13239 tablet_service.cc:1511] Processing CreateTablet for tablet cea93840561c4cb3b90d46e4aa70f542 (DEFAULT_TABLE table=default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.485121 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:28.486022 13269 raft_consensus.cc:2393] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:28.487291 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea93840561c4cb3b90d46e4aa70f542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.492736 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:28.493508 13056 raft_consensus.cc:2468] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:28.505095 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e63e2032b3d546d68f72a9add7b0ccaa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:28.508176 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e63e2032b3d546d68f72a9add7b0ccaa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.514072 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3177f4d8098a4c45b437b8e6021b0820" } modify_external_catalogs: true
I20260810 13:53:28.514911 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3177f4d8098a4c45b437b8e6021b0820" } modify_external_catalogs: true
I20260810 13:53:28.448312 13658 rpcz_store.cc:276] 0810 13:53:27.258265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:27.258430 (+ 165us) service_pool.cc:224] Handling call
0810 13:53:27.548713 (+290283us) ts_tablet_manager.cc:1151] Deleting tablet e103757fbb0443f4bd686dfa27d395c8
0810 13:53:27.550841 (+ 2128us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:27.649429 (+ 98588us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:27.660229 (+ 10800us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:28.446997 (+786768us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":289570}
I20260810 13:53:28.523293 13658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 16) took 1263 ms. Trace:
I20260810 13:53:28.523779 13658 rpcz_store.cc:276] 0810 13:53:27.259702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:27.269172 (+ 9470us) service_pool.cc:224] Handling call
0810 13:53:28.522595 (+1253423us) ts_tablet_manager.cc:1151] Deleting tablet 394e07c2950c49a88e189e61e87ba0be
0810 13:53:28.522782 (+ 187us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:28.523204 (+ 422us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1252628}
I20260810 13:53:28.530889 13014 tablet_service.cc:1558] Processing DeleteTablet for tablet 465063c8535141babc56e282aeb1123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:28.532371 13658 tablet_replica.cc:333] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:28.533244 13012 tablet_service.cc:1558] Processing DeleteTablet for tablet dbc8028d03464b138c1f1e6f682f8b88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:28.546602 13638 tablet_bootstrap.cc:654] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:28.474200 13640 ts_tablet_manager.cc:1434] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.039s user 0.008s sys 0.000s
I20260810 13:53:28.547899 13640 tablet_bootstrap.cc:492] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:28.472034 13695 ts_tablet_manager.cc:1929] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:28.549012 13695 log.cc:1199] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/465063c8535141babc56e282aeb1123b
I20260810 13:53:28.549185 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d283456f26db4b0ba1923f3730dac318"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:28.549882 13695 ts_tablet_manager.cc:1950] T 465063c8535141babc56e282aeb1123b P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:53:28.551267 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d283456f26db4b0ba1923f3730dac318 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.479867 13438 tablet_service.cc:1511] Processing CreateTablet for tablet d2f8801796064c39ba1c81c64d622d68 (DEFAULT_TABLE table=default.Table_e9033f340a474a419492b9db68676dbe [id=beff34142f7b47628583cb5290552648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.481710 13436 tablet_service.cc:1511] Processing CreateTablet for tablet 266e949bbf6d4a558d73e3cb2efec490 (DEFAULT_TABLE table=default.Table_f688a5d2568d4835bc32eb6cc9533ef9 [id=539325ee3b9c41609568f2e02f54dc02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.543689 13445 tablet_service.cc:1511] Processing CreateTablet for tablet cea93840561c4cb3b90d46e4aa70f542 (DEFAULT_TABLE table=default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.553612 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f8801796064c39ba1c81c64d622d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.555016 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 753ce298de754598b0cde6a4d5f38df1 (table default.Table_f4652ba122584895bb5457b896c8221f [id=499867c6462c4d07bc1e9ade02170394]). Expected version 2 got 0
I20260810 13:53:28.557458 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266e949bbf6d4a558d73e3cb2efec490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.558494 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb]) successfully deleted
I20260810 13:53:28.561637 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea93840561c4cb3b90d46e4aa70f542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.567090 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_3de6c479279d4d81a94bb53c5bad9d03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:28.569249 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3de6c479279d4d81a94bb53c5bad9d03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.534094 13658 raft_consensus.cc:2243] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
W20260810 13:53:28.581108 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet dbc8028d03464b138c1f1e6f682f8b88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbc8028d03464b138c1f1e6f682f8b88 already in progress: creating tablet
W20260810 13:53:28.583537 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 6cdab6f2407d4545bf6bbd81917b3434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cdab6f2407d4545bf6bbd81917b3434 already in progress: creating tablet
I20260810 13:53:28.587044 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet dd8e4c8d7fb84d92ae6ba72d53d266e0
I20260810 13:53:28.468425 13759 leader_election.cc:290] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:28.591403 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 36ec9b2dcf4f4096b27f7122fedaa33e
I20260810 13:53:28.572190 13675 raft_consensus.cc:493] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:28.592931 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:28.593041 13675 raft_consensus.cc:515] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.594000 13659 tablet_replica.cc:333] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:28.594853 13659 raft_consensus.cc:2243] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:28.595360 13659 raft_consensus.cc:2272] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:28.595583 13675 leader_election.cc:290] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:28.598119 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:28.600524 13659 ts_tablet_manager.cc:1916] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:28.615747 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_09b06bf2510640cbb56513f266611e9d" } new_table_name: "default.Table_b336b48fc06c48e682801beb6a13546b" modify_external_catalogs: true
I20260810 13:53:28.623616 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:28.624585 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:28.627758 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ce298de754598b0cde6a4d5f38df1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:28.628340 13475 raft_consensus.cc:2468] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:28.624603 13640 tablet_bootstrap.cc:654] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:28.633137 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 already in progress: creating tablet
I20260810 13:53:28.633921 13164 leader_election.cc:304] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
W20260810 13:53:28.634356 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 36ec9b2dcf4f4096b27f7122fedaa33e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ec9b2dcf4f4096b27f7122fedaa33e already in progress: creating tablet
I20260810 13:53:28.635094 13675 raft_consensus.cc:2804] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:28.635546 13675 raft_consensus.cc:493] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:28.635969 13675 raft_consensus.cc:3060] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:28.646800 13675 raft_consensus.cc:515] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.651821 13638 tablet_bootstrap.cc:492] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:28.657083 13638 ts_tablet_manager.cc:1403] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.307s user 0.005s sys 0.008s
I20260810 13:53:28.662463 13640 tablet_bootstrap.cc:492] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:28.662916 13640 ts_tablet_manager.cc:1403] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.115s user 0.011s sys 0.005s
I20260810 13:53:28.664213 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ce298de754598b0cde6a4d5f38df1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:28.664788 13475 raft_consensus.cc:3060] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:28.665958 13640 raft_consensus.cc:359] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.666622 13640 raft_consensus.cc:385] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:28.666883 13640 raft_consensus.cc:740] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:28.667488 13640 consensus_queue.cc:260] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.669617 13640 ts_tablet_manager.cc:1434] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260810 13:53:28.669590 13014 tablet_service.cc:1511] Processing CreateTablet for tablet da664a1596554ee3890f58f0c54521a6 (DEFAULT_TABLE table=default.Table_3358f077962d46eabe9b4a3760e186a1 [id=c9ebbfcd82964aa798abcf82aaf3e881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.671909 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da664a1596554ee3890f58f0c54521a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.672611 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3358f077962d46eabe9b4a3760e186a1" } new_table_name: "default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d" modify_external_catalogs: true
I20260810 13:53:28.679263 13475 raft_consensus.cc:2468] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:28.686229 13659 ts_tablet_manager.cc:1929] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:28.686815 13659 log.cc:1199] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/dd8e4c8d7fb84d92ae6ba72d53d266e0
I20260810 13:53:28.687654 13659 ts_tablet_manager.cc:1950] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
W20260810 13:53:28.689713 13721 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.758s user 0.011s sys 0.014s
I20260810 13:53:28.689790 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 (table default.Table_f1eafd41cfde48f9a72a916f057f85de [id=3223eee4aaa74b849772949d52da374b]) successfully deleted
W20260810 13:53:28.690092 13721 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.759s user 0.012s sys 0.014s
W20260810 13:53:28.695777 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 36ec9b2dcf4f4096b27f7122fedaa33e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ec9b2dcf4f4096b27f7122fedaa33e already in progress: creating tablet
I20260810 13:53:28.699725 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:28.577852 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 465063c8535141babc56e282aeb1123b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:28.700644 13269 raft_consensus.cc:2393] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:28.701607 13010 tablet_service.cc:1511] Processing CreateTablet for tablet 3066b475871c45fdbe585947fd6800c9 (DEFAULT_TABLE table=default.Table_6d2d5952d6e14e5f9d5b3cd2f0a29477 [id=9c99ad2364cc45fba0746cbae06deeeb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:28.702857 12952 leader_election.cc:343] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: dd8e4c8d7fb84d92ae6ba72d53d266e0
I20260810 13:53:28.706434 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 9081f957f5824ed29603b1d84eff6906 (DEFAULT_TABLE table=default.Table_bcd4624cfe8441918229192ed0a7d742 [id=a18b953f33b14259a0b180987321ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.720830 13007 tablet_service.cc:1511] Processing CreateTablet for tablet cea93840561c4cb3b90d46e4aa70f542 (DEFAULT_TABLE table=default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.716799 13009 tablet_service.cc:1511] Processing CreateTablet for tablet a67cf93d78254f15a1b89c99048110c8 (DEFAULT_TABLE table=default.Table_ee68a2d145ba40c4a469a9ee06d0ea05 [id=5b919872756647048ea2e4fecbe78537]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:28.699366 13018 consensus_meta.cc:287] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.825s user 0.010s sys 0.002s
W20260810 13:53:28.727768 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 803a6a0a86a343b4a23f37d8317d5d0d consensus state has no leader
I20260810 13:53:28.730556 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cdab6f2407d4545bf6bbd81917b3434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:28.723316 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3066b475871c45fdbe585947fd6800c9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:28.745891 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet da664a1596554ee3890f58f0c54521a6 consensus state has no leader
I20260810 13:53:28.681357 13640 tablet_bootstrap.cc:492] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:28.693284 13660 raft_consensus.cc:493] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:28.777076 13660 raft_consensus.cc:515] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.777428 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 185031fc211149fe87003c0cf267030d (DEFAULT_TABLE table=default.Table_62fb6098d2ab4e7e87f381440fd0e1f6 [id=52650fc2dbe548c2be71514fb532b2f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.778649 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 185031fc211149fe87003c0cf267030d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.779578 13660 leader_election.cc:290] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:28.798826 13382 leader_election.cc:343] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: dd8e4c8d7fb84d92ae6ba72d53d266e0
I20260810 13:53:28.802435 13675 leader_election.cc:290] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:28.798000 13640 tablet_bootstrap.cc:654] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:28.714896 13658 pending_rounds.cc:70] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:53:28.819247 13164 leader_election.cc:304] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:28.821146 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 22d96232e31f46e791d739643ffb9257 (DEFAULT_TABLE table=default.Table_99416f24ad8b403a93f75579664ab8a3 [id=ad025a7f2cba416c84c364ecb2d3e607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.822762 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d96232e31f46e791d739643ffb9257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.823146 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:28.824055 13695 tablet_replica.cc:333] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:28.825031 13695 raft_consensus.cc:2243] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:28.825500 13695 raft_consensus.cc:2272] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:28.828464 13695 ts_tablet_manager.cc:1916] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:28.828867 13675 raft_consensus.cc:2804] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:28.822758 13011 tablet_service.cc:1511] Processing CreateTablet for tablet d2f8801796064c39ba1c81c64d622d68 (DEFAULT_TABLE table=default.Table_e9033f340a474a419492b9db68676dbe [id=beff34142f7b47628583cb5290552648]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.835357 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:28.840320 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 185031fc211149fe87003c0cf267030d (DEFAULT_TABLE table=default.Table_62fb6098d2ab4e7e87f381440fd0e1f6 [id=52650fc2dbe548c2be71514fb532b2f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.841651 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 185031fc211149fe87003c0cf267030d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.731101 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 266e949bbf6d4a558d73e3cb2efec490 (DEFAULT_TABLE table=default.Table_f688a5d2568d4835bc32eb6cc9533ef9 [id=539325ee3b9c41609568f2e02f54dc02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.847359 13638 raft_consensus.cc:359] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.848147 13638 raft_consensus.cc:385] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:28.854195 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9c735e2c23c24d01949057c6f5ab7055"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:28.856604 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c735e2c23c24d01949057c6f5ab7055 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.865497 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f688a5d2568d4835bc32eb6cc9533ef9" } modify_external_catalogs: true
I20260810 13:53:28.866161 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f688a5d2568d4835bc32eb6cc9533ef9" } modify_external_catalogs: true
I20260810 13:53:28.886445 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 266e949bbf6d4a558d73e3cb2efec490
I20260810 13:53:28.900168 13639 tablet_bootstrap.cc:492] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:28.902099 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0682d4d59c234e6f8c2e1f986ec9796e" } modify_external_catalogs: true
I20260810 13:53:28.902729 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0682d4d59c234e6f8c2e1f986ec9796e" } modify_external_catalogs: true
I20260810 13:53:28.919552 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d65613c7aabf400ca0d3681e35864efb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:28.922884 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d65613c7aabf400ca0d3681e35864efb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.937868 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_58f3e4b775334976838be231fc137217"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:28.944154 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_58f3e4b775334976838be231fc137217 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:28.913318 13638 raft_consensus.cc:740] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:28.951985 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 22d96232e31f46e791d739643ffb9257 (DEFAULT_TABLE table=default.Table_99416f24ad8b403a93f75579664ab8a3 [id=ad025a7f2cba416c84c364ecb2d3e607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.953329 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d96232e31f46e791d739643ffb9257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.953573 13640 tablet_bootstrap.cc:492] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:28.953994 13640 ts_tablet_manager.cc:1403] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.273s user 0.008s sys 0.004s
I20260810 13:53:28.956473 13640 raft_consensus.cc:359] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.957273 13640 raft_consensus.cc:385] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:28.957624 13640 raft_consensus.cc:740] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:28.958597 13436 tablet_service.cc:1511] Processing CreateTablet for tablet 956e50a9d2ff4af39a349bd93c48f7d9 (DEFAULT_TABLE table=default.Table_3de1b4c6b1424eb0ab2183f39131ed74 [id=f800d0ffba7e47e6affc4f8527dfe445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.960242 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956e50a9d2ff4af39a349bd93c48f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.966115 13640 consensus_queue.cc:260] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.968895 13638 consensus_queue.cc:260] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:28.972354 13640 ts_tablet_manager.cc:1434] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260810 13:53:28.972378 13233 tablet_service.cc:1511] Processing CreateTablet for tablet d2cf90601bf4424aa6dc009415af8db6 (DEFAULT_TABLE table=default.Table_e7825c3e642745fb9b951ec09cb8820a [id=be32b50a9d45438b86b5ab8bca95243c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.973278 13640 tablet_bootstrap.cc:492] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:28.982791 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 956e50a9d2ff4af39a349bd93c48f7d9 (DEFAULT_TABLE table=default.Table_3de1b4c6b1424eb0ab2183f39131ed74 [id=f800d0ffba7e47e6affc4f8527dfe445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.983461 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 185031fc211149fe87003c0cf267030d (DEFAULT_TABLE table=default.Table_62fb6098d2ab4e7e87f381440fd0e1f6 [id=52650fc2dbe548c2be71514fb532b2f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.985030 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:28.986639 13639 ts_tablet_manager.cc:1403] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 1.181s user 0.051s sys 0.065s
I20260810 13:53:28.986514 13675 raft_consensus.cc:697] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:28.864995 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea93840561c4cb3b90d46e4aa70f542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.994380 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956e50a9d2ff4af39a349bd93c48f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.997844 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cf90601bf4424aa6dc009415af8db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.994292 13675 consensus_queue.cc:237] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.004179 13000 tablet_service.cc:1511] Processing CreateTablet for tablet 0800a52ff0f34efd9541454eb4ecbf4c (DEFAULT_TABLE table=default.Table_0682d4d59c234e6f8c2e1f986ec9796e [id=6ebba3be39a64bc6a44e31673adb90df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:28.819774 13658 pending_rounds.cc:77] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971548673478656 op_type: NO_OP noop_request { }
I20260810 13:53:29.008144 13004 tablet_service.cc:1511] Processing CreateTablet for tablet 956e50a9d2ff4af39a349bd93c48f7d9 (DEFAULT_TABLE table=default.Table_3de1b4c6b1424eb0ab2183f39131ed74 [id=f800d0ffba7e47e6affc4f8527dfe445]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.012259 13018 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 21) took 1279 ms. Trace:
I20260810 13:53:29.013742 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet 266e949bbf6d4a558d73e3cb2efec490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:29.012602 13018 rpcz_store.cc:276] 0810 13:53:27.732897 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:27.733083 (+ 186us) service_pool.cc:224] Handling call
0810 13:53:27.770832 (+ 37749us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:27.771019 (+ 187us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:27.873796 (+102777us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:28.834245 (+960449us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:29.011869 (+177624us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:53:29.012170 (+ 301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26629504}
I20260810 13:53:29.014981 13658 raft_consensus.cc:2889] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:29.015565 13658 raft_consensus.cc:2272] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:29.017944 13238 tablet_service.cc:1511] Processing CreateTablet for tablet d9ada39233e9421d9870565c73f2ee16 (DEFAULT_TABLE table=default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.018961 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ada39233e9421d9870565c73f2ee16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.019219 13658 ts_tablet_manager.cc:1916] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:29.020105 13239 tablet_service.cc:1511] Processing CreateTablet for tablet e839b2604ad640419fc845b54706cd4d (DEFAULT_TABLE table=default.Table_ae5a7110be7d4f6d81477dec588d4b64 [id=c93d3c57643543cda0f021e1171b3365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.021014 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e839b2604ad640419fc845b54706cd4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:28.991804 13006 tablet_service.cc:1511] Processing CreateTablet for tablet 22d96232e31f46e791d739643ffb9257 (DEFAULT_TABLE table=default.Table_99416f24ad8b403a93f75579664ab8a3 [id=ad025a7f2cba416c84c364ecb2d3e607]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.022920 13003 tablet_service.cc:1511] Processing CreateTablet for tablet d2cf90601bf4424aa6dc009415af8db6 (DEFAULT_TABLE table=default.Table_e7825c3e642745fb9b951ec09cb8820a [id=be32b50a9d45438b86b5ab8bca95243c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.018939 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 0800a52ff0f34efd9541454eb4ecbf4c (DEFAULT_TABLE table=default.Table_0682d4d59c234e6f8c2e1f986ec9796e [id=6ebba3be39a64bc6a44e31673adb90df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.033776 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0800a52ff0f34efd9541454eb4ecbf4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.040527 13448 tablet_service.cc:1511] Processing CreateTablet for tablet d2cf90601bf4424aa6dc009415af8db6 (DEFAULT_TABLE table=default.Table_e7825c3e642745fb9b951ec09cb8820a [id=be32b50a9d45438b86b5ab8bca95243c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.041963 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cf90601bf4424aa6dc009415af8db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.043758 13639 raft_consensus.cc:359] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.027493 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f8801796064c39ba1c81c64d622d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.046531 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet 266e949bbf6d4a558d73e3cb2efec490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:29.048743 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_315a5491e0d94b63bc40f67a7c9b637c" } new_table_name: "default.Table_a0338fc5155e424581582eb72501a460" modify_external_catalogs: true
I20260810 13:53:29.049788 13435 tablet_service.cc:1511] Processing CreateTablet for tablet d9ada39233e9421d9870565c73f2ee16 (DEFAULT_TABLE table=default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.051011 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ada39233e9421d9870565c73f2ee16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.053068 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67cf93d78254f15a1b89c99048110c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.054281 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 0800a52ff0f34efd9541454eb4ecbf4c
I20260810 13:53:29.056988 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9081f957f5824ed29603b1d84eff6906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.056684 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1befb4abf1054ff0900cb2c6dfe3b126"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:29.058221 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1befb4abf1054ff0900cb2c6dfe3b126 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:29.069631 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 0800a52ff0f34efd9541454eb4ecbf4c (DEFAULT_TABLE table=default.Table_0682d4d59c234e6f8c2e1f986ec9796e [id=6ebba3be39a64bc6a44e31673adb90df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.071043 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0800a52ff0f34efd9541454eb4ecbf4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.071966 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266e949bbf6d4a558d73e3cb2efec490. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:29.079413 13020 consensus_meta.cc:287] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.580s user 0.009s sys 0.003s
I20260810 13:53:29.044520 13639 raft_consensus.cc:385] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:29.082028 13639 raft_consensus.cc:740] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:29.085547 13660 raft_consensus.cc:493] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:29.086016 13660 raft_consensus.cc:515] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.092999 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 956e50a9d2ff4af39a349bd93c48f7d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.095489 13660 leader_election.cc:290] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:29.096400 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 753ce298de754598b0cde6a4d5f38df1 (table default.Table_f4652ba122584895bb5457b896c8221f [id=499867c6462c4d07bc1e9ade02170394], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 753ce298de754598b0cde6a4d5f38df1 consensus state has no leader
I20260810 13:53:29.099215 13020 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 19) took 1401 ms. Trace:
I20260810 13:53:29.099666 13020 rpcz_store.cc:276] 0810 13:53:27.697675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:27.697919 (+ 244us) service_pool.cc:224] Handling call
0810 13:53:27.770413 (+ 72494us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:27.770561 (+ 148us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:28.498857 (+728296us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:29.079889 (+581032us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:29.099113 (+ 19224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14080}
I20260810 13:53:29.102775 13021 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 23) took 1214 ms. Trace:
I20260810 13:53:29.103288 13021 rpcz_store.cc:276] 0810 13:53:27.887796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:27.887927 (+ 131us) service_pool.cc:224] Handling call
0810 13:53:27.889344 (+ 1417us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:27.889493 (+ 149us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:28.679087 (+789594us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:29.101912 (+422825us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:29.102435 (+ 523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:29.111866 13019 tablet_service.cc:1511] Processing CreateTablet for tablet e839b2604ad640419fc845b54706cd4d (DEFAULT_TABLE table=default.Table_ae5a7110be7d4f6d81477dec588d4b64 [id=c93d3c57643543cda0f021e1171b3365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.116701 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet 0800a52ff0f34efd9541454eb4ecbf4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:29.096256 13639 consensus_queue.cc:260] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.119688 13434 tablet_service.cc:1511] Processing CreateTablet for tablet e839b2604ad640419fc845b54706cd4d (DEFAULT_TABLE table=default.Table_ae5a7110be7d4f6d81477dec588d4b64 [id=c93d3c57643543cda0f021e1171b3365]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.121397 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e839b2604ad640419fc845b54706cd4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.106950 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet 266e949bbf6d4a558d73e3cb2efec490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:29.124878 13432 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb4301bda1c457eb99de7e99263da41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:29.126013 13432 tablet_service.cc:1558] Processing DeleteTablet for tablet 0800a52ff0f34efd9541454eb4ecbf4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:29.119892 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 185031fc211149fe87003c0cf267030d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.144889 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ab738697d8ab40ea911724a98689bcf1" } new_table_name: "default.Table_3afcf9952f64439db184876b30cf6bba" modify_external_catalogs: true
I20260810 13:53:29.145445 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e839b2604ad640419fc845b54706cd4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.148371 13006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d96232e31f46e791d739643ffb9257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.154291 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2cf90601bf4424aa6dc009415af8db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.160928 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0800a52ff0f34efd9541454eb4ecbf4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.166424 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f7173588194000bb6ff0e9f72ced98" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:29.167152 13269 raft_consensus.cc:2468] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:29.171507 13640 tablet_bootstrap.cc:654] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:29.178777 13382 leader_election.cc:304] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
W20260810 13:53:29.182328 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 266e949bbf6d4a558d73e3cb2efec490 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 266e949bbf6d4a558d73e3cb2efec490 already in progress: creating tablet
I20260810 13:53:29.183084 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 0800a52ff0f34efd9541454eb4ecbf4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:29.188656 13660 raft_consensus.cc:2804] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:29.189306 13660 raft_consensus.cc:493] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:29.189939 13660 raft_consensus.cc:3060] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:29.190865 13638 ts_tablet_manager.cc:1434] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.533s user 0.010s sys 0.007s
W20260810 13:53:29.191306 13638 ts_tablet_manager.cc:1467] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Tablet startup took 533ms
W20260810 13:53:29.191772 13638 ts_tablet_manager.cc:1469] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Trace:
0810 13:53:26.797829 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:26.799719 (+ 1890us) service_pool.cc:224] Handling call
0810 13:53:26.801380 (+ 1661us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:26.801465 (+ 85us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:26.993118 (+191653us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:27.134055 (+140937us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:27.134588 (+ 533us) inbound_call.cc:177] Queueing success response
0810 13:53:28.349891 (+1215303us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:53:28.657538 (+307647us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:53:28.658884 (+ 1346us) tablet_replica.cc:261] Starting instrumentation
0810 13:53:28.659421 (+ 537us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":10556,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":165,"tablet-open.queue_time_us":1215431,"thread_start_us":219539,"threads_started":1}
I20260810 13:53:29.204809 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:29.206008 13475 raft_consensus.cc:2393] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
W20260810 13:53:29.213346 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 0800a52ff0f34efd9541454eb4ecbf4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0800a52ff0f34efd9541454eb4ecbf4c already in progress: creating tablet
I20260810 13:53:29.212767 13638 tablet_bootstrap.cc:492] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:29.222940 13640 tablet_bootstrap.cc:492] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:29.223712 13638 tablet_bootstrap.cc:654] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:29.223347 13640 ts_tablet_manager.cc:1403] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.250s user 0.008s sys 0.003s
I20260810 13:53:29.226873 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet e103757fbb0443f4bd686dfa27d395c8 (table default.Table_628b33635c22408a808a1c792b9b38df [id=e9f23d43853244cda1cf4f52cc3876c4]) successfully deleted
W20260810 13:53:29.227712 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 394e07c2950c49a88e189e61e87ba0be because the tablet was not found. No further retry: Not found: Tablet not found: 394e07c2950c49a88e189e61e87ba0be
I20260810 13:53:29.237221 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ce298de754598b0cde6a4d5f38df1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:29.243352 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a58df75cb91544ef863a09f4d6004da0 consensus state has no leader
I20260810 13:53:29.245434 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4c8d7fb84d92ae6ba72d53d266e0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:29.246651 13054 raft_consensus.cc:2468] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:29.249328 13639 ts_tablet_manager.cc:1434] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.258s user 0.010s sys 0.002s
I20260810 13:53:29.232597 13640 raft_consensus.cc:359] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:29.250703 12739 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e63e2032b3d546d68f72a9add7b0ccaa" } modify_external_catalogs: true
I20260810 13:53:29.251081 13640 raft_consensus.cc:385] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:29.251420 13640 raft_consensus.cc:740] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:29.251652 12739 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e63e2032b3d546d68f72a9add7b0ccaa" } modify_external_catalogs: true
I20260810 13:53:29.252238 13640 consensus_queue.cc:260] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:29.254168 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4c8d7fb84d92ae6ba72d53d266e0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:29.262392 13638 tablet_bootstrap.cc:492] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:29.262806 13638 ts_tablet_manager.cc:1403] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.014s
I20260810 13:53:29.263232 13640 ts_tablet_manager.cc:1434] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.038s user 0.010s sys 0.003s
I20260810 13:53:29.266616 13638 raft_consensus.cc:359] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.267347 13638 raft_consensus.cc:385] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:29.267688 13638 raft_consensus.cc:740] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:29.270006 13695 ts_tablet_manager.cc:1929] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:29.270964 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_a0338fc5155e424581582eb72501a460 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 4 got 3
I20260810 13:53:29.271632 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]). Expected version 2 got 0
I20260810 13:53:29.272145 12746 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561]). Expected version 1 got 0
I20260810 13:53:29.272312 13638 consensus_queue.cc:260] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.279865 13640 tablet_bootstrap.cc:492] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:29.280874 13638 ts_tablet_manager.cc:1434] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20260810 13:53:29.281721 13638 tablet_bootstrap.cc:492] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:29.284094 12749 catalog_manager.cc:5719] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:29.286597 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 753ce298de754598b0cde6a4d5f38df1 (table default.Table_f4652ba122584895bb5457b896c8221f [id=499867c6462c4d07bc1e9ade02170394]). Expected version 2 got 0
I20260810 13:53:29.292619 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:29.293376 13056 raft_consensus.cc:3060] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:29.294783 13695 log.cc:1199] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/dd8e4c8d7fb84d92ae6ba72d53d266e0
I20260810 13:53:29.295940 13695 ts_tablet_manager.cc:1950] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:29.313138 13638 tablet_bootstrap.cc:654] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:29.326289 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f4652ba122584895bb5457b896c8221f" } modify_external_catalogs: true
I20260810 13:53:29.328776 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f7173588194000bb6ff0e9f72ced98" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:29.330974 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4c8d7fb84d92ae6ba72d53d266e0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:29.333093 13049 raft_consensus.cc:2468] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:29.329648 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4b1bb30dd1e24d91bcd19adea0bb0b9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:29.335219 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b1bb30dd1e24d91bcd19adea0bb0b9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:29.332224 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_57980e60ac6549c8b24861967f6cc198"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:29.335487 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47b0b44837544e48e6d63b491180480" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:53:29.338735 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57980e60ac6549c8b24861967f6cc198 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:29.340515 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753ce298de754598b0cde6a4d5f38df1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:29.341380 12739 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet b857cf97c0244ef4be73f17e0a30fa3c
I20260810 13:53:29.343552 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:29.346982 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet b857cf97c0244ef4be73f17e0a30fa3c because the tablet was not found. No further retry: Not found: Tablet not found: b857cf97c0244ef4be73f17e0a30fa3c
I20260810 13:53:29.348574 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_72e009ae681c4849997fb6e4d2295654"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:29.350139 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72e009ae681c4849997fb6e4d2295654 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:29.354197 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f4652ba122584895bb5457b896c8221f" } modify_external_catalogs: true
W20260810 13:53:29.367741 13167 leader_election.cc:343] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:29.375046 13167 leader_election.cc:304] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:29.376257 13167 raft_consensus.cc:2686] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:29.383555 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 1108f64f1260448b8a68ea9fe30ea494 (DEFAULT_TABLE table=default.Table_3de6c479279d4d81a94bb53c5bad9d03 [id=444e5f8f6be54ddc8ec01e68ecb0e3c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.317349 13020 tablet_service.cc:1511] Processing CreateTablet for tablet d9ada39233e9421d9870565c73f2ee16 (DEFAULT_TABLE table=default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.384864 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1108f64f1260448b8a68ea9fe30ea494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.385625 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9ada39233e9421d9870565c73f2ee16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.393321 13233 tablet_service.cc:1511] Processing CreateTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c (DEFAULT_TABLE table=default.Table_e63e2032b3d546d68f72a9add7b0ccaa [id=75a3bda0a82c4e94b96551672ea3550a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.394619 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b857cf97c0244ef4be73f17e0a30fa3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.417364 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6d8842e5440b4cf38eaec7b4479d36d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:29.418210 12951 leader_election.cc:304] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:29.421425 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (DEFAULT_TABLE table=default.Table_d283456f26db4b0ba1923f3730dac318 [id=9a3a9159f7634bc999c5c10834eb41d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.422735 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dac7ad18d3c4fb58171ff8ab959d98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.439014 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b336b48fc06c48e682801beb6a13546b" } new_table_name: "default.Table_fa93c2a8f354411eb2bd67aba454740a" modify_external_catalogs: true
W20260810 13:53:29.451697 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d8842e5440b4cf38eaec7b4479d36d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:29.458014 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3de6c479279d4d81a94bb53c5bad9d03" } new_table_name: "default.Table_e0787f0d6b1c497ca0177d251362b562" modify_external_catalogs: true
I20260810 13:53:29.472119 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 753ce298de754598b0cde6a4d5f38df1
I20260810 13:53:29.486307 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 753ce298de754598b0cde6a4d5f38df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:29.487268 13659 tablet_replica.cc:333] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:29.488354 13659 raft_consensus.cc:2243] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:29.489269 13639 tablet_bootstrap.cc:492] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:29.489333 13659 pending_rounds.cc:70] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:29.489687 13659 pending_rounds.cc:77] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971556763275264 op_type: NO_OP noop_request { }
I20260810 13:53:29.490101 13659 raft_consensus.cc:2889] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:29.490458 13659 raft_consensus.cc:2272] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:29.495820 13659 ts_tablet_manager.cc:1916] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:29.502882 13056 raft_consensus.cc:2468] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:29.504040 13758 raft_consensus.cc:2749] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:29.506273 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_a0338fc5155e424581582eb72501a460 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 4 got 3
W20260810 13:53:29.479493 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 61984.6us
W20260810 13:53:29.507929 12951 leader_election.cc:343] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: Tablet not RUNNING: STOPPED
I20260810 13:53:29.508390 12951 leader_election.cc:304] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:29.511574 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:29.512356 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 803a6a0a86a343b4a23f37d8317d5d0d consensus state has no leader
W20260810 13:53:29.513032 13167 leader_election.cc:343] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:29.514125 13167 leader_election.cc:304] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:29.515709 13779 raft_consensus.cc:2804] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:29.516458 13779 raft_consensus.cc:697] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
W20260810 13:53:29.516387 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1108f64f1260448b8a68ea9fe30ea494 consensus state has no leader
I20260810 13:53:29.517292 13779 consensus_queue.cc:237] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } }
I20260810 13:53:29.542484 12747 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_a0338fc5155e424581582eb72501a460 [id=16ae437e3ead46bf9b523ac06f73efe2]). Expected version 4 got 3
I20260810 13:53:29.544937 13758 raft_consensus.cc:2749] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:29.552270 13639 tablet_bootstrap.cc:654] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:29.555750 13638 tablet_bootstrap.cc:492] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:29.556164 13638 ts_tablet_manager.cc:1403] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.275s user 0.019s sys 0.034s
I20260810 13:53:29.558678 13638 raft_consensus.cc:359] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:29.559382 13638 raft_consensus.cc:385] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:29.559652 13638 raft_consensus.cc:740] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:29.560380 13638 consensus_queue.cc:260] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:29.562608 13638 ts_tablet_manager.cc:1434] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260810 13:53:29.563580 13638 tablet_bootstrap.cc:492] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:29.563668 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 1108f64f1260448b8a68ea9fe30ea494 (DEFAULT_TABLE table=default.Table_3de6c479279d4d81a94bb53c5bad9d03 [id=444e5f8f6be54ddc8ec01e68ecb0e3c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.564939 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1108f64f1260448b8a68ea9fe30ea494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.569918 13638 tablet_bootstrap.cc:654] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:29.570873 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3de1b4c6b1424eb0ab2183f39131ed74" } modify_external_catalogs: true
I20260810 13:53:29.571485 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3de1b4c6b1424eb0ab2183f39131ed74" } modify_external_catalogs: true
I20260810 13:53:29.602550 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb4301bda1c457eb99de7e99263da41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:29.604609 13010 tablet_service.cc:1511] Processing CreateTablet for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (DEFAULT_TABLE table=default.Table_d283456f26db4b0ba1923f3730dac318 [id=9a3a9159f7634bc999c5c10834eb41d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.605727 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dac7ad18d3c4fb58171ff8ab959d98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.606127 13638 tablet_bootstrap.cc:492] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:29.606586 13638 ts_tablet_manager.cc:1403] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.043s user 0.010s sys 0.002s
I20260810 13:53:29.609372 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_dac7ad3575c0493f80f31c5bc76e595f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:29.611123 13638 raft_consensus.cc:359] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:29.611366 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dac7ad3575c0493f80f31c5bc76e595f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:29.611593 13014 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 27) took 1079 ms. Trace:
I20260810 13:53:29.611728 13638 raft_consensus.cc:385] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:29.611984 13638 raft_consensus.cc:740] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:29.611918 13014 rpcz_store.cc:276] 0810 13:53:28.532495 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:28.587377 (+ 54882us) service_pool.cc:224] Handling call
0810 13:53:28.671033 (+ 83656us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:28.671159 (+ 126us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:29.351530 (+680371us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:29.611111 (+259581us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:29.611531 (+ 420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:29.613842 13007 tablet_service.cc:1511] Processing CreateTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c (DEFAULT_TABLE table=default.Table_e63e2032b3d546d68f72a9add7b0ccaa [id=75a3bda0a82c4e94b96551672ea3550a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.614748 13638 consensus_queue.cc:260] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:29.615384 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b857cf97c0244ef4be73f17e0a30fa3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.621722 13638 ts_tablet_manager.cc:1434] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260810 13:53:29.627357 13638 tablet_bootstrap.cc:492] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:29.630947 13675 raft_consensus.cc:493] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:29.631573 13675 raft_consensus.cc:515] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:29.634377 13675 leader_election.cc:290] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:29.636161 13012 tablet_service.cc:1558] Processing DeleteTablet for tablet 753ce298de754598b0cde6a4d5f38df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:29.652189 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23454581a9a4b55b0756ef890dee7fb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:29.654371 13167 leader_election.cc:343] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:29.660059 13659 ts_tablet_manager.cc:1929] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:29.681383 13659 log.cc:1199] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/753ce298de754598b0cde6a4d5f38df1
I20260810 13:53:29.682761 13659 ts_tablet_manager.cc:1950] T 753ce298de754598b0cde6a4d5f38df1 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:29.689713 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet fdb4301bda1c457eb99de7e99263da41 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:26 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:29.692845 13236 tablet_service.cc:1511] Processing CreateTablet for tablet cd3d4b038acb48ebaebef7a424f721c5 (DEFAULT_TABLE table=default.Table_57980e60ac6549c8b24861967f6cc198 [id=18ade4a3af044a498725f45a06e04b81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.693845 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd3d4b038acb48ebaebef7a424f721c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.698720 13659 tablet_replica.cc:333] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:29.699606 13659 raft_consensus.cc:2243] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:29.700152 13659 raft_consensus.cc:2272] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:29.703763 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a456e8d8c2b046e7a2877075ce1b3741"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:29.705816 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d09e415cd1d84b0dbdf423af55ae1a20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:29.708106 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d09e415cd1d84b0dbdf423af55ae1a20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:29.710055 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a456e8d8c2b046e7a2877075ce1b3741 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:29.703222 13638 tablet_bootstrap.cc:654] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:29.718315 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 5836c2923aaf4c698e20b9652fcddc20 (DEFAULT_TABLE table=default.Table_58f3e4b775334976838be231fc137217 [id=a454e03bffcf4e06bbe01ad44ea9dc8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.720273 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5836c2923aaf4c698e20b9652fcddc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.722608 13658 ts_tablet_manager.cc:1929] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:29.723026 13658 log.cc:1199] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/465063c8535141babc56e282aeb1123b
I20260810 13:53:29.724203 13658 ts_tablet_manager.cc:1950] T 465063c8535141babc56e282aeb1123b P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:29.716037 13659 ts_tablet_manager.cc:1916] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:29.726408 13658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 24) took 1196 ms. Trace:
I20260810 13:53:29.726751 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_58f3e4b775334976838be231fc137217" } new_table_name: "default.Table_0609246684174333942081eeed9399f6" modify_external_catalogs: true
I20260810 13:53:29.726727 13658 rpcz_store.cc:276] 0810 13:53:28.530335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:28.530566 (+ 231us) service_pool.cc:224] Handling call
0810 13:53:28.532146 (+ 1580us) ts_tablet_manager.cc:1151] Deleting tablet 465063c8535141babc56e282aeb1123b
0810 13:53:28.532198 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:29.530691 (+998493us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:29.722492 (+191801us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:29.726353 (+ 3861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3835,"tablet-delete.queue_time_us":141}
I20260810 13:53:29.729254 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e0787f0d6b1c497ca0177d251362b562" } new_table_name: "default.Table_0b36b9f532694ebca181ab081e3f6e77" modify_external_catalogs: true
I20260810 13:53:29.735496 13638 tablet_bootstrap.cc:492] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:29.735905 13638 ts_tablet_manager.cc:1403] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.109s user 0.009s sys 0.001s
I20260810 13:53:29.739365 12744 catalog_manager.cc:5719] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:29.741384 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 753ce298de754598b0cde6a4d5f38df1 (table default.Table_f4652ba122584895bb5457b896c8221f [id=499867c6462c4d07bc1e9ade02170394]) successfully deleted
I20260810 13:53:29.742754 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 465063c8535141babc56e282aeb1123b (table default.Table_4f138df89fef4ed2a9c5d12c80a75ea1 [id=e5f2a566d27f4740bbc22013fa97ffbb]) successfully deleted
I20260810 13:53:29.745662 13006 tablet_service.cc:1511] Processing CreateTablet for tablet cd3d4b038acb48ebaebef7a424f721c5 (DEFAULT_TABLE table=default.Table_57980e60ac6549c8b24861967f6cc198 [id=18ade4a3af044a498725f45a06e04b81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.746555 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_bb7f1a0edf05477c9bef48a64c4b391a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:29.747356 13006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd3d4b038acb48ebaebef7a424f721c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:29.749624 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb7f1a0edf05477c9bef48a64c4b391a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:29.754511 13638 raft_consensus.cc:359] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:29.755195 13638 raft_consensus.cc:385] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:29.755501 13638 raft_consensus.cc:740] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:29.770112 13387 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 83351.2us
I20260810 13:53:29.773092 13638 consensus_queue.cc:260] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:29.783254 13382 leader_election.cc:343] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:29.783736 13695 tablet_replica.cc:333] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:29.784454 13382 leader_election.cc:304] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:53:29.785655 13382 raft_consensus.cc:2686] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:29.787725 13382 leader_election.cc:304] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:29.793637 13638 ts_tablet_manager.cc:1434] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.057s user 0.006s sys 0.001s
I20260810 13:53:29.769456 13791 raft_consensus.cc:493] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:29.794099 13791 raft_consensus.cc:515] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.794557 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 956e50a9d2ff4af39a349bd93c48f7d9
I20260810 13:53:29.790932 13796 raft_consensus.cc:493] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:29.796020 13796 raft_consensus.cc:515] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:29.792537 13660 consensus_meta.cc:287] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.601s user 0.009s sys 0.000s
I20260810 13:53:29.796422 13791 leader_election.cc:290] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:29.799175 13660 raft_consensus.cc:515] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.801671 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9c735e2c23c24d01949057c6f5ab7055" } modify_external_catalogs: true
I20260810 13:53:29.802536 13658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 25) took 1271 ms. Trace:
I20260810 13:53:29.802701 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9c735e2c23c24d01949057c6f5ab7055" } modify_external_catalogs: true
I20260810 13:53:29.802774 13660 leader_election.cc:290] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:29.802915 13658 rpcz_store.cc:276] 0810 13:53:28.530814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:28.532324 (+ 1510us) service_pool.cc:224] Handling call
0810 13:53:29.776265 (+1243941us) ts_tablet_manager.cc:1151] Deleting tablet dbc8028d03464b138c1f1e6f682f8b88
0810 13:53:29.776714 (+ 449us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:29.802460 (+ 25746us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1241878}
I20260810 13:53:29.804616 13796 leader_election.cc:290] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:29.804734 13658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 26) took 1273 ms. Trace:
I20260810 13:53:29.805207 13658 rpcz_store.cc:276] 0810 13:53:28.531537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:28.533944 (+ 2407us) service_pool.cc:224] Handling call
0810 13:53:29.804305 (+1270361us) ts_tablet_manager.cc:1151] Deleting tablet 465063c8535141babc56e282aeb1123b
0810 13:53:29.804359 (+ 54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:29.804649 (+ 290us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1096473}
I20260810 13:53:29.806842 13638 tablet_bootstrap.cc:492] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:29.809859 13791 raft_consensus.cc:2749] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:53:29.822788 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 5836c2923aaf4c698e20b9652fcddc20 (DEFAULT_TABLE table=default.Table_58f3e4b775334976838be231fc137217 [id=a454e03bffcf4e06bbe01ad44ea9dc8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.823933 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 307a6b609b674afbb684147005b66d87 (DEFAULT_TABLE table=default.Table_d65613c7aabf400ca0d3681e35864efb [id=91c351539b734ae7bc1aaf17075075f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.824368 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5836c2923aaf4c698e20b9652fcddc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.825783 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet 956e50a9d2ff4af39a349bd93c48f7d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:29.825875 13239 tablet_service.cc:1511] Processing CreateTablet for tablet c549fde3bf9c44ccb18087a7bd64e435 (DEFAULT_TABLE table=default.Table_1befb4abf1054ff0900cb2c6dfe3b126 [id=35cc992f73c943c3a468c8ef4e5c0283]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.826846 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c549fde3bf9c44ccb18087a7bd64e435. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:29.827281 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet dbc8028d03464b138c1f1e6f682f8b88 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbc8028d03464b138c1f1e6f682f8b88 already in progress: creating tablet
W20260810 13:53:29.827903 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 465063c8535141babc56e282aeb1123b because the tablet was not found. No further retry: Not found: Tablet not found: 465063c8535141babc56e282aeb1123b
I20260810 13:53:29.829061 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet 956e50a9d2ff4af39a349bd93c48f7d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:29.828928 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]). Expected version 2 got 0
I20260810 13:53:29.829747 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet e23454581a9a4b55b0756ef890dee7fb (table default.Table_97c5eb6773e04cb680d7e463b5b77bc8 [id=590b98307a364781a383eb9a072bb4d7]). Expected version 1 got 0
I20260810 13:53:29.830438 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307a6b609b674afbb684147005b66d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.831504 13639 tablet_bootstrap.cc:492] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:29.831962 13639 ts_tablet_manager.cc:1403] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.343s user 0.011s sys 0.007s
I20260810 13:53:29.834213 13018 tablet_service.cc:1511] Processing CreateTablet for tablet c549fde3bf9c44ccb18087a7bd64e435 (DEFAULT_TABLE table=default.Table_1befb4abf1054ff0900cb2c6dfe3b126 [id=35cc992f73c943c3a468c8ef4e5c0283]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.835664 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c549fde3bf9c44ccb18087a7bd64e435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.839095 13695 raft_consensus.cc:2243] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:29.839799 13695 raft_consensus.cc:2272] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:29.842312 13695 ts_tablet_manager.cc:1916] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:29.842499 13639 raft_consensus.cc:359] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.843117 13639 raft_consensus.cc:385] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:29.843361 13639 raft_consensus.cc:740] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:29.845293 13758 raft_consensus.cc:493] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:29.845801 13758 raft_consensus.cc:515] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.847591 13813 tablet.cc:1724] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 13:53:29.848933 13758 leader_election.cc:290] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:29.855366 13659 ts_tablet_manager.cc:1929] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:29.855823 13659 log.cc:1199] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/fdb4301bda1c457eb99de7e99263da41
I20260810 13:53:29.864895 13010 tablet_service.cc:1511] Processing CreateTablet for tablet 307a6b609b674afbb684147005b66d87 (DEFAULT_TABLE table=default.Table_d65613c7aabf400ca0d3681e35864efb [id=91c351539b734ae7bc1aaf17075075f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.866300 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307a6b609b674afbb684147005b66d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.869704 13658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 29) took 1205 ms. Trace:
I20260810 13:53:29.870251 13658 rpcz_store.cc:276] 0810 13:53:28.703451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:28.719280 (+ 15829us) service_pool.cc:224] Handling call
0810 13:53:29.869106 (+1149826us) ts_tablet_manager.cc:1151] Deleting tablet 6cdab6f2407d4545bf6bbd81917b3434
0810 13:53:29.869200 (+ 94us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:29.869616 (+ 416us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138050}
I20260810 13:53:29.870752 13640 tablet_bootstrap.cc:654] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:29.871788 13658 tablet_replica.cc:333] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:29.872735 13658 raft_consensus.cc:2243] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:29.872879 13659 ts_tablet_manager.cc:1950] T fdb4301bda1c457eb99de7e99263da41 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:29.873282 13658 raft_consensus.cc:2272] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:29.875320 13658 ts_tablet_manager.cc:1916] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:29.886518 12952 leader_election.cc:343] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: fdb4301bda1c457eb99de7e99263da41
I20260810 13:53:29.887176 13639 consensus_queue.cc:260] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.897776 13810 tablet.cc:1724] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 13:53:29.899451 13638 tablet_bootstrap.cc:654] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:29.902297 13639 ts_tablet_manager.cc:1434] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.070s user 0.000s sys 0.008s
I20260810 13:53:29.910287 13675 raft_consensus.cc:493] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:29.910815 13675 raft_consensus.cc:515] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:29.864183 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 76530.4us
I20260810 13:53:29.917963 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:29.918520 13675 leader_election.cc:290] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:29.919799 13445 tablet_service.cc:1511] Processing CreateTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c (DEFAULT_TABLE table=default.Table_e63e2032b3d546d68f72a9add7b0ccaa [id=75a3bda0a82c4e94b96551672ea3550a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.920248 13639 tablet_bootstrap.cc:492] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:29.920986 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b857cf97c0244ef4be73f17e0a30fa3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.920826 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 1108f64f1260448b8a68ea9fe30ea494 (DEFAULT_TABLE table=default.Table_3de6c479279d4d81a94bb53c5bad9d03 [id=444e5f8f6be54ddc8ec01e68ecb0e3c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.921950 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1108f64f1260448b8a68ea9fe30ea494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.922633 13435 tablet_service.cc:1511] Processing CreateTablet for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (DEFAULT_TABLE table=default.Table_d283456f26db4b0ba1923f3730dac318 [id=9a3a9159f7634bc999c5c10834eb41d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.923674 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dac7ad18d3c4fb58171ff8ab959d98a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.923882 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 753ce298de754598b0cde6a4d5f38df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:29.924540 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:29.932273 13436 tablet_service.cc:1511] Processing CreateTablet for tablet 307a6b609b674afbb684147005b66d87 (DEFAULT_TABLE table=default.Table_d65613c7aabf400ca0d3681e35864efb [id=91c351539b734ae7bc1aaf17075075f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.933089 13434 tablet_service.cc:1511] Processing CreateTablet for tablet cd3d4b038acb48ebaebef7a424f721c5 (DEFAULT_TABLE table=default.Table_57980e60ac6549c8b24861967f6cc198 [id=18ade4a3af044a498725f45a06e04b81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.933542 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307a6b609b674afbb684147005b66d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.934170 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd3d4b038acb48ebaebef7a424f721c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.934685 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 956e50a9d2ff4af39a349bd93c48f7d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:29.937326 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 5836c2923aaf4c698e20b9652fcddc20 (DEFAULT_TABLE table=default.Table_58f3e4b775334976838be231fc137217 [id=a454e03bffcf4e06bbe01ad44ea9dc8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.938303 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5836c2923aaf4c698e20b9652fcddc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.941728 13432 tablet_service.cc:1511] Processing CreateTablet for tablet c549fde3bf9c44ccb18087a7bd64e435 (DEFAULT_TABLE table=default.Table_1befb4abf1054ff0900cb2c6dfe3b126 [id=35cc992f73c943c3a468c8ef4e5c0283]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.942983 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c549fde3bf9c44ccb18087a7bd64e435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.946130 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 435f585d225b492cb2b2e83fdb3a2b3d (DEFAULT_TABLE table=default.Table_9c735e2c23c24d01949057c6f5ab7055 [id=ca0d2f3d357749e8b2e23f6cfe8ea8ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.947180 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435f585d225b492cb2b2e83fdb3a2b3d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:29.949753 13167 leader_election.cc:343] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:29.950484 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (DEFAULT_TABLE table=default.Table_4b1bb30dd1e24d91bcd19adea0bb0b9d [id=667ccf7ba20c49b2be82e167aa212ecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.951490 13638 tablet_bootstrap.cc:492] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:29.951680 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.951900 13638 ts_tablet_manager.cc:1403] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.145s user 0.010s sys 0.001s
I20260810 13:53:29.954623 13638 raft_consensus.cc:359] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.955329 13638 raft_consensus.cc:385] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:29.955614 13638 raft_consensus.cc:740] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:29.960960 13638 consensus_queue.cc:260] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:29.968004 13638 ts_tablet_manager.cc:1434] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.016s user 0.003s sys 0.004s
I20260810 13:53:29.968876 13638 tablet_bootstrap.cc:492] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:29.973711 13758 raft_consensus.cc:493] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:29.974169 13758 raft_consensus.cc:515] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:29.974850 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 6cdab6f2407d4545bf6bbd81917b3434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cdab6f2407d4545bf6bbd81917b3434 already in progress: creating tablet
I20260810 13:53:29.976351 13758 leader_election.cc:290] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:29.977499 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (DEFAULT_TABLE table=default.Table_4b1bb30dd1e24d91bcd19adea0bb0b9d [id=667ccf7ba20c49b2be82e167aa212ecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.977587 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 435f585d225b492cb2b2e83fdb3a2b3d (DEFAULT_TABLE table=default.Table_9c735e2c23c24d01949057c6f5ab7055 [id=ca0d2f3d357749e8b2e23f6cfe8ea8ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.978647 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.979033 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435f585d225b492cb2b2e83fdb3a2b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.980120 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0ffad7efc24519957f2fb3be945b7d (DEFAULT_TABLE table=default.Table_72e009ae681c4849997fb6e4d2295654 [id=71df08438fab431cb91d9560374ce19c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.981621 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0ffad7efc24519957f2fb3be945b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.982334 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (DEFAULT_TABLE table=default.Table_4b1bb30dd1e24d91bcd19adea0bb0b9d [id=667ccf7ba20c49b2be82e167aa212ecd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.983348 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:29.984552 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f7173588194000bb6ff0e9f72ced98" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:29.985176 13269 raft_consensus.cc:2468] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:29.986500 12952 leader_election.cc:304] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:29.990613 13639 tablet_bootstrap.cc:654] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:29.991032 13758 raft_consensus.cc:2804] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:29.991374 13758 raft_consensus.cc:493] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:29.879078 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 435f585d225b492cb2b2e83fdb3a2b3d (DEFAULT_TABLE table=default.Table_9c735e2c23c24d01949057c6f5ab7055 [id=ca0d2f3d357749e8b2e23f6cfe8ea8ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:29.991740 13758 raft_consensus.cc:3060] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:29.992513 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435f585d225b492cb2b2e83fdb3a2b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.010546 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:30.011225 13476 raft_consensus.cc:2468] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:30.012821 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 (table default.Table_f1eafd41cfde48f9a72a916f057f85de [id=3223eee4aaa74b849772949d52da374b]) successfully deleted
W20260810 13:53:30.014050 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 266e949bbf6d4a558d73e3cb2efec490 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 266e949bbf6d4a558d73e3cb2efec490 already in progress: creating tablet
I20260810 13:53:30.015409 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23454581a9a4b55b0756ef890dee7fb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:30.019022 13638 tablet_bootstrap.cc:654] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:30.036164 13658 ts_tablet_manager.cc:1929] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:30.038774 13658 log.cc:1199] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/dd8e4c8d7fb84d92ae6ba72d53d266e0
I20260810 13:53:30.039609 13658 ts_tablet_manager.cc:1950] T dd8e4c8d7fb84d92ae6ba72d53d266e0 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:30.041621 13638 tablet_bootstrap.cc:492] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:30.042092 13638 ts_tablet_manager.cc:1403] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.000s
I20260810 13:53:30.045266 13638 raft_consensus.cc:359] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.040522 13639 tablet_bootstrap.cc:492] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:30.041206 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb4301bda1c457eb99de7e99263da41" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:30.046238 13639 ts_tablet_manager.cc:1403] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.126s user 0.009s sys 0.003s
I20260810 13:53:30.046408 13056 raft_consensus.cc:2468] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:30.048749 13639 raft_consensus.cc:359] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.049368 13639 raft_consensus.cc:385] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.049602 13639 raft_consensus.cc:740] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:30.055109 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f7173588194000bb6ff0e9f72ced98" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:30.056977 13639 consensus_queue.cc:260] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.058655 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:30.059309 13054 raft_consensus.cc:2468] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:30.061048 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdb4301bda1c457eb99de7e99263da41" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:30.061358 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f7173588194000bb6ff0e9f72ced98" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:30.061522 13658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 35) took 1247 ms. Trace:
I20260810 13:53:30.062186 13476 raft_consensus.cc:2393] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:30.057163 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f7173588194000bb6ff0e9f72ced98" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:30.063495 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a0338fc5155e424581582eb72501a460" } modify_external_catalogs: true
I20260810 13:53:30.063937 13638 raft_consensus.cc:385] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.064086 13269 raft_consensus.cc:3060] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:30.064204 13638 raft_consensus.cc:740] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:30.064142 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a0338fc5155e424581582eb72501a460" } modify_external_catalogs: true
I20260810 13:53:30.064889 13638 consensus_queue.cc:260] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.067597 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2560857e4f9f4c45988374f05f107f9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:30.059505 13164 leader_election.cc:304] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:30.059751 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:30.069380 13268 raft_consensus.cc:2468] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:30.070454 13675 raft_consensus.cc:2804] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:30.070779 13675 raft_consensus.cc:493] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:30.071102 13675 raft_consensus.cc:3060] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:30.074889 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2560857e4f9f4c45988374f05f107f9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.075989 13638 ts_tablet_manager.cc:1434] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.034s user 0.005s sys 0.000s
I20260810 13:53:30.062228 13658 rpcz_store.cc:276] 0810 13:53:28.823458 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:28.835050 (+ 11592us) service_pool.cc:224] Handling call
0810 13:53:29.871639 (+1036589us) ts_tablet_manager.cc:1151] Deleting tablet dd8e4c8d7fb84d92ae6ba72d53d266e0
0810 13:53:29.871680 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:29.998037 (+126357us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:30.035983 (+ 37946us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:30.061436 (+ 25453us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1035862}
I20260810 13:53:30.078526 13658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 36) took 1096 ms. Trace:
I20260810 13:53:30.078962 13658 rpcz_store.cc:276] 0810 13:53:28.981750 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:28.984825 (+ 3075us) service_pool.cc:224] Handling call
0810 13:53:30.078153 (+1093328us) ts_tablet_manager.cc:1151] Deleting tablet 36ec9b2dcf4f4096b27f7122fedaa33e
0810 13:53:30.078202 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:30.078470 (+ 268us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1092712}
I20260810 13:53:30.079248 13675 raft_consensus.cc:515] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.080847 13779 raft_consensus.cc:493] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:30.081284 13779 raft_consensus.cc:515] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.083444 13779 leader_election.cc:290] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:30.085008 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58df75cb91544ef863a09f4d6004da0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:30.086194 13167 leader_election.cc:343] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:30.088660 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1108f64f1260448b8a68ea9fe30ea494 consensus state has no leader
W20260810 13:53:30.089562 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5836c2923aaf4c698e20b9652fcddc20 consensus state has no leader
I20260810 13:53:30.090068 13269 raft_consensus.cc:2468] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:30.094048 13638 tablet_bootstrap.cc:492] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:30.095098 13758 raft_consensus.cc:515] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:30.097713 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 803a6a0a86a343b4a23f37d8317d5d0d (table default.Table_fa93c2a8f354411eb2bd67aba454740a [id=383c0c58e7b047589f6b496ba8f4ecb0], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 803a6a0a86a343b4a23f37d8317d5d0d consensus state has no leader
I20260810 13:53:30.103031 13056 raft_consensus.cc:2393] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:53:29.967792 13695 ts_tablet_manager.cc:1929] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:30.117790 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet fdb4301bda1c457eb99de7e99263da41 (table default.Table_254925321ada4ac0a5d1d64433f511ec [id=351ef27fc29d4ac48362d1c1ce7aa3ce]) successfully deleted
W20260810 13:53:30.118532 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 956e50a9d2ff4af39a349bd93c48f7d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 956e50a9d2ff4af39a349bd93c48f7d9 already in progress: creating tablet
I20260810 13:53:30.120357 13695 log.cc:1199] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/fdb4301bda1c457eb99de7e99263da41
I20260810 13:53:30.121325 13695 ts_tablet_manager.cc:1950] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:30.122370 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0ffad7efc24519957f2fb3be945b7d (DEFAULT_TABLE table=default.Table_72e009ae681c4849997fb6e4d2295654 [id=71df08438fab431cb91d9560374ce19c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.123657 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0ffad7efc24519957f2fb3be945b7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.124982 13779 raft_consensus.cc:493] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:30.129380 13658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 42) took 1144 ms. Trace:
I20260810 13:53:30.129798 13658 rpcz_store.cc:276] 0810 13:53:29.045505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:29.072829 (+ 27324us) service_pool.cc:224] Handling call
0810 13:53:30.128919 (+1056090us) ts_tablet_manager.cc:1151] Deleting tablet 266e949bbf6d4a558d73e3cb2efec490
0810 13:53:30.128985 (+ 66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:30.129320 (+ 335us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":981121}
I20260810 13:53:30.132277 13658 tablet_replica.cc:333] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:30.137550 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0ffad7efc24519957f2fb3be945b7d (DEFAULT_TABLE table=default.Table_72e009ae681c4849997fb6e4d2295654 [id=71df08438fab431cb91d9560374ce19c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.148926 13779 raft_consensus.cc:515] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.152282 13779 leader_election.cc:290] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:30.157012 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c08ec290e447678084964c23a930ad" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:30.157230 13164 leader_election.cc:343] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:30.157640 13164 leader_election.cc:304] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:30.156524 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:30.158340 13054 raft_consensus.cc:3060] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:30.158887 13779 raft_consensus.cc:2749] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:30.161010 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0ffad7efc24519957f2fb3be945b7d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:30.166289 13167 leader_election.cc:343] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:30.166903 12951 leader_election.cc:343] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: Tablet not RUNNING: STOPPED
I20260810 13:53:30.167531 12951 leader_election.cc:304] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:30.168593 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 435f585d225b492cb2b2e83fdb3a2b3d
I20260810 13:53:30.173132 13640 tablet_bootstrap.cc:492] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:30.173125 13658 raft_consensus.cc:2243] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:30.173612 13658 raft_consensus.cc:2272] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:30.173728 13640 ts_tablet_manager.cc:1403] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.894s user 0.012s sys 0.007s
I20260810 13:53:30.175539 13658 ts_tablet_manager.cc:1916] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:30.179874 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 59846.1us
I20260810 13:53:30.186441 13054 raft_consensus.cc:2468] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:30.192101 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 4b4a3bdfd610415ca52aa6eaef015c1e
I20260810 13:53:30.192540 13640 raft_consensus.cc:359] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.193248 13640 raft_consensus.cc:385] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.193652 13640 raft_consensus.cc:740] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:30.197254 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:30.198266 13659 tablet_replica.cc:333] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:30.198978 13659 raft_consensus.cc:2243] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:30.199438 13659 raft_consensus.cc:2272] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:30.201156 13659 ts_tablet_manager.cc:1916] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:30.205035 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet fdb4301bda1c457eb99de7e99263da41 (table default.Table_254925321ada4ac0a5d1d64433f511ec [id=351ef27fc29d4ac48362d1c1ce7aa3ce]) successfully deleted
I20260810 13:53:30.207325 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58df75cb91544ef863a09f4d6004da0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:30.224431 13695 tablet_replica.cc:333] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:30.225319 13695 raft_consensus.cc:2243] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:30.196964 13639 ts_tablet_manager.cc:1434] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.150s user 0.012s sys 0.016s
I20260810 13:53:30.130992 13675 leader_election.cc:290] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:30.126629 13638 tablet_bootstrap.cc:654] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:30.227792 13758 leader_election.cc:290] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:30.229125 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f7173588194000bb6ff0e9f72ced98" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:30.230324 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 435f585d225b492cb2b2e83fdb3a2b3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:30.231026 13269 raft_consensus.cc:2393] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:30.231169 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet dd8e4c8d7fb84d92ae6ba72d53d266e0 (table default.Table_f1eafd41cfde48f9a72a916f057f85de [id=3223eee4aaa74b849772949d52da374b]) successfully deleted
W20260810 13:53:30.231789 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 36ec9b2dcf4f4096b27f7122fedaa33e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 36ec9b2dcf4f4096b27f7122fedaa33e already in progress: creating tablet
W20260810 13:53:30.232371 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 0800a52ff0f34efd9541454eb4ecbf4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0800a52ff0f34efd9541454eb4ecbf4c already in progress: creating tablet
W20260810 13:53:30.233007 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 266e949bbf6d4a558d73e3cb2efec490 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 266e949bbf6d4a558d73e3cb2efec490 already in progress: creating tablet
I20260810 13:53:30.226737 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c08ec290e447678084964c23a930ad" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:30.233565 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet b857cf97c0244ef4be73f17e0a30fa3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b857cf97c0244ef4be73f17e0a30fa3c already in progress: creating tablet
I20260810 13:53:30.235088 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b4a3bdfd610415ca52aa6eaef015c1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:30.225956 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:30.237944 13639 tablet_bootstrap.cc:492] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:53:30.227627 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 60794.3us
I20260810 13:53:30.241540 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_564d788cbd304cb380cad3c066309639"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:30.242424 13167 leader_election.cc:304] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:53:30.243448 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_564d788cbd304cb380cad3c066309639 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.244313 13010 tablet_service.cc:1558] Processing DeleteTablet for tablet 435f585d225b492cb2b2e83fdb3a2b3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:30.244954 13675 raft_consensus.cc:2804] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:30.244961 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b4a3bdfd610415ca52aa6eaef015c1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:30.245397 13675 raft_consensus.cc:697] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:30.246482 13675 consensus_queue.cc:237] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.248894 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_84a5a2b5e80343c194da3ea9661f2a81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:30.250782 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84a5a2b5e80343c194da3ea9661f2a81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.252453 13659 ts_tablet_manager.cc:1929] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:30.234261 13640 consensus_queue.cc:260] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.265270 13638 tablet_bootstrap.cc:492] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:30.279835 13638 ts_tablet_manager.cc:1403] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.186s user 0.011s sys 0.005s
I20260810 13:53:30.282431 13638 raft_consensus.cc:359] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.283083 13638 raft_consensus.cc:385] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.283345 13638 raft_consensus.cc:740] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:30.284051 13638 consensus_queue.cc:260] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.286319 13638 ts_tablet_manager.cc:1434] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 13:53:30.287173 13638 tablet_bootstrap.cc:492] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:30.288838 13659 log.cc:1199] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/36ec9b2dcf4f4096b27f7122fedaa33e
I20260810 13:53:30.289777 13659 ts_tablet_manager.cc:1950] T 36ec9b2dcf4f4096b27f7122fedaa33e P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:30.290377 13639 tablet_bootstrap.cc:654] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:30.295238 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e7825c3e642745fb9b951ec09cb8820a" } new_table_name: "default.Table_5ff0aa00c62240a982aa971545b08350" modify_external_catalogs: true
I20260810 13:53:30.297050 13659 tablet_replica.cc:333] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:30.297724 13659 raft_consensus.cc:2243] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:30.298605 13659 raft_consensus.cc:2272] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:30.299517 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 36ec9b2dcf4f4096b27f7122fedaa33e (table default.Table_3177f4d8098a4c45b437b8e6021b0820 [id=c6652acc3d524807ab8be29692f07874]) successfully deleted
I20260810 13:53:30.295208 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_fa93c2a8f354411eb2bd67aba454740a" } new_table_name: "default.Table_be9fec10e00d4ea6bbedfbe8346507b1" modify_external_catalogs: true
W20260810 13:53:30.300256 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 435f585d225b492cb2b2e83fdb3a2b3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 435f585d225b492cb2b2e83fdb3a2b3d already in progress: creating tablet
I20260810 13:53:30.332288 13658 ts_tablet_manager.cc:1929] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:30.332712 13658 log.cc:1199] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/fdb4301bda1c457eb99de7e99263da41
I20260810 13:53:30.333809 13658 ts_tablet_manager.cc:1950] T fdb4301bda1c457eb99de7e99263da41 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:30.334556 13659 ts_tablet_manager.cc:1916] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:30.336107 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet fdb4301bda1c457eb99de7e99263da41 (table default.Table_254925321ada4ac0a5d1d64433f511ec [id=351ef27fc29d4ac48362d1c1ce7aa3ce]) successfully deleted
I20260810 13:53:30.340154 13638 tablet_bootstrap.cc:654] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:30.349689 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 753ce298de754598b0cde6a4d5f38df1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 753ce298de754598b0cde6a4d5f38df1 already in progress: creating tablet
W20260810 13:53:30.353155 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 956e50a9d2ff4af39a349bd93c48f7d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 956e50a9d2ff4af39a349bd93c48f7d9 already in progress: creating tablet
W20260810 13:53:30.358664 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2cf90601bf4424aa6dc009415af8db6 consensus state has no leader
W20260810 13:53:30.244076 13382 leader_election.cc:343] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: fdb4301bda1c457eb99de7e99263da41
I20260810 13:53:30.266381 13695 raft_consensus.cc:2272] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:30.362160 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 803a6a0a86a343b4a23f37d8317d5d0d consensus state has no leader
I20260810 13:53:30.364070 13658 tablet_replica.cc:333] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:30.363375 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_636572e9c1c24956bc53550f45390b1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:30.366101 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_636572e9c1c24956bc53550f45390b1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.365790 13639 tablet_bootstrap.cc:492] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:30.366798 13639 ts_tablet_manager.cc:1403] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.129s user 0.012s sys 0.002s
I20260810 13:53:30.369640 13639 raft_consensus.cc:359] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.374564 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_dac7ad3575c0493f80f31c5bc76e595f" } modify_external_catalogs: true
I20260810 13:53:30.375145 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_dac7ad3575c0493f80f31c5bc76e595f" } modify_external_catalogs: true
I20260810 13:53:30.376065 13639 raft_consensus.cc:385] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.376344 13639 raft_consensus.cc:740] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:30.309242 13475 raft_consensus.cc:3060] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:30.370819 13658 raft_consensus.cc:2243] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:30.377318 13658 raft_consensus.cc:2272] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:30.382023 13639 consensus_queue.cc:260] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.387687 13812 raft_consensus.cc:493] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:30.388190 13812 raft_consensus.cc:515] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.390727 13812 leader_election.cc:290] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:30.391053 13638 tablet_bootstrap.cc:492] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:30.391445 13638 ts_tablet_manager.cc:1403] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.104s user 0.009s sys 0.003s
I20260810 13:53:30.392390 13658 ts_tablet_manager.cc:1916] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:30.394182 13638 raft_consensus.cc:359] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.394884 13638 raft_consensus.cc:385] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.395169 13638 raft_consensus.cc:740] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:30.395927 13638 consensus_queue.cc:260] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.397440 13639 ts_tablet_manager.cc:1434] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.030s user 0.000s sys 0.006s
I20260810 13:53:30.398605 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_564d788cbd304cb380cad3c066309639" } modify_external_catalogs: true
I20260810 13:53:30.399457 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_564d788cbd304cb380cad3c066309639" } modify_external_catalogs: true
W20260810 13:53:30.361768 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 117731us
I20260810 13:53:30.411659 13640 ts_tablet_manager.cc:1434] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.238s user 0.006s sys 0.000s
I20260810 13:53:30.420881 13382 leader_election.cc:304] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:30.421986 13382 leader_election.cc:304] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:30.422890 13382 leader_election.cc:304] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:53:30.423725 13382 raft_consensus.cc:2686] T fdb4301bda1c457eb99de7e99263da41 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:30.424132 13639 tablet_bootstrap.cc:492] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:30.425068 13638 ts_tablet_manager.cc:1434] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.033s user 0.007s sys 0.001s
I20260810 13:53:30.428084 13695 ts_tablet_manager.cc:1916] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:30.432997 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2de7aaadcc9042a1a7142a894e0c8493"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:30.433863 13659 ts_tablet_manager.cc:1929] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 13:53:30.434228 13659 log.cc:1199] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/4b4a3bdfd610415ca52aa6eaef015c1e
I20260810 13:53:30.434927 13659 ts_tablet_manager.cc:1950] T 4b4a3bdfd610415ca52aa6eaef015c1e P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
W20260810 13:53:30.435307 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2de7aaadcc9042a1a7142a894e0c8493 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.409771 13831 tablet.cc:1724] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20260810 13:53:30.439181 13639 tablet_bootstrap.cc:654] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:30.441588 13638 tablet_bootstrap.cc:492] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:30.445838 13695 ts_tablet_manager.cc:1929] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:30.446240 13695 log.cc:1199] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/753ce298de754598b0cde6a4d5f38df1
I20260810 13:53:30.446969 13695 ts_tablet_manager.cc:1950] T 753ce298de754598b0cde6a4d5f38df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:30.452142 13475 raft_consensus.cc:2468] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:30.455929 13638 tablet_bootstrap.cc:654] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:30.460892 13812 raft_consensus.cc:2764] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:53:30.461647 13812 raft_consensus.cc:2804] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:30.462184 13812 raft_consensus.cc:697] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:30.463620 13812 consensus_queue.cc:237] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.456589 13658 ts_tablet_manager.cc:1929] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 13:53:30.465067 13658 log.cc:1199] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/4b4a3bdfd610415ca52aa6eaef015c1e
I20260810 13:53:30.465754 13658 ts_tablet_manager.cc:1950] T 4b4a3bdfd610415ca52aa6eaef015c1e P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:30.467608 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 44788.4us
I20260810 13:53:30.468101 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_a0338fc5155e424581582eb72501a460 [id=16ae437e3ead46bf9b523ac06f73efe2]) successfully deleted
I20260810 13:53:30.469228 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_a0338fc5155e424581582eb72501a460 [id=16ae437e3ead46bf9b523ac06f73efe2]) successfully deleted
I20260810 13:53:30.470933 13639 tablet_bootstrap.cc:492] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:30.471510 13639 ts_tablet_manager.cc:1403] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.048s user 0.008s sys 0.003s
I20260810 13:53:30.474555 13639 raft_consensus.cc:359] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.475153 13639 raft_consensus.cc:385] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.475386 13639 raft_consensus.cc:740] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:53:30.480525 13164 leader_election.cc:343] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:30.480721 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 0800a52ff0f34efd9541454eb4ecbf4c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0800a52ff0f34efd9541454eb4ecbf4c already in progress: creating tablet
I20260810 13:53:30.481073 13164 leader_election.cc:304] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:30.481954 13639 consensus_queue.cc:260] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:30.482543 13164 leader_election.cc:343] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:30.482862 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ec9b2dcf4f4096b27f7122fedaa33e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:30.482961 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 753ce298de754598b0cde6a4d5f38df1 (table default.Table_f4652ba122584895bb5457b896c8221f [id=499867c6462c4d07bc1e9ade02170394]) successfully deleted
I20260810 13:53:30.482928 13164 leader_election.cc:304] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:30.483413 13054 raft_consensus.cc:2468] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:30.483899 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4f7173588194000bb6ff0e9f72ced98" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:30.484154 13779 raft_consensus.cc:2749] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:30.484830 13779 raft_consensus.cc:2749] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:30.485357 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 435f585d225b492cb2b2e83fdb3a2b3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 435f585d225b492cb2b2e83fdb3a2b3d already in progress: creating tablet
W20260810 13:53:30.485500 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet b857cf97c0244ef4be73f17e0a30fa3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b857cf97c0244ef4be73f17e0a30fa3c already in progress: creating tablet
W20260810 13:53:30.486284 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 956e50a9d2ff4af39a349bd93c48f7d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 956e50a9d2ff4af39a349bd93c48f7d9 already in progress: creating tablet
I20260810 13:53:30.493538 13639 ts_tablet_manager.cc:1434] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.022s user 0.006s sys 0.002s
I20260810 13:53:30.500594 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet 435f585d225b492cb2b2e83fdb3a2b3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:30.501963 13640 tablet_bootstrap.cc:492] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:30.505402 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4b7d5cd81064430aba9b62fad26b42ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:30.508522 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b7d5cd81064430aba9b62fad26b42ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.510215 13638 tablet_bootstrap.cc:492] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:30.510686 13638 ts_tablet_manager.cc:1403] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.069s user 0.008s sys 0.000s
I20260810 13:53:30.513590 13639 tablet_bootstrap.cc:492] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:30.514299 13638 raft_consensus.cc:359] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.514983 13638 raft_consensus.cc:385] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.515242 13638 raft_consensus.cc:740] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:30.523545 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5151631f180c44e8bb89c91b094f1259"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:30.524118 13638 consensus_queue.cc:260] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:30.526077 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5151631f180c44e8bb89c91b094f1259 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.526153 13054 raft_consensus.cc:1275] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 13:53:30.528405 13675 consensus_queue.cc:1048] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:30.549054 13639 tablet_bootstrap.cc:654] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:30.552810 13638 ts_tablet_manager.cc:1434] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.042s user 0.010s sys 0.000s
I20260810 13:53:30.555025 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561]). Expected version 1 got 0
I20260810 13:53:30.556062 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 46c08ec290e447678084964c23a930ad (table default.Table_04c2694cab1b4e1ea553387407cd2ac3 [id=b560a46577fe4470bc512466f972a18c]). Expected version 1 got 0
I20260810 13:53:30.557011 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]). Expected version 1 got 0
I20260810 13:53:30.559003 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561]). Expected version 1 got 0
I20260810 13:53:30.560554 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 0b427bfff3734fa08370bfbc480cb802 (DEFAULT_TABLE table=default.Table_dac7ad3575c0493f80f31c5bc76e595f [id=be02ad64399140469aa0fdfb872b3c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.562307 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b427bfff3734fa08370bfbc480cb802. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:30.566056 12728 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 -> Peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Couldn't send request to peer 2928f7d4503145b182d99007d240334d. Status: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260810 13:53:30.563190 13638 tablet_bootstrap.cc:492] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:30.566391 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 0b427bfff3734fa08370bfbc480cb802 (DEFAULT_TABLE table=default.Table_dac7ad3575c0493f80f31c5bc76e595f [id=be02ad64399140469aa0fdfb872b3c22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.567971 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b427bfff3734fa08370bfbc480cb802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.573814 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (DEFAULT_TABLE table=default.Table_6d8842e5440b4cf38eaec7b4479d36d6 [id=82f67714ca3b4e6aab8557bd0f53d264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.575975 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e169a9bbc24a5196b1bdaf5bb06207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.576233 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (DEFAULT_TABLE table=default.Table_6d8842e5440b4cf38eaec7b4479d36d6 [id=82f67714ca3b4e6aab8557bd0f53d264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.577381 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e169a9bbc24a5196b1bdaf5bb06207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.577791 13010 tablet_service.cc:1511] Processing CreateTablet for tablet 8ffbabe58e034f26915504f2b1fa4679 (DEFAULT_TABLE table=default.Table_d09e415cd1d84b0dbdf423af55ae1a20 [id=5aded17b3ed14b679b105714f33ff602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.579231 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffbabe58e034f26915504f2b1fa4679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.591670 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_04c2694cab1b4e1ea553387407cd2ac3" } new_table_name: "default.Table_19de196adf7f448b9beee85f7221ea70" modify_external_catalogs: true
I20260810 13:53:30.593075 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_97c5eb6773e04cb680d7e463b5b77bc8" } new_table_name: "default.Table_08582b65868149cca4ac724f7d18a869" modify_external_catalogs: true
I20260810 13:53:30.595665 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 8ffbabe58e034f26915504f2b1fa4679 (DEFAULT_TABLE table=default.Table_d09e415cd1d84b0dbdf423af55ae1a20 [id=5aded17b3ed14b679b105714f33ff602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.596838 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b4a3bdfd610415ca52aa6eaef015c1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:30.597375 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffbabe58e034f26915504f2b1fa4679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.597929 13695 tablet_replica.cc:333] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:30.598948 13695 raft_consensus.cc:2243] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:30.598747 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 (DEFAULT_TABLE table=default.Table_a456e8d8c2b046e7a2877075ce1b3741 [id=2e4a328ff76e41a1bd0718c74494f4d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.599591 13695 raft_consensus.cc:2272] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:30.600296 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2ad1e3a90f47ac83ca262cad9964f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.612483 13695 ts_tablet_manager.cc:1916] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:30.622570 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 0b427bfff3734fa08370bfbc480cb802 (DEFAULT_TABLE table=default.Table_dac7ad3575c0493f80f31c5bc76e595f [id=be02ad64399140469aa0fdfb872b3c22]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:30.623227 13382 leader_election.cc:343] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 36ec9b2dcf4f4096b27f7122fedaa33e
I20260810 13:53:30.623693 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b427bfff3734fa08370bfbc480cb802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.623890 13382 leader_election.cc:304] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:53:30.625165 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (DEFAULT_TABLE table=default.Table_6d8842e5440b4cf38eaec7b4479d36d6 [id=82f67714ca3b4e6aab8557bd0f53d264]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.625358 13435 tablet_service.cc:1511] Processing CreateTablet for tablet 8ffbabe58e034f26915504f2b1fa4679 (DEFAULT_TABLE table=default.Table_d09e415cd1d84b0dbdf423af55ae1a20 [id=5aded17b3ed14b679b105714f33ff602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.626255 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e169a9bbc24a5196b1bdaf5bb06207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.626155 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:30.627099 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ffbabe58e034f26915504f2b1fa4679. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.628741 13839 raft_consensus.cc:2804] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:30.629078 13839 raft_consensus.cc:493] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:30.629369 13839 raft_consensus.cc:3060] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:30.630673 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 435f585d225b492cb2b2e83fdb3a2b3d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 435f585d225b492cb2b2e83fdb3a2b3d already in progress: creating tablet
I20260810 13:53:30.633644 13638 tablet_bootstrap.cc:654] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:30.634657 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b4a3bdfd610415ca52aa6eaef015c1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:30.636266 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 4b4a3bdfd610415ca52aa6eaef015c1e because the tablet was not found. No further retry: Not found: Tablet not found: 4b4a3bdfd610415ca52aa6eaef015c1e
I20260810 13:53:30.648852 12951 leader_election.cc:304] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:30.650451 13758 raft_consensus.cc:2749] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:53:30.668206 12743 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet ae931dd8ee4348ac96e37c1e37319103
W20260810 13:53:30.670038 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 46216.5us
I20260810 13:53:30.678534 13675 consensus_queue.cc:1048] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:30.687603 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 (DEFAULT_TABLE table=default.Table_a456e8d8c2b046e7a2877075ce1b3741 [id=2e4a328ff76e41a1bd0718c74494f4d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.689271 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2ad1e3a90f47ac83ca262cad9964f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.715487 13839 raft_consensus.cc:515] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.726851 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 (DEFAULT_TABLE table=default.Table_a456e8d8c2b046e7a2877075ce1b3741 [id=2e4a328ff76e41a1bd0718c74494f4d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:30.720184 13640 tablet_bootstrap.cc:654] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:30.731695 13639 tablet_bootstrap.cc:492] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:30.732651 13758 raft_consensus.cc:493] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:30.733400 13758 raft_consensus.cc:515] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.738410 13758 leader_election.cc:290] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:30.741020 12952 leader_election.cc:343] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 753ce298de754598b0cde6a4d5f38df1
I20260810 13:53:30.743125 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c2ad1e3a90f47ac83ca262cad9964f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:30.743939 13675 raft_consensus.cc:493] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:30.744650 13675 raft_consensus.cc:515] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.750334 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdab6f2407d4545bf6bbd81917b3434" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:30.750581 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdab6f2407d4545bf6bbd81917b3434" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:30.752475 13167 leader_election.cc:343] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:30.752744 13675 leader_election.cc:290] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
W20260810 13:53:30.753542 13164 leader_election.cc:343] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:30.754014 13164 leader_election.cc:304] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:30.755142 13675 raft_consensus.cc:2749] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:30.758234 12951 leader_election.cc:343] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 753ce298de754598b0cde6a4d5f38df1
I20260810 13:53:30.758924 12951 leader_election.cc:304] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:30.761759 13758 raft_consensus.cc:2749] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:30.762754 13638 tablet_bootstrap.cc:492] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:30.763542 13638 ts_tablet_manager.cc:1403] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.201s user 0.021s sys 0.005s
I20260810 13:53:30.768801 13639 ts_tablet_manager.cc:1403] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.255s user 0.013s sys 0.011s
I20260810 13:53:30.771459 13839 leader_election.cc:290] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:30.773406 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36ec9b2dcf4f4096b27f7122fedaa33e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:30.774014 13056 raft_consensus.cc:3060] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:30.774224 13863 tablet.cc:1724] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:30.783334 13056 raft_consensus.cc:2468] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:30.786392 13382 leader_election.cc:304] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:30.799702 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 0b427bfff3734fa08370bfbc480cb802
I20260810 13:53:30.772478 13639 raft_consensus.cc:359] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.800722 13639 raft_consensus.cc:385] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.801031 13639 raft_consensus.cc:740] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:30.802268 13639 consensus_queue.cc:260] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:30.802623 13382 leader_election.cc:343] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 36ec9b2dcf4f4096b27f7122fedaa33e
I20260810 13:53:30.804283 13864 tablet.cc:1724] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:30.805034 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b427bfff3734fa08370bfbc480cb802 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:30.806814 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 0b427bfff3734fa08370bfbc480cb802 because the tablet was not found. No further retry: Not found: Tablet not found: 0b427bfff3734fa08370bfbc480cb802
I20260810 13:53:30.808912 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b427bfff3734fa08370bfbc480cb802 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:30.809865 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b427bfff3734fa08370bfbc480cb802 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:30.811610 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 0b427bfff3734fa08370bfbc480cb802 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b427bfff3734fa08370bfbc480cb802 already in progress: creating tablet
I20260810 13:53:30.817188 13638 raft_consensus.cc:359] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.817898 13638 raft_consensus.cc:385] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:30.818197 13638 raft_consensus.cc:740] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:30.819149 13638 consensus_queue.cc:260] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.822268 12743 catalog_manager.cc:5719] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:30.824488 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561]). Expected version 1 got 0
I20260810 13:53:30.826700 13639 ts_tablet_manager.cc:1434] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.057s user 0.006s sys 0.000s
I20260810 13:53:30.798197 13839 raft_consensus.cc:2804] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:30.829836 13839 raft_consensus.cc:697] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:30.830648 13839 consensus_queue.cc:237] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:30.853201 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 803a6a0a86a343b4a23f37d8317d5d0d (table default.Table_be9fec10e00d4ea6bbedfbe8346507b1 [id=383c0c58e7b047589f6b496ba8f4ecb0]). Expected version 4 got 0
I20260810 13:53:30.854795 13639 tablet_bootstrap.cc:492] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:53:30.859206 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e23454581a9a4b55b0756ef890dee7fb consensus state has no leader
I20260810 13:53:30.874136 13638 ts_tablet_manager.cc:1434] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.110s user 0.003s sys 0.004s
W20260810 13:53:30.878422 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46c08ec290e447678084964c23a930ad consensus state has no leader
I20260810 13:53:30.868554 12744 catalog_manager.cc:5719] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:30.885928 12739 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]). Expected version 2 got 0
I20260810 13:53:30.893589 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet 753ce298de754598b0cde6a4d5f38df1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:30.894840 13658 tablet_replica.cc:333] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:30.895541 13658 raft_consensus.cc:2243] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:30.895948 13658 raft_consensus.cc:2272] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:30.897569 13658 ts_tablet_manager.cc:1916] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:30.901062 13638 tablet_bootstrap.cc:492] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:30.913340 13014 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:30.929649 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d09e415cd1d84b0dbdf423af55ae1a20" } modify_external_catalogs: true
I20260810 13:53:30.930908 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d09e415cd1d84b0dbdf423af55ae1a20" } modify_external_catalogs: true
I20260810 13:53:30.934381 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e54429fe3e9c4a46849ec51775c7b98d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:30.934791 13695 ts_tablet_manager.cc:1929] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 13:53:30.935138 13695 log.cc:1199] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/4b4a3bdfd610415ca52aa6eaef015c1e
I20260810 13:53:30.935856 13695 ts_tablet_manager.cc:1950] T 4b4a3bdfd610415ca52aa6eaef015c1e P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:53:30.936082 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e54429fe3e9c4a46849ec51775c7b98d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.949898 13695 tablet_replica.cc:333] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:30.959062 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet dbc8028d03464b138c1f1e6f682f8b88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:30.959794 13659 tablet_replica.cc:333] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:30.960772 13659 raft_consensus.cc:2243] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:30.961460 13659 raft_consensus.cc:2272] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:30.961566 13675 raft_consensus.cc:493] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:30.962198 13675 raft_consensus.cc:515] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:30.966245 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cdab6f2407d4545bf6bbd81917b3434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:30.966388 13639 tablet_bootstrap.cc:654] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:30.967329 12739 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet e23454581a9a4b55b0756ef890dee7fb (table default.Table_08582b65868149cca4ac724f7d18a869 [id=590b98307a364781a383eb9a072bb4d7]). Expected version 2 got 0
I20260810 13:53:30.968493 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 4b4a3bdfd610415ca52aa6eaef015c1e (table default.Table_a0338fc5155e424581582eb72501a460 [id=16ae437e3ead46bf9b523ac06f73efe2]) successfully deleted
I20260810 13:53:30.969406 13659 ts_tablet_manager.cc:1916] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:30.970345 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_26706f97443749789e2eb7686f5b5baa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:30.974972 13658 ts_tablet_manager.cc:1929] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:30.975369 13658 log.cc:1199] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/753ce298de754598b0cde6a4d5f38df1
I20260810 13:53:30.976154 13658 ts_tablet_manager.cc:1950] T 753ce298de754598b0cde6a4d5f38df1 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:30.976646 13675 leader_election.cc:290] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
W20260810 13:53:30.986850 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26706f97443749789e2eb7686f5b5baa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.989178 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a016d9e12b94493d9de2b382919f4f52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:30.993460 13695 raft_consensus.cc:2243] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
W20260810 13:53:30.999430 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a016d9e12b94493d9de2b382919f4f52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:30.976862 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803a6a0a86a343b4a23f37d8317d5d0d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:31.007856 13167 leader_election.cc:343] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:31.012857 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803a6a0a86a343b4a23f37d8317d5d0d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:31.015422 13164 leader_election.cc:343] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:31.016119 13164 leader_election.cc:304] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:31.019411 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b4a3bdfd610415ca52aa6eaef015c1e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:31.021085 13640 tablet_bootstrap.cc:492] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:31.021241 13695 pending_rounds.cc:70] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: Trying to abort 1 pending ops.
I20260810 13:53:31.022274 13675 raft_consensus.cc:2749] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:31.030588 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 8ffbabe58e034f26915504f2b1fa4679
I20260810 13:53:31.021514 13640 ts_tablet_manager.cc:1403] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.520s user 0.011s sys 0.011s
I20260810 13:53:31.034214 13014 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffbabe58e034f26915504f2b1fa4679 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:31.035624 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffbabe58e034f26915504f2b1fa4679 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:31.035842 13640 raft_consensus.cc:359] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.036448 13640 raft_consensus.cc:385] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.037689 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6e068e49fcce427380036984ea33472f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:31.040529 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6e068e49fcce427380036984ea33472f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:31.046627 13658 tablet_replica.cc:333] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:31.047312 13658 raft_consensus.cc:2243] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:31.047739 13658 raft_consensus.cc:2272] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:31.048166 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffbabe58e034f26915504f2b1fa4679 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:31.049464 13658 ts_tablet_manager.cc:1916] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:31.021833 13695 pending_rounds.cc:77] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971564464955392 op_type: NO_OP noop_request { }
I20260810 13:53:31.057588 13695 raft_consensus.cc:2889] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:31.058010 13695 raft_consensus.cc:2272] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:31.068053 13638 tablet_bootstrap.cc:654] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:31.070228 13640 raft_consensus.cc:740] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.075843 13640 consensus_queue.cc:260] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.080476 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 753ce298de754598b0cde6a4d5f38df1 (table default.Table_f4652ba122584895bb5457b896c8221f [id=499867c6462c4d07bc1e9ade02170394]) successfully deleted
I20260810 13:53:31.076696 13875 tablet.cc:1724] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:31.095824 13640 ts_tablet_manager.cc:1434] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.063s user 0.006s sys 0.000s
I20260810 13:53:31.065738 13695 ts_tablet_manager.cc:1916] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:31.119271 13640 tablet_bootstrap.cc:492] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:31.121569 13658 ts_tablet_manager.cc:1929] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:31.130159 13658 log.cc:1199] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/36ec9b2dcf4f4096b27f7122fedaa33e
I20260810 13:53:31.135953 13658 ts_tablet_manager.cc:1950] T 36ec9b2dcf4f4096b27f7122fedaa33e P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:31.141834 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 36ec9b2dcf4f4096b27f7122fedaa33e (table default.Table_3177f4d8098a4c45b437b8e6021b0820 [id=c6652acc3d524807ab8be29692f07874]) successfully deleted
I20260810 13:53:31.135087 13639 tablet_bootstrap.cc:492] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:31.142908 13639 ts_tablet_manager.cc:1403] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.288s user 0.001s sys 0.019s
I20260810 13:53:31.146565 13659 ts_tablet_manager.cc:1929] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:31.146570 13639 raft_consensus.cc:359] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.147261 13639 raft_consensus.cc:385] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.147557 13639 raft_consensus.cc:740] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.150027 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ee68a2d145ba40c4a469a9ee06d0ea05" } new_table_name: "default.Table_71038e51b4474c5e9e8643d25c35a001" modify_external_catalogs: true
I20260810 13:53:31.150990 13659 log.cc:1199] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/dbc8028d03464b138c1f1e6f682f8b88
I20260810 13:53:31.151705 13659 ts_tablet_manager.cc:1950] T dbc8028d03464b138c1f1e6f682f8b88 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:31.153447 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d65613c7aabf400ca0d3681e35864efb" } new_table_name: "default.Table_2500b640931944079b9a58c7590ee717" modify_external_catalogs: true
I20260810 13:53:31.157359 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_bb7f1a0edf05477c9bef48a64c4b391a" } modify_external_catalogs: true
I20260810 13:53:31.158283 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_bb7f1a0edf05477c9bef48a64c4b391a" } modify_external_catalogs: true
W20260810 13:53:31.161849 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 8ffbabe58e034f26915504f2b1fa4679 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ffbabe58e034f26915504f2b1fa4679 already in progress: creating tablet
I20260810 13:53:31.162606 13639 consensus_queue.cc:260] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.170497 13659 tablet_replica.cc:333] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:31.171242 13659 raft_consensus.cc:2243] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:31.171820 13659 raft_consensus.cc:2272] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:31.175081 13758 raft_consensus.cc:493] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:31.175936 13758 raft_consensus.cc:515] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.179112 13638 tablet_bootstrap.cc:492] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
W20260810 13:53:31.179212 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 46c08ec290e447678084964c23a930ad consensus state has no leader
I20260810 13:53:31.179533 13638 ts_tablet_manager.cc:1403] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.279s user 0.008s sys 0.008s
I20260810 13:53:31.182238 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23454581a9a4b55b0756ef890dee7fb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:31.182988 13475 raft_consensus.cc:2468] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:31.182801 13638 raft_consensus.cc:359] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.183454 13638 raft_consensus.cc:385] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.183702 13638 raft_consensus.cc:740] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.184893 12951 leader_election.cc:304] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:31.186617 13758 leader_election.cc:290] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:31.187674 13758 raft_consensus.cc:2804] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:31.188562 13758 raft_consensus.cc:493] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:31.189302 13758 raft_consensus.cc:3060] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:31.192646 13640 tablet_bootstrap.cc:654] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:31.194090 13659 ts_tablet_manager.cc:1916] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:31.196987 13639 ts_tablet_manager.cc:1434] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.054s user 0.006s sys 0.001s
I20260810 13:53:31.214195 13639 tablet_bootstrap.cc:492] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:31.226246 13758 raft_consensus.cc:515] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.230302 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_62b678911e20486d82020751e85e2204"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:31.231976 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62b678911e20486d82020751e85e2204 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:31.238363 13640 tablet_bootstrap.cc:492] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:31.238878 13640 ts_tablet_manager.cc:1403] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.142s user 0.010s sys 0.006s
I20260810 13:53:31.242908 13640 raft_consensus.cc:359] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.243768 13640 raft_consensus.cc:385] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.244102 13640 raft_consensus.cc:740] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.244946 13640 consensus_queue.cc:260] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.248104 13640 ts_tablet_manager.cc:1434] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260810 13:53:31.250110 13640 tablet_bootstrap.cc:492] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:31.252283 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6e068e49fcce427380036984ea33472f" } modify_external_catalogs: true
I20260810 13:53:31.252941 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6e068e49fcce427380036984ea33472f" } modify_external_catalogs: true
I20260810 13:53:31.254829 13695 ts_tablet_manager.cc:1929] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:31.255148 13695 log.cc:1199] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/36ec9b2dcf4f4096b27f7122fedaa33e
I20260810 13:53:31.255815 13695 ts_tablet_manager.cc:1950] T 36ec9b2dcf4f4096b27f7122fedaa33e P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:31.258283 13639 tablet_bootstrap.cc:654] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:31.261304 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 36ec9b2dcf4f4096b27f7122fedaa33e (table default.Table_3177f4d8098a4c45b437b8e6021b0820 [id=c6652acc3d524807ab8be29692f07874]) successfully deleted
I20260810 13:53:31.263589 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23454581a9a4b55b0756ef890dee7fb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:31.264101 13475 raft_consensus.cc:3060] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:31.272023 13475 raft_consensus.cc:2468] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:31.273689 12951 leader_election.cc:304] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:31.284031 13879 raft_consensus.cc:2804] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:31.277487 13758 leader_election.cc:290] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:31.293329 12728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20260810 13:53:31.294847 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 0b427bfff3734fa08370bfbc480cb802 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0b427bfff3734fa08370bfbc480cb802 already in progress: creating tablet
W20260810 13:53:31.297416 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 4b4a3bdfd610415ca52aa6eaef015c1e because the tablet was not found. No further retry: Not found: Tablet not found: 4b4a3bdfd610415ca52aa6eaef015c1e
I20260810 13:53:31.300479 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet dbc8028d03464b138c1f1e6f682f8b88 (table default.Table_5920060ddbce482392401dc8c24f703f [id=307895865f6346a192129d3b938f3f4e]) successfully deleted
W20260810 13:53:31.302237 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 8ffbabe58e034f26915504f2b1fa4679 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ffbabe58e034f26915504f2b1fa4679 already in progress: creating tablet
I20260810 13:53:31.308179 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9656a7ccd188461fa55387c96150bb80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:31.184451 13638 consensus_queue.cc:260] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:31.310496 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9656a7ccd188461fa55387c96150bb80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:31.311723 13638 ts_tablet_manager.cc:1434] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.132s user 0.004s sys 0.004s
I20260810 13:53:31.317700 13638 tablet_bootstrap.cc:492] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:31.305370 13874 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:31.320669 13640 tablet_bootstrap.cc:654] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:31.309218 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23454581a9a4b55b0756ef890dee7fb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:31.325004 13269 raft_consensus.cc:2468] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:31.308528 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23454581a9a4b55b0756ef890dee7fb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:31.326123 13268 raft_consensus.cc:3060] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:31.328868 13874 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.332363 13639 tablet_bootstrap.cc:492] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:31.332927 13639 ts_tablet_manager.cc:1403] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.119s user 0.008s sys 0.007s
I20260810 13:53:31.332865 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:31.336710 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:31.338238 13167 leader_election.cc:343] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:31.340914 13164 leader_election.cc:343] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:31.344113 13164 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:31.345203 13640 tablet_bootstrap.cc:492] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:31.345629 13640 ts_tablet_manager.cc:1403] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.096s user 0.006s sys 0.005s
W20260810 13:53:31.345606 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a67cf93d78254f15a1b89c99048110c8 consensus state has no leader
I20260810 13:53:31.353921 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 1 got 0
I20260810 13:53:31.334116 13874 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:31.358539 13640 raft_consensus.cc:359] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.358626 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 9566586ecdd24e94bad62906c2166afd (DEFAULT_TABLE table=default.Table_4b7d5cd81064430aba9b62fad26b42ec [id=cccb8bdc8e41456d8c9614c8ca334a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.359180 13640 raft_consensus.cc:385] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.359431 13640 raft_consensus.cc:740] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.360030 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9566586ecdd24e94bad62906c2166afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.367427 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]). Expected version 2 got 0
I20260810 13:53:31.368232 12739 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae] alter complete (version 2)
I20260810 13:53:31.360070 13640 consensus_queue.cc:260] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:31.373093 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 307a6b609b674afbb684147005b66d87 consensus state has no leader
I20260810 13:53:31.375530 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 9566586ecdd24e94bad62906c2166afd (DEFAULT_TABLE table=default.Table_4b7d5cd81064430aba9b62fad26b42ec [id=cccb8bdc8e41456d8c9614c8ca334a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.376057 13874 raft_consensus.cc:2749] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:31.376822 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9566586ecdd24e94bad62906c2166afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.378705 13640 ts_tablet_manager.cc:1434] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20260810 13:53:31.383733 13640 tablet_bootstrap.cc:492] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:31.385517 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 9566586ecdd24e94bad62906c2166afd (DEFAULT_TABLE table=default.Table_4b7d5cd81064430aba9b62fad26b42ec [id=cccb8bdc8e41456d8c9614c8ca334a29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.386904 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9566586ecdd24e94bad62906c2166afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.389110 13839 raft_consensus.cc:493] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:31.389591 13839 raft_consensus.cc:515] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.390302 13434 tablet_service.cc:1511] Processing CreateTablet for tablet e4afea2da7c54e508084be42dec35099 (DEFAULT_TABLE table=default.Table_2de7aaadcc9042a1a7142a894e0c8493 [id=777bd2c67c1b46859627304bbcb53524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.391462 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4afea2da7c54e508084be42dec35099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.391631 13839 leader_election.cc:290] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:31.393673 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 36ec9b2dcf4f4096b27f7122fedaa33e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:31.398913 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdab6f2407d4545bf6bbd81917b3434" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:31.404706 13382 leader_election.cc:343] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:31.405469 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 36ec9b2dcf4f4096b27f7122fedaa33e because the tablet was not found. No further retry: Not found: Tablet not found: 36ec9b2dcf4f4096b27f7122fedaa33e
I20260810 13:53:31.405664 13018 tablet_service.cc:1511] Processing CreateTablet for tablet e4afea2da7c54e508084be42dec35099 (DEFAULT_TABLE table=default.Table_2de7aaadcc9042a1a7142a894e0c8493 [id=777bd2c67c1b46859627304bbcb53524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.406883 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4afea2da7c54e508084be42dec35099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.406482 13874 consensus_queue.cc:1048] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:31.410754 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cdab6f2407d4545bf6bbd81917b3434" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:31.419852 13239 tablet_service.cc:1511] Processing CreateTablet for tablet e4afea2da7c54e508084be42dec35099 (DEFAULT_TABLE table=default.Table_2de7aaadcc9042a1a7142a894e0c8493 [id=777bd2c67c1b46859627304bbcb53524]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.422379 13638 tablet_bootstrap.cc:654] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:31.413941 13268 raft_consensus.cc:2468] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:31.425153 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4afea2da7c54e508084be42dec35099. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.450982 13879 raft_consensus.cc:697] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:31.451905 13879 consensus_queue.cc:237] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.455852 13007 tablet_service.cc:1511] Processing CreateTablet for tablet c5f2e89d61854ee5bf6955b8244215eb (DEFAULT_TABLE table=default.Table_636572e9c1c24956bc53550f45390b1d [id=7ef508c9f0fc4ba99843e9a975526602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.457159 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f2e89d61854ee5bf6955b8244215eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.464298 13640 tablet_bootstrap.cc:654] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:31.483114 13638 tablet_bootstrap.cc:492] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:31.483580 13638 ts_tablet_manager.cc:1403] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.166s user 0.009s sys 0.002s
I20260810 13:53:31.488260 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a854e55f38e14aee8898f1cb29ba6b9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:31.489805 13659 ts_tablet_manager.cc:1929] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:31.490183 13659 log.cc:1199] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/6cdab6f2407d4545bf6bbd81917b3434
W20260810 13:53:31.490482 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a854e55f38e14aee8898f1cb29ba6b9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:31.490926 13659 ts_tablet_manager.cc:1950] T 6cdab6f2407d4545bf6bbd81917b3434 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:31.497099 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_cdafdcdf220049a7b14481d153792789"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:31.499346 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdafdcdf220049a7b14481d153792789 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:31.508440 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet e23454581a9a4b55b0756ef890dee7fb (table default.Table_08582b65868149cca4ac724f7d18a869 [id=590b98307a364781a383eb9a072bb4d7]). Expected version 2 got 0
I20260810 13:53:31.509335 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c]). Expected version 2 got 0
I20260810 13:53:31.513965 13640 tablet_bootstrap.cc:492] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:31.514349 13640 ts_tablet_manager.cc:1403] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.131s user 0.009s sys 0.000s
I20260810 13:53:31.512526 12745 catalog_manager.cc:5719] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:31.518631 12745 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet e23454581a9a4b55b0756ef890dee7fb (table default.Table_08582b65868149cca4ac724f7d18a869 [id=590b98307a364781a383eb9a072bb4d7]). Expected version 2 got 0
I20260810 13:53:31.520105 12745 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 803a6a0a86a343b4a23f37d8317d5d0d (table default.Table_be9fec10e00d4ea6bbedfbe8346507b1 [id=383c0c58e7b047589f6b496ba8f4ecb0]). Expected version 4 got 0
I20260810 13:53:31.522500 13640 raft_consensus.cc:359] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.531665 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 6cdab6f2407d4545bf6bbd81917b3434 (table default.Table_6d712ead31884c588f5b2596ab077be7 [id=a434c4a0963d4968a692435c738d2383]) successfully deleted
I20260810 13:53:31.531764 13638 raft_consensus.cc:359] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.533023 13640 raft_consensus.cc:385] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:53:31.533609 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 8ffbabe58e034f26915504f2b1fa4679 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8ffbabe58e034f26915504f2b1fa4679 already in progress: creating tablet
I20260810 13:53:31.527415 13434 tablet_service.cc:1511] Processing CreateTablet for tablet c5f2e89d61854ee5bf6955b8244215eb (DEFAULT_TABLE table=default.Table_636572e9c1c24956bc53550f45390b1d [id=7ef508c9f0fc4ba99843e9a975526602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.539186 13640 raft_consensus.cc:740] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.539966 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f2e89d61854ee5bf6955b8244215eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.543493 13863 tablet.cc:1724] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:31.539964 13640 consensus_queue.cc:260] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.549350 13640 ts_tablet_manager.cc:1434] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.035s user 0.008s sys 0.000s
I20260810 13:53:31.550194 13640 tablet_bootstrap.cc:492] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:31.551151 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]). Expected version 1 got 0
I20260810 13:53:31.554168 13906 tablet.cc:1724] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:31.562028 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]). Expected version 1 got 0
I20260810 13:53:31.563009 13640 tablet_bootstrap.cc:654] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:31.575625 13231 tablet_service.cc:1511] Processing CreateTablet for tablet c5f2e89d61854ee5bf6955b8244215eb (DEFAULT_TABLE table=default.Table_636572e9c1c24956bc53550f45390b1d [id=7ef508c9f0fc4ba99843e9a975526602]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.576905 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5f2e89d61854ee5bf6955b8244215eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:31.577171 13382 leader_election.cc:343] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: Tablet not RUNNING: STOPPED
I20260810 13:53:31.577667 13382 leader_election.cc:304] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:31.578631 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 52905us
I20260810 13:53:31.579509 13839 raft_consensus.cc:2749] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:31.580026 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cdab6f2407d4545bf6bbd81917b3434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:31.580754 13695 tablet_replica.cc:333] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:31.580415 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5ff0aa00c62240a982aa971545b08350" } new_table_name: "default.Table_61931e1060bf4fe3bb18256035837a88" modify_external_catalogs: true
I20260810 13:53:31.581420 13695 raft_consensus.cc:2243] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:31.581903 13695 raft_consensus.cc:2272] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:31.584518 13695 ts_tablet_manager.cc:1916] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:31.585000 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0b36b9f532694ebca181ab081e3f6e77" } new_table_name: "default.Table_339aa1d8438e452eb0447748597f32fb" modify_external_catalogs: true
I20260810 13:53:31.560559 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561]). Expected version 1 got 0
I20260810 13:53:31.601514 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6cfbfc47b2484396fcb517d791aae2 (DEFAULT_TABLE table=default.Table_84a5a2b5e80343c194da3ea9661f2a81 [id=d9297758ec4f42bda21e7490d69498cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.602596 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6cfbfc47b2484396fcb517d791aae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.580078 13779 consensus_queue.cc:1048] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:31.532656 13638 raft_consensus.cc:385] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.605108 13638 raft_consensus.cc:740] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.606070 13638 consensus_queue.cc:260] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.608093 13638 ts_tablet_manager.cc:1434] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.124s user 0.002s sys 0.004s
I20260810 13:53:31.610546 13639 raft_consensus.cc:359] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.611196 13639 raft_consensus.cc:385] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.611447 13639 raft_consensus.cc:740] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.612072 13639 consensus_queue.cc:260] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.616735 13639 ts_tablet_manager.cc:1434] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.283s user 0.003s sys 0.004s
I20260810 13:53:31.621399 13638 tablet_bootstrap.cc:492] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:31.626554 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 92ba87c833e5459884173b65fb5645b6 (DEFAULT_TABLE table=default.Table_5151631f180c44e8bb89c91b094f1259 [id=8b0d7ace0c6f4b9592148341b6da7c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.629985 13639 tablet_bootstrap.cc:492] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:31.632579 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ba87c833e5459884173b65fb5645b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.632331 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6cfbfc47b2484396fcb517d791aae2 (DEFAULT_TABLE table=default.Table_84a5a2b5e80343c194da3ea9661f2a81 [id=d9297758ec4f42bda21e7490d69498cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.633440 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6cfbfc47b2484396fcb517d791aae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.637627 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 92ba87c833e5459884173b65fb5645b6 (DEFAULT_TABLE table=default.Table_5151631f180c44e8bb89c91b094f1259 [id=8b0d7ace0c6f4b9592148341b6da7c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.638732 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ba87c833e5459884173b65fb5645b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.642289 13639 tablet_bootstrap.cc:654] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:31.660766 12746 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 7ec635ded92041ecb38dc114a0bfabb2
I20260810 13:53:31.665788 13430 tablet_service.cc:1511] Processing CreateTablet for tablet eaaa924290594d319b02526550416571 (DEFAULT_TABLE table=default.Table_2560857e4f9f4c45988374f05f107f9c [id=b4f568587c6841999ef3750b3cd4044a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.666963 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaa924290594d319b02526550416571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.666744 13435 tablet_service.cc:1511] Processing CreateTablet for tablet acaaa179b4fa4ca592674e24a4e54706 (DEFAULT_TABLE table=default.Table_bb7f1a0edf05477c9bef48a64c4b391a [id=44416790a2a54b08ae687611fc087cdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.667948 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acaaa179b4fa4ca592674e24a4e54706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.672827 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6cfbfc47b2484396fcb517d791aae2 (DEFAULT_TABLE table=default.Table_84a5a2b5e80343c194da3ea9661f2a81 [id=d9297758ec4f42bda21e7490d69498cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.674361 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6cfbfc47b2484396fcb517d791aae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.681730 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 92ba87c833e5459884173b65fb5645b6 (DEFAULT_TABLE table=default.Table_5151631f180c44e8bb89c91b094f1259 [id=8b0d7ace0c6f4b9592148341b6da7c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.683477 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ba87c833e5459884173b65fb5645b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.686604 13695 ts_tablet_manager.cc:1929] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:31.698120 13695 log.cc:1199] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/6cdab6f2407d4545bf6bbd81917b3434
I20260810 13:53:31.699545 13695 ts_tablet_manager.cc:1950] T 6cdab6f2407d4545bf6bbd81917b3434 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:31.708981 13879 raft_consensus.cc:493] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:31.711668 13236 tablet_service.cc:1511] Processing CreateTablet for tablet eaaa924290594d319b02526550416571 (DEFAULT_TABLE table=default.Table_2560857e4f9f4c45988374f05f107f9c [id=b4f568587c6841999ef3750b3cd4044a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.712843 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaa924290594d319b02526550416571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.713145 13010 tablet_service.cc:1511] Processing CreateTablet for tablet acaaa179b4fa4ca592674e24a4e54706 (DEFAULT_TABLE table=default.Table_bb7f1a0edf05477c9bef48a64c4b391a [id=44416790a2a54b08ae687611fc087cdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.714210 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acaaa179b4fa4ca592674e24a4e54706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.715890 13238 tablet_service.cc:1511] Processing CreateTablet for tablet acaaa179b4fa4ca592674e24a4e54706 (DEFAULT_TABLE table=default.Table_bb7f1a0edf05477c9bef48a64c4b391a [id=44416790a2a54b08ae687611fc087cdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.716897 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acaaa179b4fa4ca592674e24a4e54706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.717064 13014 tablet_service.cc:1511] Processing CreateTablet for tablet eaaa924290594d319b02526550416571 (DEFAULT_TABLE table=default.Table_2560857e4f9f4c45988374f05f107f9c [id=b4f568587c6841999ef3750b3cd4044a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:31.718114 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaaa924290594d319b02526550416571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:31.718945 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet acaaa179b4fa4ca592674e24a4e54706
I20260810 13:53:31.711865 13879 raft_consensus.cc:515] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.721434 13779 raft_consensus.cc:493] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:31.721992 13779 raft_consensus.cc:515] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.726941 13779 leader_election.cc:290] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:31.727720 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:31.729292 13167 leader_election.cc:343] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:31.734155 13879 leader_election.cc:290] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:31.734799 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet acaaa179b4fa4ca592674e24a4e54706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:31 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:31.735378 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58df75cb91544ef863a09f4d6004da0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:31.735961 13268 raft_consensus.cc:2468] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:31.737211 12952 leader_election.cc:304] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:31.738088 13879 raft_consensus.cc:2804] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:31.738433 13879 raft_consensus.cc:493] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:31.738770 13879 raft_consensus.cc:3060] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:31.727085 13638 tablet_bootstrap.cc:654] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:31.751355 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet acaaa179b4fa4ca592674e24a4e54706 because the tablet was not found. No further retry: Not found: Tablet not found: acaaa179b4fa4ca592674e24a4e54706
I20260810 13:53:31.758854 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 6cdab6f2407d4545bf6bbd81917b3434 (table default.Table_6d712ead31884c588f5b2596ab077be7 [id=a434c4a0963d4968a692435c738d2383]) successfully deleted
I20260810 13:53:31.764497 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:31.765025 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58df75cb91544ef863a09f4d6004da0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:31.765715 13477 raft_consensus.cc:2468] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:53:31.766448 13164 leader_election.cc:343] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:31.767048 13164 leader_election.cc:304] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:31.768507 13779 raft_consensus.cc:2749] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:31.769012 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet acaaa179b4fa4ca592674e24a4e54706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:31 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:31.769711 13435 tablet_service.cc:1558] Processing DeleteTablet for tablet acaaa179b4fa4ca592674e24a4e54706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:31 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:31.770808 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet acaaa179b4fa4ca592674e24a4e54706 because the tablet was not found. No further retry: Not found: Tablet not found: acaaa179b4fa4ca592674e24a4e54706
W20260810 13:53:31.777884 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet acaaa179b4fa4ca592674e24a4e54706 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet acaaa179b4fa4ca592674e24a4e54706 already in progress: creating tablet
I20260810 13:53:31.782783 13640 tablet_bootstrap.cc:492] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:31.783223 13640 ts_tablet_manager.cc:1403] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.233s user 0.013s sys 0.004s
I20260810 13:53:31.792750 13640 raft_consensus.cc:359] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:31.798591 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2cf90601bf4424aa6dc009415af8db6 consensus state has no leader
I20260810 13:53:31.776268 13879 raft_consensus.cc:515] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.815724 13879 leader_election.cc:290] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:31.817157 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1108f64f1260448b8a68ea9fe30ea494 consensus state has no leader
I20260810 13:53:31.820019 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58df75cb91544ef863a09f4d6004da0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:31.820972 13268 raft_consensus.cc:3060] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:31.835079 13268 raft_consensus.cc:2468] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:31.845721 12739 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]). Expected version 1 got 0
I20260810 13:53:31.853622 12952 leader_election.cc:304] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:31.855077 13879 raft_consensus.cc:2804] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:31.855549 13879 raft_consensus.cc:697] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:31.856423 13879 consensus_queue.cc:237] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.868623 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_62b678911e20486d82020751e85e2204" } modify_external_catalogs: true
I20260810 13:53:31.869625 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_62b678911e20486d82020751e85e2204" } modify_external_catalogs: true
I20260810 13:53:31.874593 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c75d32693a7f4df68c1f2c97bfaf15f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:31.794822 13916 mvcc.cc:204] Tried to move back new op lower bound from 7316971566934024192 to 7316971562097467392. Current Snapshot: MvccSnapshot[applied={T|T < 7316971566934024192}]
W20260810 13:53:31.879786 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c75d32693a7f4df68c1f2c97bfaf15f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:31.793551 13640 raft_consensus.cc:385] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.880968 13640 raft_consensus.cc:740] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.882043 13640 consensus_queue.cc:260] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.809544 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58df75cb91544ef863a09f4d6004da0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:31.894093 13477 raft_consensus.cc:3060] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:31.801694 13839 consensus_queue.cc:1048] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.104s
I20260810 13:53:31.921633 13928 consensus_queue.cc:1048] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:31.945560 13640 ts_tablet_manager.cc:1434] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.162s user 0.008s sys 0.001s
I20260810 13:53:31.946230 13639 tablet_bootstrap.cc:492] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:31.946660 13639 ts_tablet_manager.cc:1403] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.317s user 0.004s sys 0.016s
I20260810 13:53:31.954625 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f7cdc66038804ad2b056118e3f6cf67e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:31.955358 13640 tablet_bootstrap.cc:492] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:31.957911 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_65f3e467e91b454799305f55c1a236ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:31.958846 13927 tablet.cc:1724] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:31.963078 13639 raft_consensus.cc:359] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.968151 13638 tablet_bootstrap.cc:492] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:31.974268 13639 raft_consensus.cc:385] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.968677 13638 ts_tablet_manager.cc:1403] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.347s user 0.004s sys 0.014s
I20260810 13:53:31.979573 13639 raft_consensus.cc:740] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.980818 13639 consensus_queue.cc:260] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:31.978605 13638 raft_consensus.cc:359] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:31.991047 13638 raft_consensus.cc:385] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:31.991465 13638 raft_consensus.cc:740] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:31.992417 13638 consensus_queue.cc:260] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.002403 13638 ts_tablet_manager.cc:1434] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.027s user 0.007s sys 0.001s
I20260810 13:53:32.004772 13639 ts_tablet_manager.cc:1434] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.058s user 0.007s sys 0.002s
I20260810 13:53:32.005793 13639 tablet_bootstrap.cc:492] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:32.010353 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_4b1bb30dd1e24d91bcd19adea0bb0b9d" } new_table_name: "default.Table_434066270df645e9b8616951cfc588ba" modify_external_catalogs: true
W20260810 13:53:32.030719 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65f3e467e91b454799305f55c1a236ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.030866 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e54429fe3e9c4a46849ec51775c7b98d" } modify_external_catalogs: true
I20260810 13:53:32.031782 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e54429fe3e9c4a46849ec51775c7b98d" } modify_external_catalogs: true
W20260810 13:53:32.033337 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7cdc66038804ad2b056118e3f6cf67e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.033439 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f6f7ede8521e49639551011fad2d4e87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:32.036512 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6f7ede8521e49639551011fad2d4e87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.037304 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0609246684174333942081eeed9399f6" } new_table_name: "default.Table_fa5cf1b28a8849b8a511b17ee9213eca" modify_external_catalogs: true
I20260810 13:53:32.039362 13640 tablet_bootstrap.cc:654] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.087308 13640 tablet_bootstrap.cc:492] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:32.087950 13640 ts_tablet_manager.cc:1403] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.142s user 0.005s sys 0.012s
I20260810 13:53:32.110522 13640 raft_consensus.cc:359] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.110874 12744 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet f75a8311ba914af685c1d7e08a670742
I20260810 13:53:32.111176 13640 raft_consensus.cc:385] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:32.111418 13640 raft_consensus.cc:740] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:32.112181 13640 consensus_queue.cc:260] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.117592 13930 raft_consensus.cc:493] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:32.118348 13930 raft_consensus.cc:515] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.017874 13779 raft_consensus.cc:493] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:32.119748 13779 raft_consensus.cc:515] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.122504 13930 leader_election.cc:290] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:32.124832 13640 ts_tablet_manager.cc:1434] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.036s user 0.004s sys 0.004s
I20260810 13:53:32.125775 13640 tablet_bootstrap.cc:492] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:53:32.133472 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce consensus state has no leader
I20260810 13:53:32.134897 12750 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561] alter complete (version 1)
I20260810 13:53:32.137892 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c08ec290e447678084964c23a930ad" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:32.138787 13268 raft_consensus.cc:2468] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:32.146602 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_9fcafa456d124c5d95b8e9e9f76dba13 [id=8aad892ad49f4c0aa7681d88843d3561]). Expected version 1 got 0
I20260810 13:53:32.156586 13640 tablet_bootstrap.cc:654] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.174743 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9081f957f5824ed29603b1d84eff6906" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:32.176944 13164 leader_election.cc:343] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:32.179266 13640 tablet_bootstrap.cc:492] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:32.179724 13640 ts_tablet_manager.cc:1403] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.054s user 0.008s sys 0.009s
I20260810 13:53:32.172600 13779 leader_election.cc:290] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:32.181527 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5836c2923aaf4c698e20b9652fcddc20 consensus state has no leader
I20260810 13:53:32.185050 13640 raft_consensus.cc:359] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.185642 13640 raft_consensus.cc:385] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:32.185997 13640 raft_consensus.cc:740] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:32.187179 13640 consensus_queue.cc:260] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.193864 13640 ts_tablet_manager.cc:1434] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.014s user 0.000s sys 0.007s
I20260810 13:53:32.194674 13640 tablet_bootstrap.cc:492] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:32.201102 13382 leader_election.cc:304] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:32.202469 13930 raft_consensus.cc:2804] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:32.203004 13930 raft_consensus.cc:493] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:32.203466 13930 raft_consensus.cc:3060] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:32.205615 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 803a6a0a86a343b4a23f37d8317d5d0d (table default.Table_be9fec10e00d4ea6bbedfbe8346507b1 [id=383c0c58e7b047589f6b496ba8f4ecb0], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet 803a6a0a86a343b4a23f37d8317d5d0d consensus state has no leader
I20260810 13:53:32.219774 13930 raft_consensus.cc:515] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.231395 13638 tablet_bootstrap.cc:492] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:32.231693 13930 leader_election.cc:290] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:32.245183 13640 tablet_bootstrap.cc:654] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.232299 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c08ec290e447678084964c23a930ad" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:32.270139 13268 raft_consensus.cc:3060] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:32.281430 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9081f957f5824ed29603b1d84eff6906" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:32.287230 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c08ec290e447678084964c23a930ad" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:32.269209 13879 raft_consensus.cc:493] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:32.277112 13887 raft_consensus.cc:493] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:32.294937 13887 raft_consensus.cc:515] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.293921 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c08ec290e447678084964c23a930ad" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:32.298658 13879 raft_consensus.cc:515] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.302627 13050 raft_consensus.cc:3060] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:32.313508 13167 leader_election.cc:343] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:32.314018 13167 leader_election.cc:304] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:32.317929 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803a6a0a86a343b4a23f37d8317d5d0d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:32.318655 13269 raft_consensus.cc:2468] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:32.319525 13879 leader_election.cc:290] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:32.321727 12952 leader_election.cc:304] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:32.322952 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_339aa1d8438e452eb0447748597f32fb" } modify_external_catalogs: true
I20260810 13:53:32.322999 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c08ec290e447678084964c23a930ad" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:32.323519 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_339aa1d8438e452eb0447748597f32fb" } modify_external_catalogs: true
I20260810 13:53:32.325634 13887 leader_election.cc:290] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:32.328668 13779 raft_consensus.cc:2749] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:32.326349 13887 raft_consensus.cc:2804] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:32.331399 13887 raft_consensus.cc:493] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:32.331813 13887 raft_consensus.cc:3060] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:32.337937 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_cf87937d4ae348878fccadff2eca2c6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:32.339499 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf87937d4ae348878fccadff2eca2c6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.355713 13639 tablet_bootstrap.cc:654] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.359290 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803a6a0a86a343b4a23f37d8317d5d0d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:32.359423 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_da1e61ef9f8f47a5951aa7018430e579"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:32.360142 13475 raft_consensus.cc:2468] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:53:32.362156 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da1e61ef9f8f47a5951aa7018430e579 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.312592 13050 raft_consensus.cc:2468] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:32.369424 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_62fb6098d2ab4e7e87f381440fd0e1f6" } new_table_name: "default.Table_5b387b0607e24b559bfb3fbfdc9dc431" modify_external_catalogs: true
I20260810 13:53:32.373566 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_81b4a7eba14c4cc4835272fbaf08f02a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:32.375552 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81b4a7eba14c4cc4835272fbaf08f02a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.379240 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c08ec290e447678084964c23a930ad" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:32.384893 13476 raft_consensus.cc:2393] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:32.379825 13382 leader_election.cc:304] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:32.386289 13930 raft_consensus.cc:2804] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:32.386757 13930 raft_consensus.cc:697] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:32.387578 13930 consensus_queue.cc:237] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.381335 13480 raft_consensus.cc:1275] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 13:53:32.383359 13640 tablet_bootstrap.cc:492] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:32.393020 13640 ts_tablet_manager.cc:1403] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.198s user 0.052s sys 0.048s
W20260810 13:53:32.396872 13477 consensus_meta.cc:287] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.502s user 0.007s sys 0.003s
I20260810 13:53:32.397986 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d5cdc422c7d54e0191f33637f3a9822d" } new_table_name: "default.Table_22a4a114f5cf4de481c7520fc99963ba" modify_external_catalogs: true
I20260810 13:53:32.413089 13477 raft_consensus.cc:2468] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:32.407539 13640 raft_consensus.cc:359] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.415131 13640 raft_consensus.cc:385] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:32.415597 13640 raft_consensus.cc:740] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:32.416882 13640 consensus_queue.cc:260] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.427181 13638 tablet_bootstrap.cc:654] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.446641 13268 raft_consensus.cc:2468] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:32.449921 13640 ts_tablet_manager.cc:1434] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.057s user 0.006s sys 0.002s
I20260810 13:53:32.452507 13640 tablet_bootstrap.cc:492] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:32.482568 12951 leader_election.cc:304] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:32.490406 13640 tablet_bootstrap.cc:654] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.499678 13879 raft_consensus.cc:2749] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:32.500841 13879 consensus_queue.cc:1048] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:32.517831 13639 tablet_bootstrap.cc:492] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:32.522194 13639 ts_tablet_manager.cc:1403] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.517s user 0.013s sys 0.021s
I20260810 13:53:32.533876 13887 raft_consensus.cc:515] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.530082 13638 tablet_bootstrap.cc:492] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:32.538345 13638 ts_tablet_manager.cc:1403] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.307s user 0.004s sys 0.012s
I20260810 13:53:32.542083 13639 raft_consensus.cc:359] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.543686 13640 tablet_bootstrap.cc:492] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:32.542214 13638 raft_consensus.cc:359] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.544083 13638 raft_consensus.cc:385] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:32.544342 13638 raft_consensus.cc:740] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:32.545593 13640 ts_tablet_manager.cc:1403] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.093s user 0.015s sys 0.007s
I20260810 13:53:32.545303 13638 consensus_queue.cc:260] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.559804 13638 ts_tablet_manager.cc:1434] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.021s user 0.004s sys 0.004s
I20260810 13:53:32.560667 13639 raft_consensus.cc:385] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:32.563036 13639 raft_consensus.cc:740] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:32.564827 13639 consensus_queue.cc:260] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.567577 13640 raft_consensus.cc:359] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.571504 13639 ts_tablet_manager.cc:1434] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.048s user 0.006s sys 0.000s
I20260810 13:53:32.578809 13638 tablet_bootstrap.cc:492] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:32.594787 13640 raft_consensus.cc:385] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:32.594734 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 803a6a0a86a343b4a23f37d8317d5d0d (table default.Table_be9fec10e00d4ea6bbedfbe8346507b1 [id=383c0c58e7b047589f6b496ba8f4ecb0]). Expected version 4 got 0
I20260810 13:53:32.595233 13640 raft_consensus.cc:740] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:32.596212 13640 consensus_queue.cc:260] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.597424 13638 tablet_bootstrap.cc:654] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.602195 13639 tablet_bootstrap.cc:492] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:32.605930 13236 tablet_service.cc:1511] Processing CreateTablet for tablet b7dded9a7c2c4652b41131f0bc14a6b5 (DEFAULT_TABLE table=default.Table_26706f97443749789e2eb7686f5b5baa [id=4e674333f87c408fa06b5852511ad168]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:32.606966 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dded9a7c2c4652b41131f0bc14a6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:32.609455 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 35ba701a453546088933416d17e71127 (DEFAULT_TABLE table=default.Table_e54429fe3e9c4a46849ec51775c7b98d [id=5fa0d1b7c3134c4c9e2f3a8ae8c5ff8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:32.610507 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ba701a453546088933416d17e71127. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:32.613027 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 185031fc211149fe87003c0cf267030d consensus state has no leader
I20260810 13:53:32.613816 13640 ts_tablet_manager.cc:1434] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.067s user 0.007s sys 0.000s
I20260810 13:53:32.614876 13442 tablet_service.cc:1511] Processing CreateTablet for tablet b7dded9a7c2c4652b41131f0bc14a6b5 (DEFAULT_TABLE table=default.Table_26706f97443749789e2eb7686f5b5baa [id=4e674333f87c408fa06b5852511ad168]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:32.616001 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dded9a7c2c4652b41131f0bc14a6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:32.616932 13640 tablet_bootstrap.cc:492] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:32.617542 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 35ba701a453546088933416d17e71127 (DEFAULT_TABLE table=default.Table_e54429fe3e9c4a46849ec51775c7b98d [id=5fa0d1b7c3134c4c9e2f3a8ae8c5ff8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:32.623109 13639 tablet_bootstrap.cc:654] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.622828 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 2327309017db4094907b3e405988f224 (DEFAULT_TABLE table=default.Table_a016d9e12b94493d9de2b382919f4f52 [id=924550c187ce43b4940231335048eefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:32.629206 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ba701a453546088933416d17e71127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:32.631603 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 2327309017db4094907b3e405988f224 (DEFAULT_TABLE table=default.Table_a016d9e12b94493d9de2b382919f4f52 [id=924550c187ce43b4940231335048eefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:32.632174 13638 tablet_bootstrap.cc:492] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:32.632565 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2327309017db4094907b3e405988f224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:32.632561 13638 ts_tablet_manager.cc:1403] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.000s
I20260810 13:53:32.640002 13640 tablet_bootstrap.cc:654] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.647516 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_0af09af6fb66466099e6c7b157ee196b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:32.649330 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0af09af6fb66466099e6c7b157ee196b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.652743 13638 raft_consensus.cc:359] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.653416 13638 raft_consensus.cc:385] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:32.653779 13638 raft_consensus.cc:740] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:32.654367 12742 catalog_manager.cc:5719] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:32.657145 13937 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:32.657825 13937 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.660964 13879 raft_consensus.cc:493] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:32.661506 13879 raft_consensus.cc:515] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.664275 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]). Expected version 1 got 0
I20260810 13:53:32.664213 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:32.665216 13937 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:32.665997 13879 leader_election.cc:290] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:32.665848 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c]). Expected version 2 got 0
W20260810 13:53:32.670267 12952 leader_election.cc:343] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 6cdab6f2407d4545bf6bbd81917b3434
I20260810 13:53:32.671691 13010 tablet_service.cc:1511] Processing CreateTablet for tablet b7dded9a7c2c4652b41131f0bc14a6b5 (DEFAULT_TABLE table=default.Table_26706f97443749789e2eb7686f5b5baa [id=4e674333f87c408fa06b5852511ad168]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:32.673344 13167 leader_election.cc:343] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:32.674603 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 35ba701a453546088933416d17e71127 (DEFAULT_TABLE table=default.Table_e54429fe3e9c4a46849ec51775c7b98d [id=5fa0d1b7c3134c4c9e2f3a8ae8c5ff8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:32.677887 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 2327309017db4094907b3e405988f224 (DEFAULT_TABLE table=default.Table_a016d9e12b94493d9de2b382919f4f52 [id=924550c187ce43b4940231335048eefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:32.682032 13268 raft_consensus.cc:1275] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 13:53:32.684536 13879 consensus_queue.cc:1048] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:32.688601 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dded9a7c2c4652b41131f0bc14a6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:32.693828 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ba701a453546088933416d17e71127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:32.695963 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2327309017db4094907b3e405988f224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:32.699780 13638 consensus_queue.cc:260] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.710305 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 35ba701a453546088933416d17e71127
I20260810 13:53:32.713085 13887 leader_election.cc:290] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:32.720357 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ba701a453546088933416d17e71127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:32.751165 13639 tablet_bootstrap.cc:492] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:32.751627 13639 ts_tablet_manager.cc:1403] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.150s user 0.009s sys 0.013s
I20260810 13:53:32.755834 13930 raft_consensus.cc:493] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:32.756577 13930 raft_consensus.cc:515] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.759490 13930 leader_election.cc:290] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:32.761093 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2327309017db4094907b3e405988f224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:32.765220 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:32.766626 13435 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ba701a453546088933416d17e71127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:32.771440 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803a6a0a86a343b4a23f37d8317d5d0d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:32.772044 13475 raft_consensus.cc:3060] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:32.776798 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 1108f64f1260448b8a68ea9fe30ea494
I20260810 13:53:32.786505 13639 raft_consensus.cc:359] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.787299 13639 raft_consensus.cc:385] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:32.787566 13639 raft_consensus.cc:740] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:32.797020 13639 consensus_queue.cc:260] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:32.805248 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 35ba701a453546088933416d17e71127 because the tablet was not found. No further retry: Not found: Tablet not found: 35ba701a453546088933416d17e71127
I20260810 13:53:32.813741 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1023c03a20e448b4abaa7920a9ae09d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:32.814767 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 1108f64f1260448b8a68ea9fe30ea494 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:32.815505 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1023c03a20e448b4abaa7920a9ae09d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.715385 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "803a6a0a86a343b4a23f37d8317d5d0d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:32.819346 13269 raft_consensus.cc:3060] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:32.715791 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ba701a453546088933416d17e71127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:32.821102 13638 ts_tablet_manager.cc:1434] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.185s user 0.005s sys 0.004s
I20260810 13:53:32.782176 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet 1108f64f1260448b8a68ea9fe30ea494 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:32.825556 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_71038e51b4474c5e9e8643d25c35a001 [id=5b919872756647048ea2e4fecbe78537]). Expected version 1 got 0
I20260810 13:53:32.832626 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_af9731918cc3424cae557be94f842007"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:32.833077 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_da1e61ef9f8f47a5951aa7018430e579" } new_table_name: "default.Table_f3ec47fb314845439746815e3f401bc7" modify_external_catalogs: true
W20260810 13:53:32.834333 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_af9731918cc3424cae557be94f842007 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.838222 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9081f957f5824ed29603b1d84eff6906" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:32.839448 13265 raft_consensus.cc:2468] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:32.836280 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_060b551b964e40d1a67a29b0927f2ed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:32.830020 13928 raft_consensus.cc:493] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:32.843818 13928 raft_consensus.cc:515] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:32.845283 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_060b551b964e40d1a67a29b0927f2ed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:32.846083 13928 leader_election.cc:290] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:32.846596 13928 raft_consensus.cc:493] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:32.847072 13928 raft_consensus.cc:515] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.851248 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 1108f64f1260448b8a68ea9fe30ea494 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:32.852582 13164 leader_election.cc:343] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:32.853012 13164 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:32.855038 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet dbc8028d03464b138c1f1e6f682f8b88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:32.857214 13976 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:32.857304 13382 leader_election.cc:304] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:32.855005 13639 ts_tablet_manager.cc:1434] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.103s user 0.008s sys 0.011s
I20260810 13:53:32.860587 13639 tablet_bootstrap.cc:492] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:32.860882 13988 tablet.cc:1724] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 13:53:32.864348 12951 leader_election.cc:343] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 6cdab6f2407d4545bf6bbd81917b3434
W20260810 13:53:32.873483 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 35ba701a453546088933416d17e71127 because the tablet was not found. No further retry: Not found: Tablet not found: 35ba701a453546088933416d17e71127
W20260810 13:53:32.876940 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 1108f64f1260448b8a68ea9fe30ea494 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1108f64f1260448b8a68ea9fe30ea494 already in progress: creating tablet
I20260810 13:53:32.885380 13269 raft_consensus.cc:2468] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:32.888842 13930 raft_consensus.cc:2804] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:32.896862 13930 raft_consensus.cc:493] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:32.897197 13930 raft_consensus.cc:3060] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:32.904966 13928 leader_election.cc:290] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:32.921761 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c75d32693a7f4df68c1f2c97bfaf15f5" } modify_external_catalogs: true
I20260810 13:53:32.922428 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c75d32693a7f4df68c1f2c97bfaf15f5" } modify_external_catalogs: true
I20260810 13:53:32.932914 13475 raft_consensus.cc:2468] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:32.935117 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:32.935750 13269 raft_consensus.cc:2468] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
W20260810 13:53:32.936322 13382 leader_election.cc:343] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: dbc8028d03464b138c1f1e6f682f8b88
I20260810 13:53:32.880525 13639 tablet_bootstrap.cc:654] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:32.936892 12951 leader_election.cc:304] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:32.937786 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 73508.5us
I20260810 13:53:32.939352 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9081f957f5824ed29603b1d84eff6906" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:32.890717 12952 leader_election.cc:304] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:32.940974 13887 raft_consensus.cc:493] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:53:32.941279 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 50627.9us
I20260810 13:53:32.941533 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc8028d03464b138c1f1e6f682f8b88" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:32.941592 13887 raft_consensus.cc:515] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:32.942580 13879 raft_consensus.cc:2749] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:32.943724 13879 raft_consensus.cc:2804] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:32.944478 13879 raft_consensus.cc:697] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:32.944948 13050 raft_consensus.cc:2468] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:32.946070 13879 consensus_queue.cc:237] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:32.950867 12952 leader_election.cc:343] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: dbc8028d03464b138c1f1e6f682f8b88
I20260810 13:53:32.951042 13887 leader_election.cc:290] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:32.976166 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d48dc5ee2e94468ab72aa4dc58b0ae01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:32.989439 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a456e8d8c2b046e7a2877075ce1b3741" } modify_external_catalogs: true
I20260810 13:53:32.990010 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a456e8d8c2b046e7a2877075ce1b3741" } modify_external_catalogs: true
I20260810 13:53:32.992393 13639 tablet_bootstrap.cc:492] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:32.992846 13639 ts_tablet_manager.cc:1403] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.132s user 0.023s sys 0.008s
I20260810 13:53:32.993081 13990 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:53:32.994436 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73ad47d29d61456891478a9544594a94 has no consensus state
I20260810 13:53:32.993924 13990 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:32.997587 13990 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
W20260810 13:53:32.998356 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d48dc5ee2e94468ab72aa4dc58b0ae01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.002599 13639 raft_consensus.cc:359] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.003258 13639 raft_consensus.cc:385] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:33.003536 13639 raft_consensus.cc:740] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:33.004179 13639 consensus_queue.cc:260] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.006187 13639 ts_tablet_manager.cc:1434] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.013s user 0.006s sys 0.001s
I20260810 13:53:33.006048 13975 tablet.cc:1724] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:33.017222 13638 tablet_bootstrap.cc:492] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:33.018488 13639 tablet_bootstrap.cc:492] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:33.026257 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:33.027138 13050 raft_consensus.cc:2468] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:33.041692 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_4b7d5cd81064430aba9b62fad26b42ec" } new_table_name: "default.Table_e9ba4f3b33c04d40b8eec3b0ff44485f" modify_external_catalogs: true
W20260810 13:53:33.046226 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 1108f64f1260448b8a68ea9fe30ea494 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1108f64f1260448b8a68ea9fe30ea494 already in progress: creating tablet
I20260810 13:53:33.061159 13639 tablet_bootstrap.cc:654] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:33.064240 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9566586ecdd24e94bad62906c2166afd consensus state has no leader
I20260810 13:53:33.067876 13638 tablet_bootstrap.cc:654] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:33.071580 13986 tablet_replica.cc:333] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:33.073258 13986 raft_consensus.cc:2243] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 13:53:33.064997 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 128707us
I20260810 13:53:33.077013 13382 leader_election.cc:304] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:33.079998 13928 raft_consensus.cc:2804] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:33.080549 13928 raft_consensus.cc:493] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:33.081161 13928 raft_consensus.cc:3060] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:33.092644 13930 raft_consensus.cc:515] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.095620 13930 leader_election.cc:290] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
W20260810 13:53:33.097980 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 35ba701a453546088933416d17e71127 because the tablet was not found. No further retry: Not found: Tablet not found: 35ba701a453546088933416d17e71127
W20260810 13:53:33.098704 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 1108f64f1260448b8a68ea9fe30ea494 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1108f64f1260448b8a68ea9fe30ea494 already in progress: creating tablet
W20260810 13:53:33.099856 13382 leader_election.cc:343] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:33.099869 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc8028d03464b138c1f1e6f682f8b88" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:33.104993 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:33.105288 13986 raft_consensus.cc:2272] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:33.105798 13269 raft_consensus.cc:2468] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:33.107488 13986 ts_tablet_manager.cc:1916] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:33.110486 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9081f957f5824ed29603b1d84eff6906" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:33.111310 13264 raft_consensus.cc:3060] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:33.118811 13640 tablet_bootstrap.cc:492] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:33.119511 13640 ts_tablet_manager.cc:1403] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.503s user 0.006s sys 0.026s
I20260810 13:53:33.133005 13382 leader_election.cc:304] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:53:33.133699 13382 raft_consensus.cc:2686] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:33.141582 13264 raft_consensus.cc:2468] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:33.143141 13928 raft_consensus.cc:515] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.146579 13988 tablet.cc:1724] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:33.147828 13949 consensus_queue.cc:1048] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260810 13:53:33.156968 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e58fac539ec54fe68ad81b9a6776d3f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:33.158527 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e58fac539ec54fe68ad81b9a6776d3f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.163827 13928 leader_election.cc:290] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:33.163920 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_57828eb9ca764faf923e3e68fd0233a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:33.165644 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57828eb9ca764faf923e3e68fd0233a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.170019 13640 raft_consensus.cc:359] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.170734 13640 raft_consensus.cc:385] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:33.170972 13640 raft_consensus.cc:740] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:33.172139 13949 consensus_queue.cc:1048] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:53:33.174829 12951 leader_election.cc:343] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:33.175591 12951 leader_election.cc:304] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:33.181360 13382 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:33.182343 13962 raft_consensus.cc:2749] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:33.182745 13928 raft_consensus.cc:2804] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:33.183312 13928 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:33.183861 13928 raft_consensus.cc:3060] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:33.191390 13238 tablet_service.cc:1511] Processing CreateTablet for tablet f7afa380245248f5bac203b0905721c6 (DEFAULT_TABLE table=default.Table_cf87937d4ae348878fccadff2eca2c6b [id=7db25ca91e1a4ed1b9645002bee461ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.192680 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7afa380245248f5bac203b0905721c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.199581 13014 tablet_service.cc:1511] Processing CreateTablet for tablet f7afa380245248f5bac203b0905721c6 (DEFAULT_TABLE table=default.Table_cf87937d4ae348878fccadff2eca2c6b [id=7db25ca91e1a4ed1b9645002bee461ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.202481 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 1c2ad1e3a90f47ac83ca262cad9964f0
I20260810 13:53:33.204111 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f6f7ede8521e49639551011fad2d4e87" } new_table_name: "default.Table_603963be19d14370b9a5093b52e009f7" modify_external_catalogs: true
I20260810 13:53:33.205732 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:33.208513 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c2ad1e3a90f47ac83ca262cad9964f0 already in progress: creating tablet
I20260810 13:53:33.209024 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7afa380245248f5bac203b0905721c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.214447 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6076d5112f5c4c6096f5bb41abee7ff1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:33.216377 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6076d5112f5c4c6096f5bb41abee7ff1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:33.216791 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_f3ec47fb314845439746815e3f401bc7 [id=41ab72dabf7e4cbaaa1c8010766780c4], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 73ad47d29d61456891478a9544594a94 consensus state has no leader
I20260810 13:53:33.218722 13928 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.222926 13928 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:33.183491 13382 leader_election.cc:304] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:33.231979 13640 consensus_queue.cc:260] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.234829 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_cb09b1a8472e4349bbbac0669af3d045"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:33.237775 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cb09b1a8472e4349bbbac0669af3d045 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.245772 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 1 got 0
W20260810 13:53:33.252964 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 69599.4us
I20260810 13:53:33.254238 13928 raft_consensus.cc:2804] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:33.254838 13928 raft_consensus.cc:697] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:33.255389 13640 ts_tablet_manager.cc:1434] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.136s user 0.000s sys 0.007s
I20260810 13:53:33.255856 13928 consensus_queue.cc:237] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.264040 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 (DEFAULT_TABLE table=default.Table_81b4a7eba14c4cc4835272fbaf08f02a [id=0f2a8fd26a9043059d6b3d36c0ad03d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.265076 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d04860a72c64a5db966e2784c6dbbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.268532 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 73ad47d29d61456891478a9544594a94 (DEFAULT_TABLE table=default.Table_f3ec47fb314845439746815e3f401bc7 [id=41ab72dabf7e4cbaaa1c8010766780c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.269634 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ad47d29d61456891478a9544594a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.271564 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:33.272202 13265 raft_consensus.cc:3060] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:33.247081 12743 catalog_manager.cc:5719] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:33.281033 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c]). Expected version 2 got 0
I20260810 13:53:33.285267 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e9033f340a474a419492b9db68676dbe" } new_table_name: "default.Table_b06142d593144274beace392faa4ec79" modify_external_catalogs: true
I20260810 13:53:33.293581 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:33.296069 13638 tablet_bootstrap.cc:492] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:33.296556 13638 ts_tablet_manager.cc:1403] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.280s user 0.041s sys 0.030s
I20260810 13:53:33.298133 14006 tablet.cc:1724] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:33.300956 13640 tablet_bootstrap.cc:492] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:33.302991 13638 raft_consensus.cc:359] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.303876 13638 raft_consensus.cc:385] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:33.308882 13638 raft_consensus.cc:740] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:33.317621 12728 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 -> Peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Couldn't send request to peer 2928f7d4503145b182d99007d240334d. Status: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260810 13:53:33.321426 14018 tablet.cc:1724] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:33.311867 13638 consensus_queue.cc:260] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.327649 13638 ts_tablet_manager.cc:1434] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.031s user 0.004s sys 0.002s
I20260810 13:53:33.329954 13639 tablet_bootstrap.cc:492] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:33.330439 13639 ts_tablet_manager.cc:1403] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.312s user 0.010s sys 0.014s
I20260810 13:53:33.333580 13975 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:50548 (request call id 78) took 1096 ms. Trace:
I20260810 13:53:33.333935 13975 rpcz_store.cc:276] 0810 13:53:32.237270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:32.237437 (+ 167us) service_pool.cc:224] Handling call
0810 13:53:33.333499 (+1096062us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:32.301199 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:32.301697 (+ 498us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:32.301741 (+ 44us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:32.301813 (+ 72us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:32.301970 (+ 157us) alter_schema_op.cc:128] START. Timestamp: 1786370012287218
0810 13:53:32.302013 (+ 43us) op_driver.cc:348] REPLICATION: starting
0810 13:53:32.302609 (+ 596us) log.cc:844] Serialized 173 byte log entry
0810 13:53:32.682442 (+379833us) op_driver.cc:464] REPLICATION: finished
0810 13:53:33.005954 (+323512us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:53:33.007979 (+ 2025us) log.cc:844] Serialized 5 byte log entry
0810 13:53:33.318168 (+310189us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:33.326254 (+ 8086us) log.cc:844] Serialized 14 byte log entry
0810 13:53:33.333349 (+ 7095us) alter_schema_op.cc:73] Released schema lock
0810 13:53:33.333379 (+ 30us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":323299,"prepare.queue_time_us":62316,"prepare.run_cpu_time_us":47682,"prepare.run_wall_time_us":410018,"raft.queue_time_us":16058,"raft.run_cpu_time_us":535,"raft.run_wall_time_us":535,"replication_time_us":380256,"thread_start_us":771123,"threads_started":3}]]}
I20260810 13:53:33.339608 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 35c43f7f8b7e4e56b5edbabe242c9dde
I20260810 13:53:33.341261 13638 tablet_bootstrap.cc:492] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:33.343431 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:33.344074 13056 raft_consensus.cc:3060] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:33.341626 13265 raft_consensus.cc:2468] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:33.351665 13056 raft_consensus.cc:2468] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:33.353030 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9081f957f5824ed29603b1d84eff6906" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:33.359721 13010 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:33.371536 13975 tablet.cc:1724] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:33.382786 13638 tablet_bootstrap.cc:654] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:33.387368 13239 tablet_service.cc:1511] Processing CreateTablet for tablet f62023d553cd46cab920de44baa96eec (DEFAULT_TABLE table=default.Table_65f3e467e91b454799305f55c1a236ef [id=e8338009e3ca44ae81d7b7b7d533713f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.388475 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62023d553cd46cab920de44baa96eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.397922 13435 tablet_service.cc:1511] Processing CreateTablet for tablet f7afa380245248f5bac203b0905721c6 (DEFAULT_TABLE table=default.Table_cf87937d4ae348878fccadff2eca2c6b [id=7db25ca91e1a4ed1b9645002bee461ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.399062 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7afa380245248f5bac203b0905721c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.404282 13977 raft_consensus.cc:493] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:33.405145 13977 raft_consensus.cc:515] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.411294 13977 leader_election.cc:290] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:33.417645 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:33.419945 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 (DEFAULT_TABLE table=default.Table_81b4a7eba14c4cc4835272fbaf08f02a [id=0f2a8fd26a9043059d6b3d36c0ad03d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.420334 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 73ad47d29d61456891478a9544594a94 (DEFAULT_TABLE table=default.Table_f3ec47fb314845439746815e3f401bc7 [id=41ab72dabf7e4cbaaa1c8010766780c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.421845 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d04860a72c64a5db966e2784c6dbbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.422914 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ad47d29d61456891478a9544594a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.440917 13640 tablet_bootstrap.cc:654] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:33.443003 13010 tablet_service.cc:1511] Processing CreateTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 (DEFAULT_TABLE table=default.Table_81b4a7eba14c4cc4835272fbaf08f02a [id=0f2a8fd26a9043059d6b3d36c0ad03d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.445185 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d04860a72c64a5db966e2784c6dbbf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.455364 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2de7aaadcc9042a1a7142a894e0c8493" } modify_external_catalogs: true
I20260810 13:53:33.455963 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2de7aaadcc9042a1a7142a894e0c8493" } modify_external_catalogs: true
I20260810 13:53:33.456418 13639 raft_consensus.cc:359] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.457176 13639 raft_consensus.cc:385] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:33.457507 13639 raft_consensus.cc:740] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:33.458353 13639 consensus_queue.cc:260] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.478044 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 73ad47d29d61456891478a9544594a94 (DEFAULT_TABLE table=default.Table_f3ec47fb314845439746815e3f401bc7 [id=41ab72dabf7e4cbaaa1c8010766780c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.479027 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ad47d29d61456891478a9544594a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.479815 13639 ts_tablet_manager.cc:1434] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.149s user 0.007s sys 0.000s
I20260810 13:53:33.483852 13006 tablet_service.cc:1511] Processing CreateTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde (DEFAULT_TABLE table=default.Table_c75d32693a7f4df68c1f2c97bfaf15f5 [id=6fef18912c5c43519e5759644317fc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.485492 13006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c43f7f8b7e4e56b5edbabe242c9dde. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:33.487295 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4dea61b84b614ead8830873568f9b7c4 consensus state has no leader
W20260810 13:53:33.491001 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c2ad1e3a90f47ac83ca262cad9964f0 already in progress: creating tablet
I20260810 13:53:33.492164 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:33.493614 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:33.474057 13442 tablet_service.cc:1511] Processing CreateTablet for tablet f62023d553cd46cab920de44baa96eec (DEFAULT_TABLE table=default.Table_65f3e467e91b454799305f55c1a236ef [id=e8338009e3ca44ae81d7b7b7d533713f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.474745 13429 tablet_service.cc:1511] Processing CreateTablet for tablet a83ddc3ea3e74b569385b289fe8cf469 (DEFAULT_TABLE table=default.Table_cdafdcdf220049a7b14481d153792789 [id=c084fab842804eaa9fdb0bd1d42e518a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.495729 13639 tablet_bootstrap.cc:492] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:33.475196 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde (DEFAULT_TABLE table=default.Table_c75d32693a7f4df68c1f2c97bfaf15f5 [id=6fef18912c5c43519e5759644317fc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.498435 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62023d553cd46cab920de44baa96eec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:33.503090 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d2f8801796064c39ba1c81c64d622d68 consensus state has no leader
I20260810 13:53:33.505926 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83ddc3ea3e74b569385b289fe8cf469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.508320 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c43f7f8b7e4e56b5edbabe242c9dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.514216 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde (DEFAULT_TABLE table=default.Table_c75d32693a7f4df68c1f2c97bfaf15f5 [id=6fef18912c5c43519e5759644317fc3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.515285 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35c43f7f8b7e4e56b5edbabe242c9dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.517752 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet e4afea2da7c54e508084be42dec35099
I20260810 13:53:33.475759 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:33.476379 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185031fc211149fe87003c0cf267030d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:33.477104 13382 leader_election.cc:343] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:33.521551 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 44471.8us
W20260810 13:53:33.523113 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 35c43f7f8b7e4e56b5edbabe242c9dde because the tablet was not found. No further retry: Not found: Tablet not found: 35c43f7f8b7e4e56b5edbabe242c9dde
I20260810 13:53:33.523720 13382 leader_election.cc:304] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:33.524886 13928 raft_consensus.cc:2804] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:33.525628 13928 raft_consensus.cc:697] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:33.527038 13928 consensus_queue.cc:237] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.529183 13977 raft_consensus.cc:493] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:33.529662 13977 raft_consensus.cc:515] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:33.531992 13382 leader_election.cc:343] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:33.532631 13977 leader_election.cc:290] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:33.534595 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet e4afea2da7c54e508084be42dec35099 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:33.534543 13239 tablet_service.cc:1511] Processing CreateTablet for tablet a83ddc3ea3e74b569385b289fe8cf469 (DEFAULT_TABLE table=default.Table_cdafdcdf220049a7b14481d153792789 [id=c084fab842804eaa9fdb0bd1d42e518a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.535750 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83ddc3ea3e74b569385b289fe8cf469. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.535842 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 8c80bc85fe25433ab2559ea0ada61978 (DEFAULT_TABLE table=default.Table_f7cdc66038804ad2b056118e3f6cf67e [id=8aaef23848b848bebe6d6d9069d961fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.538234 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c80bc85fe25433ab2559ea0ada61978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.538183 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:33.538988 13265 raft_consensus.cc:3060] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:33.540076 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_71038e51b4474c5e9e8643d25c35a001 [id=5b919872756647048ea2e4fecbe78537]). Expected version 1 got 0
I20260810 13:53:33.540793 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet e23454581a9a4b55b0756ef890dee7fb (table default.Table_08582b65868149cca4ac724f7d18a869 [id=590b98307a364781a383eb9a072bb4d7]). Expected version 2 got 0
I20260810 13:53:33.541342 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
W20260810 13:53:33.542579 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet e4afea2da7c54e508084be42dec35099 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4afea2da7c54e508084be42dec35099 already in progress: creating tablet
I20260810 13:53:33.543663 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet e4f7173588194000bb6ff0e9f72ced98 (table default.Table_22a4a114f5cf4de481c7520fc99963ba [id=5c116d56fd00422f80495064d32a7f4e]). Expected version 1 got 0
I20260810 13:53:33.544622 12750 catalog_manager.cc:5719] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:33.555817 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 803a6a0a86a343b4a23f37d8317d5d0d (table default.Table_be9fec10e00d4ea6bbedfbe8346507b1 [id=383c0c58e7b047589f6b496ba8f4ecb0]). Expected version 4 got 0
I20260810 13:53:33.563194 13977 raft_consensus.cc:493] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:33.563434 13986 ts_tablet_manager.cc:1929] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:33.563989 13986 log.cc:1199] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/dbc8028d03464b138c1f1e6f682f8b88
I20260810 13:53:33.563690 13977 raft_consensus.cc:515] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.566457 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:33.570932 13007 tablet_service.cc:1511] Processing CreateTablet for tablet f62023d553cd46cab920de44baa96eec (DEFAULT_TABLE table=default.Table_65f3e467e91b454799305f55c1a236ef [id=e8338009e3ca44ae81d7b7b7d533713f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.573421 13990 consensus_queue.cc:1048] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:53:33.577657 13164 leader_election.cc:343] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:33.578464 13004 tablet_service.cc:1511] Processing CreateTablet for tablet a83ddc3ea3e74b569385b289fe8cf469 (DEFAULT_TABLE table=default.Table_cdafdcdf220049a7b14481d153792789 [id=c084fab842804eaa9fdb0bd1d42e518a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.583112 13977 leader_election.cc:290] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:33.586140 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e09dfca6a32c405e9aedfa450e20e5e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:33.587608 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e09dfca6a32c405e9aedfa450e20e5e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.587765 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "185031fc211149fe87003c0cf267030d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:33.589352 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_65f3e467e91b454799305f55c1a236ef" } modify_external_catalogs: true
I20260810 13:53:33.589807 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_65f3e467e91b454799305f55c1a236ef" } modify_external_catalogs: true
I20260810 13:53:33.597126 13986 ts_tablet_manager.cc:1950] T dbc8028d03464b138c1f1e6f682f8b88 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:33.601769 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f62023d553cd46cab920de44baa96eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.606038 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a83ddc3ea3e74b569385b289fe8cf469. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:33.614805 13167 leader_election.cc:343] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:33.615336 13167 leader_election.cc:304] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:33.615656 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 8c80bc85fe25433ab2559ea0ada61978 (DEFAULT_TABLE table=default.Table_f7cdc66038804ad2b056118e3f6cf67e [id=8aaef23848b848bebe6d6d9069d961fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.616652 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c80bc85fe25433ab2559ea0ada61978. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:33.621917 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 35c43f7f8b7e4e56b5edbabe242c9dde because the tablet was not found. No further retry: Not found: Tablet not found: 35c43f7f8b7e4e56b5edbabe242c9dde
I20260810 13:53:33.624325 13962 raft_consensus.cc:493] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:33.624058 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5306ac6359cd4033b2c54ad5db69828c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:33.624908 13962 raft_consensus.cc:515] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.627868 13962 leader_election.cc:290] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:33.630036 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9081f957f5824ed29603b1d84eff6906" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:33.626907 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5306ac6359cd4033b2c54ad5db69828c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.631100 13269 raft_consensus.cc:2393] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:33.636751 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c (DEFAULT_TABLE table=default.Table_9656a7ccd188461fa55387c96150bb80 [id=1531ea1f96db44c8918e0d74570c0ffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.638015 13233 tablet_service.cc:1511] Processing CreateTablet for tablet c4db9d7e82414cab8a69618effe89b40 (DEFAULT_TABLE table=default.Table_a854e55f38e14aee8898f1cb29ba6b9b [id=7f6b178a7e0a44cdbc49adfea482738b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.640902 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet e4afea2da7c54e508084be42dec35099 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:33.645879 12743 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_08582b65868149cca4ac724f7d18a869 [id=590b98307a364781a383eb9a072bb4d7] alter complete (version 2)
I20260810 13:53:33.657613 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet 266e949bbf6d4a558d73e3cb2efec490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:33.658649 13989 tablet_replica.cc:333] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:33.658268 13000 tablet_service.cc:1511] Processing CreateTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c (DEFAULT_TABLE table=default.Table_9656a7ccd188461fa55387c96150bb80 [id=1531ea1f96db44c8918e0d74570c0ffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.659893 13989 raft_consensus.cc:2243] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:33.660844 13019 tablet_service.cc:1511] Processing CreateTablet for tablet c4db9d7e82414cab8a69618effe89b40 (DEFAULT_TABLE table=default.Table_a854e55f38e14aee8898f1cb29ba6b9b [id=7f6b178a7e0a44cdbc49adfea482738b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.660601 13989 raft_consensus.cc:2272] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:33.666091 13989 ts_tablet_manager.cc:1916] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:33.676486 13977 raft_consensus.cc:2749] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:33.638047 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ff9e8a8ca845b89154ed0626d34c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.680406 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 4dea61b84b614ead8830873568f9b7c4 (DEFAULT_TABLE table=default.Table_603963be19d14370b9a5093b52e009f7 [id=e4c6b90e139246beac835146660eb0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.687973 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4db9d7e82414cab8a69618effe89b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.692378 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e09dfca6a32c405e9aedfa450e20e5e3" } new_table_name: "default.Table_6ded227a454f419d937bfd5c1bfd240a" modify_external_catalogs: true
I20260810 13:53:33.695147 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dea61b84b614ead8830873568f9b7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.696062 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_df442195c83b420ea736308ced6e4594"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:33.699120 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df442195c83b420ea736308ced6e4594 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.708323 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e58fac539ec54fe68ad81b9a6776d3f7" } new_table_name: "default.Table_f00f2c0d91a148c99635b0f83eb66124" modify_external_catalogs: true
I20260810 13:53:33.717744 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet f62023d553cd46cab920de44baa96eec
I20260810 13:53:33.722282 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet f62023d553cd46cab920de44baa96eec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:33.725672 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_636572e9c1c24956bc53550f45390b1d" } modify_external_catalogs: true
I20260810 13:53:33.726214 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_636572e9c1c24956bc53550f45390b1d" } modify_external_catalogs: true
I20260810 13:53:33.739797 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 4dea61b84b614ead8830873568f9b7c4 (DEFAULT_TABLE table=default.Table_603963be19d14370b9a5093b52e009f7 [id=e4c6b90e139246beac835146660eb0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:33.742689 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet dbc8028d03464b138c1f1e6f682f8b88 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:27 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:33.743347 13009 tablet_service.cc:1558] Processing DeleteTablet for tablet f62023d553cd46cab920de44baa96eec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:33.743817 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266e949bbf6d4a558d73e3cb2efec490" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:33.743966 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cdab6f2407d4545bf6bbd81917b3434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:33.745069 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4db9d7e82414cab8a69618effe89b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.748667 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_da227c8b756041528b3a4dd7196645fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:33.750150 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da227c8b756041528b3a4dd7196645fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.751760 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea93840561c4cb3b90d46e4aa70f542" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:33.764555 14006 tablet.cc:1724] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 13:53:33.770496 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4946f79b54c46b1a59edf169109ab47 has no consensus state
I20260810 13:53:33.771697 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dea61b84b614ead8830873568f9b7c4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:33.772670 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0b88e6d9f77487f8ed2cfafd702a753 has no consensus state
I20260810 13:53:33.781958 13981 tablet_replica.cc:333] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:33.783813 13981 raft_consensus.cc:2243] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:33.788921 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet c5f2e89d61854ee5bf6955b8244215eb
I20260810 13:53:33.796732 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet c5f2e89d61854ee5bf6955b8244215eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:33.852183 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b9b29cb7b48e4a3e8d6623beb6b492a7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:33.855638 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9b29cb7b48e4a3e8d6623beb6b492a7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.896243 13928 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:33.897086 13928 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.922977 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_be9fec10e00d4ea6bbedfbe8346507b1" } modify_external_catalogs: true
I20260810 13:53:33.923672 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_be9fec10e00d4ea6bbedfbe8346507b1" } modify_external_catalogs: true
I20260810 13:53:33.935039 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 86) took 1082 ms. Trace:
I20260810 13:53:33.939236 13928 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:33.935446 13986 rpcz_store.cc:276] 0810 13:53:32.852216 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:32.854835 (+ 2619us) service_pool.cc:224] Handling call
0810 13:53:33.071305 (+216470us) ts_tablet_manager.cc:1151] Deleting tablet dbc8028d03464b138c1f1e6f682f8b88
0810 13:53:33.071363 (+ 58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:33.337069 (+265706us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:33.556673 (+219604us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:33.934965 (+378292us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":215845}
W20260810 13:53:33.951442 13167 leader_election.cc:343] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:33.957267 13265 raft_consensus.cc:2468] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:33.785130 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ff9e8a8ca845b89154ed0626d34c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:33.814851 13639 tablet_bootstrap.cc:654] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:33.762889 13975 tablet.cc:1724] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:33.977113 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_99416f24ad8b403a93f75579664ab8a3" } new_table_name: "default.Table_a5bba9c1c58c4b0b8c401ecdd6533d78" modify_external_catalogs: true
I20260810 13:53:33.982833 13640 tablet_bootstrap.cc:492] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:33.983379 13640 ts_tablet_manager.cc:1403] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.683s user 0.031s sys 0.030s
I20260810 13:53:33.983202 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f00f2c0d91a148c99635b0f83eb66124" } new_table_name: "default.Table_2c503da47ba34831aa28e953821d301d" modify_external_catalogs: true
I20260810 13:53:33.983331 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c335d24b7ec048c49b6746c821e813a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:33.985056 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c335d24b7ec048c49b6746c821e813a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.987152 13640 raft_consensus.cc:359] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.987883 13640 raft_consensus.cc:385] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:33.988183 13640 raft_consensus.cc:740] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:33.988799 13640 consensus_queue.cc:260] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:33.990269 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_347db13a1f7b4332b673b26332048bd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:33.991089 13640 ts_tablet_manager.cc:1434] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
W20260810 13:53:33.991824 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_347db13a1f7b4332b673b26332048bd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:33.992554 13640 tablet_bootstrap.cc:492] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:33.994465 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5b387b0607e24b559bfb3fbfdc9dc431" } modify_external_catalogs: true
I20260810 13:53:33.994990 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5b387b0607e24b559bfb3fbfdc9dc431" } modify_external_catalogs: true
W20260810 13:53:33.996871 13638 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.581s user 0.006s sys 0.011s
W20260810 13:53:33.997161 13638 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.582s user 0.006s sys 0.011s
I20260810 13:53:33.998574 13640 tablet_bootstrap.cc:654] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:33.999079 13638 tablet_bootstrap.cc:492] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:33.999514 13638 ts_tablet_manager.cc:1403] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.658s user 0.016s sys 0.011s
I20260810 13:53:34.022934 13640 tablet_bootstrap.cc:492] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:34.023521 13640 ts_tablet_manager.cc:1403] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.031s user 0.010s sys 0.002s
I20260810 13:53:34.027396 13640 raft_consensus.cc:359] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.028017 13640 raft_consensus.cc:385] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:34.028316 13640 raft_consensus.cc:740] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:34.035741 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 803a6a0a86a343b4a23f37d8317d5d0d
I20260810 13:53:34.033715 13640 consensus_queue.cc:260] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.050308 13640 ts_tablet_manager.cc:1434] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.026s user 0.005s sys 0.005s
I20260810 13:53:34.051431 13640 tablet_bootstrap.cc:492] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:34.059068 13640 tablet_bootstrap.cc:654] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:34.059506 13167 leader_election.cc:343] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:34.070636 13989 ts_tablet_manager.cc:1929] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:34.072144 13989 log.cc:1199] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/266e949bbf6d4a558d73e3cb2efec490
W20260810 13:53:34.075227 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4946f79b54c46b1a59edf169109ab47 has no consensus state
W20260810 13:53:34.079035 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22d96232e31f46e791d739643ffb9257 consensus state has no leader
I20260810 13:53:34.094506 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4800a8b17797422cbd7f353288dc4fad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:34.106230 13989 ts_tablet_manager.cc:1950] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:34.127272 13981 raft_consensus.cc:2272] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:34.129397 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 104314us
W20260810 13:53:34.131613 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4800a8b17797422cbd7f353288dc4fad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:34.030784 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet e4afea2da7c54e508084be42dec35099 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4afea2da7c54e508084be42dec35099 already in progress: creating tablet
W20260810 13:53:34.135376 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 104628us
I20260810 13:53:34.137396 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 266e949bbf6d4a558d73e3cb2efec490 (table default.Table_f688a5d2568d4835bc32eb6cc9533ef9 [id=539325ee3b9c41609568f2e02f54dc02]) successfully deleted
W20260810 13:53:34.138121 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet f62023d553cd46cab920de44baa96eec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f62023d553cd46cab920de44baa96eec already in progress: creating tablet
I20260810 13:53:34.140204 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d310fa96aa3e455590195ac9bf3b4825"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:34.142535 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet c5f2e89d61854ee5bf6955b8244215eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5f2e89d61854ee5bf6955b8244215eb already in progress: creating tablet
I20260810 13:53:34.143930 13981 ts_tablet_manager.cc:1916] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:34.150573 13639 tablet_bootstrap.cc:492] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:34.150995 13639 ts_tablet_manager.cc:1403] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.671s user 0.008s sys 0.008s
I20260810 13:53:34.158190 13014 tablet_service.cc:1558] Processing DeleteTablet for tablet c5f2e89d61854ee5bf6955b8244215eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:34.167251 13638 raft_consensus.cc:359] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.167934 13638 raft_consensus.cc:385] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:34.168201 13638 raft_consensus.cc:740] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:34.169639 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 803a6a0a86a343b4a23f37d8317d5d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:34.170235 13638 consensus_queue.cc:260] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.175348 13949 consensus_queue.cc:1048] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:34.185920 13638 ts_tablet_manager.cc:1434] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.186s user 0.007s sys 0.002s
I20260810 13:53:34.186484 13639 raft_consensus.cc:359] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.187136 13639 raft_consensus.cc:385] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:34.187391 13639 raft_consensus.cc:740] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:34.188001 13639 consensus_queue.cc:260] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.198771 13003 tablet_service.cc:1558] Processing DeleteTablet for tablet 803a6a0a86a343b4a23f37d8317d5d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:34.204149 13638 tablet_bootstrap.cc:492] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:34.209721 13639 ts_tablet_manager.cc:1434] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.058s user 0.008s sys 0.000s
I20260810 13:53:34.212328 13949 raft_consensus.cc:493] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:34.212853 13949 raft_consensus.cc:515] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.214712 13949 leader_election.cc:290] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:34.216298 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea93840561c4cb3b90d46e4aa70f542" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:34.216940 13269 raft_consensus.cc:2468] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:34.218547 13638 tablet_bootstrap.cc:654] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:34.218446 12952 leader_election.cc:304] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:53:34.218675 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d310fa96aa3e455590195ac9bf3b4825 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:34.219434 13949 raft_consensus.cc:2804] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:34.219774 13949 raft_consensus.cc:493] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:34.220072 13949 raft_consensus.cc:3060] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:34.226790 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f4946f79b54c46b1a59edf169109ab47 (table default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f4946f79b54c46b1a59edf169109ab47 has no consensus state
I20260810 13:53:34.241349 13989 tablet_replica.cc:333] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:34.242238 13989 raft_consensus.cc:2243] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:34.242789 13989 pending_rounds.cc:70] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:34.247745 13989 pending_rounds.cc:77] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971573141331968 op_type: NO_OP noop_request { }
I20260810 13:53:34.248200 13989 raft_consensus.cc:2889] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:34.248633 13989 raft_consensus.cc:2272] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:34.262723 13989 ts_tablet_manager.cc:1916] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:34.282054 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a5bba9c1c58c4b0b8c401ecdd6533d78" } new_table_name: "default.Table_7cb516aef022435db65d62c3231eba12" modify_external_catalogs: true
I20260810 13:53:34.285403 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8dc89b56ec51450ab5cde9cd49f3c526"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:34.286931 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8dc89b56ec51450ab5cde9cd49f3c526 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:34.290438 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_72e009ae681c4849997fb6e4d2295654" } new_table_name: "default.Table_3687705a4de844f59a3c7e3af511980e" modify_external_catalogs: true
I20260810 13:53:34.293129 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_45d852d5a1024cf4ad4560802702a072"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:34.294360 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]). Expected version 1 got 0
W20260810 13:53:34.294546 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45d852d5a1024cf4ad4560802702a072 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:34.294909 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 185031fc211149fe87003c0cf267030d (table default.Table_5b387b0607e24b559bfb3fbfdc9dc431 [id=52650fc2dbe548c2be71514fb532b2f4]). Expected version 1 got 0
I20260810 13:53:34.304744 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]). Expected version 1 got 0
I20260810 13:53:34.306592 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet 803a6a0a86a343b4a23f37d8317d5d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:34.308158 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c (DEFAULT_TABLE table=default.Table_9656a7ccd188461fa55387c96150bb80 [id=1531ea1f96db44c8918e0d74570c0ffd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.308902 13432 tablet_service.cc:1511] Processing CreateTablet for tablet 4dea61b84b614ead8830873568f9b7c4 (DEFAULT_TABLE table=default.Table_603963be19d14370b9a5093b52e009f7 [id=e4c6b90e139246beac835146660eb0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.310089 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07ff9e8a8ca845b89154ed0626d34c5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.310972 13436 tablet_service.cc:1558] Processing DeleteTablet for tablet c5f2e89d61854ee5bf6955b8244215eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:34.312000 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet e4afea2da7c54e508084be42dec35099 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:34.313246 13442 tablet_service.cc:1511] Processing CreateTablet for tablet c4db9d7e82414cab8a69618effe89b40 (DEFAULT_TABLE table=default.Table_a854e55f38e14aee8898f1cb29ba6b9b [id=7f6b178a7e0a44cdbc49adfea482738b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.313802 13639 tablet_bootstrap.cc:492] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:34.313711 13435 tablet_service.cc:1511] Processing CreateTablet for tablet 8c80bc85fe25433ab2559ea0ada61978 (DEFAULT_TABLE table=default.Table_f7cdc66038804ad2b056118e3f6cf67e [id=8aaef23848b848bebe6d6d9069d961fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.314410 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4db9d7e82414cab8a69618effe89b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.316457 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c80bc85fe25433ab2559ea0ada61978. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.317095 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet f62023d553cd46cab920de44baa96eec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:34.321585 13638 tablet_bootstrap.cc:492] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:34.322019 13638 ts_tablet_manager.cc:1403] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.132s user 0.004s sys 0.006s
W20260810 13:53:34.326371 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 22d96232e31f46e791d739643ffb9257 consensus state has no leader
I20260810 13:53:34.329803 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea93840561c4cb3b90d46e4aa70f542" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:34.338650 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266e949bbf6d4a558d73e3cb2efec490" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:34.339406 13475 raft_consensus.cc:2468] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:34.340934 13640 tablet_bootstrap.cc:492] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:34.341523 13640 ts_tablet_manager.cc:1403] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.290s user 0.032s sys 0.025s
I20260810 13:53:34.346241 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet dbc8028d03464b138c1f1e6f682f8b88 (table default.Table_5920060ddbce482392401dc8c24f703f [id=307895865f6346a192129d3b938f3f4e]) successfully deleted
W20260810 13:53:34.348302 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4b0ffad7efc24519957f2fb3be945b7d consensus state has no leader
I20260810 13:53:34.351468 13000 tablet_service.cc:1511] Processing CreateTablet for tablet b0b88e6d9f77487f8ed2cfafd702a753 (DEFAULT_TABLE table=default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.352598 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b88e6d9f77487f8ed2cfafd702a753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.352999 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dea61b84b614ead8830873568f9b7c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.353950 13986 tablet_replica.cc:333] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:34.355168 13986 raft_consensus.cc:2243] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:34.355713 13986 raft_consensus.cc:2272] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:34.356794 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_af3b17037c8442559ad5c099a9370b2d" } modify_external_catalogs: true
I20260810 13:53:34.357307 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_af3b17037c8442559ad5c099a9370b2d" } modify_external_catalogs: true
I20260810 13:53:34.361876 13986 ts_tablet_manager.cc:1916] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:34.362059 12739 catalog_manager.cc:5719] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:34.363335 13640 raft_consensus.cc:359] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.364101 13640 raft_consensus.cc:385] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:34.364413 13640 raft_consensus.cc:740] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:34.365509 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:34.365561 13640 consensus_queue.cc:260] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.364231 13003 tablet_service.cc:1511] Processing CreateTablet for tablet b54b73458a4c4201bc3b44259bc12436 (DEFAULT_TABLE table=default.Table_6076d5112f5c4c6096f5bb41abee7ff1 [id=a16e491cb9894186863d4e55b6e41d7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.367909 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54b73458a4c4201bc3b44259bc12436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.371779 13640 ts_tablet_manager.cc:1434] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.030s user 0.005s sys 0.002s
I20260810 13:53:34.372906 13640 tablet_bootstrap.cc:492] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:34.369704 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_56bad358a07547909304ec6d4ca91118"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:34.377447 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56bad358a07547909304ec6d4ca91118 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:34.377965 13050 raft_consensus.cc:3060] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:34.379642 13382 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:34.381716 12739 catalog_manager.cc:5719] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:34.383296 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_71038e51b4474c5e9e8643d25c35a001 [id=5b919872756647048ea2e4fecbe78537]). Expected version 1 got 0
I20260810 13:53:34.390965 13928 raft_consensus.cc:2804] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 13:53:34.391211 12952 consensus_peers.cc:597] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:34.391435 13928 raft_consensus.cc:697] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
W20260810 13:53:34.392107 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 66574.2us
I20260810 13:53:34.392246 13928 consensus_queue.cc:237] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.405278 13638 raft_consensus.cc:359] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.406013 13638 raft_consensus.cc:385] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:34.406351 13638 raft_consensus.cc:740] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:34.407351 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:34.408022 13264 raft_consensus.cc:2468] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:34.408170 13233 tablet_service.cc:1511] Processing CreateTablet for tablet b0b88e6d9f77487f8ed2cfafd702a753 (DEFAULT_TABLE table=default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.409204 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b88e6d9f77487f8ed2cfafd702a753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.409257 13638 consensus_queue.cc:260] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.411376 13949 raft_consensus.cc:515] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.411931 13638 ts_tablet_manager.cc:1434] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.090s user 0.006s sys 0.001s
I20260810 13:53:34.412879 13638 tablet_bootstrap.cc:492] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:53:34.413424 13164 leader_election.cc:343] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:34.413842 13164 leader_election.cc:304] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:34.414920 13164 leader_election.cc:304] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:34.415493 13164 raft_consensus.cc:2686] T 266e949bbf6d4a558d73e3cb2efec490 P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:34.418941 13949 leader_election.cc:290] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:34.422482 13640 tablet_bootstrap.cc:654] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:34.424927 13977 raft_consensus.cc:2749] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:34.383908 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]). Expected version 1 got 0
I20260810 13:53:34.429275 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 185031fc211149fe87003c0cf267030d
I20260810 13:53:34.429852 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea93840561c4cb3b90d46e4aa70f542" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:34.430353 13264 raft_consensus.cc:3060] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:34.440876 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 185031fc211149fe87003c0cf267030d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:34.441489 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 62060.9us
I20260810 13:53:34.445019 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 185031fc211149fe87003c0cf267030d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:34.455334 13264 raft_consensus.cc:2468] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:34.462199 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5a8f2e65e00343b594afce9f25120ab4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:34.463716 12952 leader_election.cc:304] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:53:34.463912 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a8f2e65e00343b594afce9f25120ab4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:34.464210 13638 tablet_bootstrap.cc:654] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:34.472110 13239 tablet_service.cc:1511] Processing CreateTablet for tablet b54b73458a4c4201bc3b44259bc12436 (DEFAULT_TABLE table=default.Table_6076d5112f5c4c6096f5bb41abee7ff1 [id=a16e491cb9894186863d4e55b6e41d7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.473516 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54b73458a4c4201bc3b44259bc12436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.473613 13989 ts_tablet_manager.cc:1929] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:34.474015 13989 log.cc:1199] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/803a6a0a86a343b4a23f37d8317d5d0d
I20260810 13:53:34.474793 13989 ts_tablet_manager.cc:1950] T 803a6a0a86a343b4a23f37d8317d5d0d P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:34.483877 13949 raft_consensus.cc:2804] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:34.482558 13928 raft_consensus.cc:493] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:34.495086 13928 raft_consensus.cc:515] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.487115 13949 raft_consensus.cc:697] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:34.498874 13949 consensus_queue.cc:237] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.504526 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9081f957f5824ed29603b1d84eff6906" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:34.504633 14044 raft_consensus.cc:493] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:34.510013 14044 raft_consensus.cc:515] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.526064 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet a47b0b44837544e48e6d63b491180480
I20260810 13:53:34.529431 13006 tablet_service.cc:1558] Processing DeleteTablet for tablet a47b0b44837544e48e6d63b491180480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:34.533468 13639 tablet_bootstrap.cc:700] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3: Time spent opening tablet: real 0.125s user 0.000s sys 0.000s
I20260810 13:53:34.534341 13639 tablet_bootstrap.cc:654] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:34.534204 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_af9731918cc3424cae557be94f842007" } new_table_name: "default.Table_dc36c90216d846139fda4196de0bf1bc" modify_external_catalogs: true
I20260810 13:53:34.543509 13006 tablet_service.cc:1511] Processing CreateTablet for tablet f4946f79b54c46b1a59edf169109ab47 (DEFAULT_TABLE table=default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.544780 13006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4946f79b54c46b1a59edf169109ab47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.557587 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6d8842e5440b4cf38eaec7b4479d36d6" } new_table_name: "default.Table_cca21ae655de4f49a5b7db97db5814ac" modify_external_catalogs: true
I20260810 13:53:34.561172 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea93840561c4cb3b90d46e4aa70f542" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:34.561919 13476 raft_consensus.cc:2468] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:34.566339 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
I20260810 13:53:34.569096 13928 leader_election.cc:290] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:34.571211 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea93840561c4cb3b90d46e4aa70f542" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:34.571972 13476 raft_consensus.cc:3060] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:34.584196 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet a47b0b44837544e48e6d63b491180480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:34.585927 13989 tablet_replica.cc:333] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:34.586915 13989 raft_consensus.cc:2243] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:34.601711 13981 ts_tablet_manager.cc:1929] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:34.602190 13981 log.cc:1199] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/dbc8028d03464b138c1f1e6f682f8b88
I20260810 13:53:34.603008 14044 leader_election.cc:290] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:34.604367 13476 raft_consensus.cc:2468] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
W20260810 13:53:34.597082 13382 leader_election.cc:343] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:34.606349 14044 consensus_queue.cc:1048] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:53:34.608217 13382 leader_election.cc:343] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:34.619320 13986 ts_tablet_manager.cc:1929] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 13:53:34.619659 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a43def9358894b2aa001a7db56706589 consensus state has no leader
I20260810 13:53:34.619848 13006 tablet_service.cc:1511] Processing CreateTablet for tablet ac2c102382734913bffb5436e06fe0a1 (DEFAULT_TABLE table=default.Table_d48dc5ee2e94468ab72aa4dc58b0ae01 [id=cb4b9877529f4cc38a48b2a61be4aa6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.620963 13006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2c102382734913bffb5436e06fe0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.622294 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 803a6a0a86a343b4a23f37d8317d5d0d (table default.Table_be9fec10e00d4ea6bbedfbe8346507b1 [id=383c0c58e7b047589f6b496ba8f4ecb0]) successfully deleted
I20260810 13:53:34.624732 12951 leader_election.cc:304] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:34.625782 12951 consensus_peers.cc:597] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:53:34.625988 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1c2ad1e3a90f47ac83ca262cad9964f0 already in progress: creating tablet
W20260810 13:53:34.626595 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 35c43f7f8b7e4e56b5edbabe242c9dde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35c43f7f8b7e4e56b5edbabe242c9dde already in progress: creating tablet
I20260810 13:53:34.627134 13879 raft_consensus.cc:2749] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:34.637518 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea93840561c4cb3b90d46e4aa70f542" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:34.638679 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8801796064c39ba1c81c64d622d68" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:34.643888 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1befb4abf1054ff0900cb2c6dfe3b126" } modify_external_catalogs: true
I20260810 13:53:34.644373 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1befb4abf1054ff0900cb2c6dfe3b126" } modify_external_catalogs: true
I20260810 13:53:34.624554 13977 raft_consensus.cc:493] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:34.646836 13977 raft_consensus.cc:515] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.653828 13639 tablet_bootstrap.cc:492] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:34.654203 13639 ts_tablet_manager.cc:1403] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.341s user 0.006s sys 0.005s
I20260810 13:53:34.653426 13989 raft_consensus.cc:2272] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:34.657202 13233 tablet_service.cc:1511] Processing CreateTablet for tablet ac2c102382734913bffb5436e06fe0a1 (DEFAULT_TABLE table=default.Table_d48dc5ee2e94468ab72aa4dc58b0ae01 [id=cb4b9877529f4cc38a48b2a61be4aa6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.657187 13639 raft_consensus.cc:359] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.657735 13989 ts_tablet_manager.cc:1916] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:34.657776 13639 raft_consensus.cc:385] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:34.658034 13639 raft_consensus.cc:740] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:34.658161 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2c102382734913bffb5436e06fe0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.660879 13000 tablet_service.cc:1511] Processing CreateTablet for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (DEFAULT_TABLE table=default.Table_060b551b964e40d1a67a29b0927f2ed5 [id=685e6bce7ba5467693e2b0e1c739897b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.661936 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bfa7b61a334886b0bc1583c7d7fee9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:34.663647 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 91e169a9bbc24a5196b1bdaf5bb06207 consensus state has no leader
I20260810 13:53:34.664899 12739 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_22a4a114f5cf4de481c7520fc99963ba [id=5c116d56fd00422f80495064d32a7f4e] alter complete (version 1)
I20260810 13:53:34.665068 13977 leader_election.cc:290] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:34.668853 13981 ts_tablet_manager.cc:1950] T dbc8028d03464b138c1f1e6f682f8b88 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:34.671602 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet dbc8028d03464b138c1f1e6f682f8b88 (table default.Table_5920060ddbce482392401dc8c24f703f [id=307895865f6346a192129d3b938f3f4e]) successfully deleted
I20260810 13:53:34.684358 13238 tablet_service.cc:1511] Processing CreateTablet for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (DEFAULT_TABLE table=default.Table_060b551b964e40d1a67a29b0927f2ed5 [id=685e6bce7ba5467693e2b0e1c739897b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.685436 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bfa7b61a334886b0bc1583c7d7fee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.685902 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea93840561c4cb3b90d46e4aa70f542" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:34.686581 13264 raft_consensus.cc:2393] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:53:34.687659 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8801796064c39ba1c81c64d622d68" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:34.688169 13264 raft_consensus.cc:2468] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:34.695071 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8801796064c39ba1c81c64d622d68" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:34.695384 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 5f1df2c9593442afa84849da6874f0f4 (DEFAULT_TABLE table=default.Table_57828eb9ca764faf923e3e68fd0233a8 [id=3fff8bc92af84e59a10a592e85ad8503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.696511 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f1df2c9593442afa84849da6874f0f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:34.699275 13167 leader_election.cc:343] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:34.700963 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c]). Expected version 2 got 0
I20260810 13:53:34.701727 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607]). Expected version 2 got 0
I20260810 13:53:34.702270 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]). Expected version 1 got 0
I20260810 13:53:34.703133 12742 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd] alter complete (version 1)
I20260810 13:53:34.712803 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet c549fde3bf9c44ccb18087a7bd64e435
I20260810 13:53:34.619827 14044 consensus_queue.cc:1048] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:34.622869 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet a47b0b44837544e48e6d63b491180480 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:34.715129 13638 tablet_bootstrap.cc:492] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:34.715586 13638 ts_tablet_manager.cc:1403] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.303s user 0.017s sys 0.017s
I20260810 13:53:34.718164 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet c549fde3bf9c44ccb18087a7bd64e435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:34.718241 13638 raft_consensus.cc:359] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.718858 13638 raft_consensus.cc:385] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:34.719098 13638 raft_consensus.cc:740] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:34.623145 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet 185031fc211149fe87003c0cf267030d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:34.719722 13638 consensus_queue.cc:260] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.625520 13432 tablet_service.cc:1511] Processing CreateTablet for tablet b54b73458a4c4201bc3b44259bc12436 (DEFAULT_TABLE table=default.Table_6076d5112f5c4c6096f5bb41abee7ff1 [id=a16e491cb9894186863d4e55b6e41d7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.722137 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b54b73458a4c4201bc3b44259bc12436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.626644 13448 tablet_service.cc:1511] Processing CreateTablet for tablet f4946f79b54c46b1a59edf169109ab47 (DEFAULT_TABLE table=default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.725353 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4946f79b54c46b1a59edf169109ab47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.725838 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
I20260810 13:53:34.726387 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]). Expected version 1 got 0
I20260810 13:53:34.726958 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]). Expected version 1 got 0
I20260810 13:53:34.727452 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_85163b830b37444787dfe92a72503b29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:34.727635 12742 catalog_manager.cc:5719] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:34.728734 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 1 got 0
W20260810 13:53:34.728917 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85163b830b37444787dfe92a72503b29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:34.726874 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ea28f1ec02f045c3bc16cbe36f484bb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:34.730686 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:34.734906 13638 ts_tablet_manager.cc:1434] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260810 13:53:34.738065 13638 tablet_bootstrap.cc:492] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:34.743597 13638 tablet_bootstrap.cc:654] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:34.635435 13640 tablet_bootstrap.cc:492] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:34.744174 13640 ts_tablet_manager.cc:1403] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.372s user 0.012s sys 0.011s
I20260810 13:53:34.745038 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_84a5a2b5e80343c194da3ea9661f2a81" } modify_external_catalogs: true
I20260810 13:53:34.745569 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_84a5a2b5e80343c194da3ea9661f2a81" } modify_external_catalogs: true
I20260810 13:53:34.747159 13640 raft_consensus.cc:359] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.747735 13640 raft_consensus.cc:385] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:34.747970 13640 raft_consensus.cc:740] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:34.744601 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_750e154b9a7a4141baa6de859c042732"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:34.750259 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_750e154b9a7a4141baa6de859c042732 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:34.752957 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet c549fde3bf9c44ccb18087a7bd64e435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:34.754192 13239 tablet_service.cc:1511] Processing CreateTablet for tablet f4946f79b54c46b1a59edf169109ab47 (DEFAULT_TABLE table=default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.755218 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4946f79b54c46b1a59edf169109ab47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.637980 13382 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:34.639242 13435 tablet_service.cc:1511] Processing CreateTablet for tablet b0b88e6d9f77487f8ed2cfafd702a753 (DEFAULT_TABLE table=default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.759773 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b88e6d9f77487f8ed2cfafd702a753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.764165 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 5f1df2c9593442afa84849da6874f0f4 (DEFAULT_TABLE table=default.Table_57828eb9ca764faf923e3e68fd0233a8 [id=3fff8bc92af84e59a10a592e85ad8503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.765167 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f1df2c9593442afa84849da6874f0f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.765280 13986 log.cc:1199] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/803a6a0a86a343b4a23f37d8317d5d0d
I20260810 13:53:34.766311 13986 ts_tablet_manager.cc:1950] T 803a6a0a86a343b4a23f37d8317d5d0d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:34.770779 13986 tablet_replica.cc:333] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:34.781453 14065 raft_consensus.cc:493] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:34.782008 14065 raft_consensus.cc:515] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.785290 14065 leader_election.cc:290] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:34.787650 13638 tablet_bootstrap.cc:492] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:34.788038 13638 ts_tablet_manager.cc:1403] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.052s user 0.004s sys 0.006s
I20260810 13:53:34.790288 13638 raft_consensus.cc:359] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.790875 13638 raft_consensus.cc:385] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:34.791126 13638 raft_consensus.cc:740] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:34.791929 13638 consensus_queue.cc:260] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.801111 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 2c6cfbfc47b2484396fcb517d791aae2
I20260810 13:53:34.803849 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6cfbfc47b2484396fcb517d791aae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:34.805312 13638 ts_tablet_manager.cc:1434] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260810 13:53:34.807125 13638 tablet_bootstrap.cc:492] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:34.818813 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 803a6a0a86a343b4a23f37d8317d5d0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:34.819722 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1cd8c50f3a554cddbf2a7ff23ac23748"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:34.820583 13639 consensus_queue.cc:260] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.824905 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6cfbfc47b2484396fcb517d791aae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:34.823845 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 (DEFAULT_TABLE table=default.Table_cb09b1a8472e4349bbbac0669af3d045 [id=5222178a76314f4da374fe8c2984369b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.829926 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:34.830476 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b84bd35b02f4a1faf15ac9bc21e6146. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:34.836097 13167 leader_election.cc:343] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:34.826108 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet f62023d553cd46cab920de44baa96eec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f62023d553cd46cab920de44baa96eec already in progress: creating tablet
I20260810 13:53:34.835960 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_26706f97443749789e2eb7686f5b5baa" } new_table_name: "default.Table_f607f9e067574d68809ebee30bc17d75" modify_external_catalogs: true
I20260810 13:53:34.791430 14048 raft_consensus.cc:2804] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:34.849251 14048 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:34.849819 14048 raft_consensus.cc:3060] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:34.853966 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]). Expected version 1 got 0
I20260810 13:53:34.844220 13981 tablet_replica.cc:333] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
W20260810 13:53:34.792004 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 154111us
W20260810 13:53:34.859138 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cd8c50f3a554cddbf2a7ff23ac23748 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:34.748524 13640 consensus_queue.cc:260] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.868319 13382 leader_election.cc:304] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:34.871541 14044 raft_consensus.cc:2804] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:34.872138 14044 raft_consensus.cc:493] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:34.872660 14044 raft_consensus.cc:3060] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:34.872777 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7dded9a7c2c4652b41131f0bc14a6b5 consensus state has no leader
I20260810 13:53:34.875934 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b9b29cb7b48e4a3e8d6623beb6b492a7" } new_table_name: "default.Table_68361e8cbef04d1595cb882c8b2e25eb" modify_external_catalogs: true
I20260810 13:53:34.869699 13640 ts_tablet_manager.cc:1434] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.125s user 0.005s sys 0.001s
I20260810 13:53:34.886593 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 (DEFAULT_TABLE table=default.Table_cb09b1a8472e4349bbbac0669af3d045 [id=5222178a76314f4da374fe8c2984369b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.887851 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b84bd35b02f4a1faf15ac9bc21e6146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.890383 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 803a6a0a86a343b4a23f37d8317d5d0d (table default.Table_be9fec10e00d4ea6bbedfbe8346507b1 [id=383c0c58e7b047589f6b496ba8f4ecb0]) successfully deleted
W20260810 13:53:34.891233 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet c5f2e89d61854ee5bf6955b8244215eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5f2e89d61854ee5bf6955b8244215eb already in progress: creating tablet
W20260810 13:53:34.892009 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet e4afea2da7c54e508084be42dec35099 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e4afea2da7c54e508084be42dec35099 already in progress: creating tablet
I20260810 13:53:34.896054 13981 raft_consensus.cc:2243] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:34.896967 13981 raft_consensus.cc:2272] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:34.900183 13981 ts_tablet_manager.cc:1916] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:34.902325 13004 tablet_service.cc:1511] Processing CreateTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 (DEFAULT_TABLE table=default.Table_1023c03a20e448b4abaa7920a9ae09d9 [id=e1f370bc63c248378875a3361c4e28e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.914318 13640 tablet_bootstrap.cc:492] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:53:34.892637 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet f62023d553cd46cab920de44baa96eec because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f62023d553cd46cab920de44baa96eec already in progress: creating tablet
I20260810 13:53:34.925778 13986 raft_consensus.cc:2243] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:34.938769 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8801796064c39ba1c81c64d622d68" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:34.949338 13986 raft_consensus.cc:2272] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:34.953114 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:34.957682 13448 tablet_service.cc:1511] Processing CreateTablet for tablet ac2c102382734913bffb5436e06fe0a1 (DEFAULT_TABLE table=default.Table_d48dc5ee2e94468ab72aa4dc58b0ae01 [id=cb4b9877529f4cc38a48b2a61be4aa6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:34.957942 13879 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:34.958245 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e9ba4f3b33c04d40b8eec3b0ff44485f" } modify_external_catalogs: true
I20260810 13:53:34.959004 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac2c102382734913bffb5436e06fe0a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:34.959028 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e9ba4f3b33c04d40b8eec3b0ff44485f" } modify_external_catalogs: true
I20260810 13:53:34.958571 13879 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.964071 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:34.965402 13269 raft_consensus.cc:2393] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:34.965173 13879 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:34.973553 13639 ts_tablet_manager.cc:1434] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.318s user 0.010s sys 0.001s
I20260810 13:53:34.982704 14065 raft_consensus.cc:493] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:34.983294 14065 raft_consensus.cc:515] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:34.986617 14065 leader_election.cc:290] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:34.992676 13639 tablet_bootstrap.cc:492] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:34.998080 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ada39233e9421d9870565c73f2ee16" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:35.000283 13167 leader_election.cc:343] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:35.028110 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c]). Expected version 2 got 0
W20260810 13:53:35.029484 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ee27d158bd40425a8c6fa8cb068daa79 has no consensus state
I20260810 13:53:35.031636 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063e3b74a9a248a1aa0c2de4b4b73a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.037865 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_11e70bf5f071476d8ba0b19c299040e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:35.039451 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11e70bf5f071476d8ba0b19c299040e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.037775 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_17e523ba6a3b40999d198d9649600be4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:35.041962 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_17e523ba6a3b40999d198d9649600be4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.047240 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 9566586ecdd24e94bad62906c2166afd
I20260810 13:53:35.050232 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet 9566586ecdd24e94bad62906c2166afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:35.050949 13006 tablet_service.cc:1558] Processing DeleteTablet for tablet 9566586ecdd24e94bad62906c2166afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:35.074712 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c]). Expected version 2 got 0
I20260810 13:53:35.075619 12744 catalog_manager.cc:5719] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:35.077124 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
I20260810 13:53:35.081971 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_19de196adf7f448b9beee85f7221ea70" } modify_external_catalogs: true
I20260810 13:53:35.082687 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_19de196adf7f448b9beee85f7221ea70" } modify_external_catalogs: true
I20260810 13:53:35.079077 13003 tablet_service.cc:1511] Processing CreateTablet for tablet a43def9358894b2aa001a7db56706589 (DEFAULT_TABLE table=default.Table_dc36c90216d846139fda4196de0bf1bc [id=fb2df53a2f9540d88c5c64b110471c2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.085772 13434 tablet_service.cc:1511] Processing CreateTablet for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (DEFAULT_TABLE table=default.Table_060b551b964e40d1a67a29b0927f2ed5 [id=685e6bce7ba5467693e2b0e1c739897b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.009785 14048 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.089942 14048 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:35.092298 13639 tablet_bootstrap.cc:654] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:35.105321 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43def9358894b2aa001a7db56706589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.115474 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 17df06cad1404d96bda5822be6a6e995 (DEFAULT_TABLE table=default.Table_0af09af6fb66466099e6c7b157ee196b [id=eb2b695cdb5c4ee78dc155df3cc8e21f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.116664 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17df06cad1404d96bda5822be6a6e995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.160224 13981 ts_tablet_manager.cc:1929] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:35.164333 13981 log.cc:1199] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/6cdab6f2407d4545bf6bbd81917b3434
I20260810 13:53:35.172313 13981 ts_tablet_manager.cc:1950] T 6cdab6f2407d4545bf6bbd81917b3434 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:35.160212 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e7fae8b89720488f8787d4413e238fa4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:35.187889 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7fae8b89720488f8787d4413e238fa4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.180400 13981 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 100) took 1437 ms. Trace:
I20260810 13:53:35.093541 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet c549fde3bf9c44ccb18087a7bd64e435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:35.096843 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet 266e949bbf6d4a558d73e3cb2efec490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:35.097909 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6cfbfc47b2484396fcb517d791aae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:35.099293 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 5f1df2c9593442afa84849da6874f0f4 (DEFAULT_TABLE table=default.Table_57828eb9ca764faf923e3e68fd0233a8 [id=3fff8bc92af84e59a10a592e85ad8503]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.096871 13436 tablet_service.cc:1511] Processing CreateTablet for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 (DEFAULT_TABLE table=default.Table_cb09b1a8472e4349bbbac0669af3d045 [id=5222178a76314f4da374fe8c2984369b]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:35.106070 14071 log.cc:927] Time spent T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.107s user 0.001s sys 0.000s
I20260810 13:53:35.112946 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0bfa7b61a334886b0bc1583c7d7fee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.198995 13981 rpcz_store.cc:276] 0810 13:53:33.743102 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:33.743849 (+ 747us) service_pool.cc:224] Handling call
0810 13:53:34.843458 (+1099609us) ts_tablet_manager.cc:1151] Deleting tablet 6cdab6f2407d4545bf6bbd81917b3434
0810 13:53:34.843724 (+ 266us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:35.082829 (+239105us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:35.159400 (+ 76571us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:35.180305 (+ 20905us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1098910}
I20260810 13:53:35.215029 13639 tablet_bootstrap.cc:492] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:35.215562 13639 ts_tablet_manager.cc:1403] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.223s user 0.021s sys 0.010s
I20260810 13:53:35.231050 13639 raft_consensus.cc:359] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.232045 13639 raft_consensus.cc:385] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:35.232383 13639 raft_consensus.cc:740] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:35.232877 13981 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 102) took 1107 ms. Trace:
I20260810 13:53:35.237681 13981 rpcz_store.cc:276] 0810 13:53:34.125834 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.158027 (+ 32193us) service_pool.cc:224] Handling call
0810 13:53:35.222485 (+1064458us) ts_tablet_manager.cc:1151] Deleting tablet c5f2e89d61854ee5bf6955b8244215eb
0810 13:53:35.223078 (+ 593us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:35.232736 (+ 9658us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1062975}
I20260810 13:53:35.241014 13981 tablet_replica.cc:333] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:35.247933 13981 raft_consensus.cc:2243] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:35.245015 13639 consensus_queue.cc:260] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.257841 13981 pending_rounds.cc:70] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:53:35.260262 13639 ts_tablet_manager.cc:1434] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.044s user 0.008s sys 0.003s
I20260810 13:53:35.259557 13981 pending_rounds.cc:77] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316971578067312640 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "803a6a0a86a343b4a23f37d8317d5d0d" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 4 new_table_name: "default.Table_be9fec10e00d4ea6bbedfbe8346507b1" dest_uuid: "88ed04d733ec447583fc897e233dd4b3" new_extra_config { } }
I20260810 13:53:35.270247 13639 tablet_bootstrap.cc:492] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:53:35.272881 13981 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50548: Aborted: Op aborted
I20260810 13:53:35.276458 13981 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:50548 (request call id 101) took 1150 ms. Trace:
I20260810 13:53:35.284147 13638 tablet_bootstrap.cc:654] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:35.278386 13981 rpcz_store.cc:276] 0810 13:53:34.125281 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.156866 (+ 31585us) service_pool.cc:224] Handling call
0810 13:53:35.275934 (+1119068us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:34.173118 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:34.175736 (+ 2618us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:34.175964 (+ 228us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:34.176213 (+ 249us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:34.177089 (+ 876us) alter_schema_op.cc:128] START. Timestamp: 1786370014176590
0810 13:53:34.177115 (+ 26us) op_driver.cc:348] REPLICATION: starting
0810 13:53:34.180799 (+ 3684us) log.cc:844] Serialized 173 byte log entry
0810 13:53:35.271744 (+1090945us) op_driver.cc:464] REPLICATION: finished
0810 13:53:35.272055 (+ 311us) op_driver.cc:389] HandleFailure(Aborted: Op aborted)
0810 13:53:35.272506 (+ 451us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":10828,"prepare.run_cpu_time_us":2107,"prepare.run_wall_time_us":9836,"replication_time_us":1093567,"thread_start_us":8172,"threads_started":1}]]}
I20260810 13:53:35.293970 14065 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:35.294430 14065 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.296563 14065 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:35.297816 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:35.299117 13981 raft_consensus.cc:2272] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:35.299082 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 17df06cad1404d96bda5822be6a6e995 (DEFAULT_TABLE table=default.Table_0af09af6fb66466099e6c7b157ee196b [id=eb2b695cdb5c4ee78dc155df3cc8e21f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.300086 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17df06cad1404d96bda5822be6a6e995. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:35.300468 14041 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50548: Illegal state: RaftConsensus is not running: State = Stopped
W20260810 13:53:35.301044 13167 leader_election.cc:343] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:35.303241 13239 tablet_service.cc:1511] Processing CreateTablet for tablet a43def9358894b2aa001a7db56706589 (DEFAULT_TABLE table=default.Table_dc36c90216d846139fda4196de0bf1bc [id=fb2df53a2f9540d88c5c64b110471c2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.303470 13981 ts_tablet_manager.cc:1916] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:35.312979 13639 tablet_bootstrap.cc:654] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:35.159528 13986 ts_tablet_manager.cc:1916] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:35.306818 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet b7dded9a7c2c4652b41131f0bc14a6b5 (table default.Table_f607f9e067574d68809ebee30bc17d75 [id=4e674333f87c408fa06b5852511ad168], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b7dded9a7c2c4652b41131f0bc14a6b5 consensus state has no leader
I20260810 13:53:35.329268 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 956e50a9d2ff4af39a349bd93c48f7d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:35.330332 13981 ts_tablet_manager.cc:1929] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:35.330766 13981 log.cc:1199] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/803a6a0a86a343b4a23f37d8317d5d0d
I20260810 13:53:35.330755 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 6cdab6f2407d4545bf6bbd81917b3434 (table default.Table_6d712ead31884c588f5b2596ab077be7 [id=a434c4a0963d4968a692435c738d2383]) successfully deleted
I20260810 13:53:35.331570 13981 ts_tablet_manager.cc:1950] T 803a6a0a86a343b4a23f37d8317d5d0d P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:35.332746 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet c5f2e89d61854ee5bf6955b8244215eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c5f2e89d61854ee5bf6955b8244215eb already in progress: creating tablet
I20260810 13:53:35.337484 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5022f9898a2b4343b457ad28e07a933f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:35.338898 13981 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 103) took 1144 ms. Trace:
I20260810 13:53:35.339232 13981 rpcz_store.cc:276] 0810 13:53:34.194959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.198584 (+ 3625us) service_pool.cc:224] Handling call
0810 13:53:35.240389 (+1041805us) ts_tablet_manager.cc:1151] Deleting tablet 803a6a0a86a343b4a23f37d8317d5d0d
0810 13:53:35.240545 (+ 156us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:35.310976 (+ 70431us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:35.330193 (+ 19217us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:35.338819 (+ 8626us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1040849}
W20260810 13:53:35.340206 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5022f9898a2b4343b457ad28e07a933f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.196573 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_cdafdcdf220049a7b14481d153792789" } new_table_name: "default.Table_f681c78b940441a29062623de79e8420" modify_external_catalogs: true
I20260810 13:53:35.344027 13981 tablet_replica.cc:333] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:35.344929 13981 raft_consensus.cc:2243] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:35.345518 13981 raft_consensus.cc:2272] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:35.350803 13981 ts_tablet_manager.cc:1916] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:35.365934 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a016d9e12b94493d9de2b382919f4f52" } new_table_name: "default.Table_72d6991df9c54bd9a1427cb6b1e98570" modify_external_catalogs: true
I20260810 13:53:35.371567 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1cd8c50f3a554cddbf2a7ff23ac23748" } modify_external_catalogs: true
I20260810 13:53:35.371768 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e383a6bbbf2247478200482d22a378e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:35.372520 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1cd8c50f3a554cddbf2a7ff23ac23748" } modify_external_catalogs: true
W20260810 13:53:35.373965 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e383a6bbbf2247478200482d22a378e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.389573 13981 ts_tablet_manager.cc:1929] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:35.390038 13981 log.cc:1199] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/185031fc211149fe87003c0cf267030d
I20260810 13:53:35.390839 13981 ts_tablet_manager.cc:1950] T 185031fc211149fe87003c0cf267030d P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:35.400789 13981 tablet_replica.cc:333] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:35.400267 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b48c394590b6458487d9402067fc9889"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:35.401664 13981 raft_consensus.cc:2243] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:35.402206 13981 raft_consensus.cc:2272] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:35.402228 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b48c394590b6458487d9402067fc9889 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.404177 13981 ts_tablet_manager.cc:1916] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:35.409368 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 46c08ec290e447678084964c23a930ad
I20260810 13:53:35.426352 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43def9358894b2aa001a7db56706589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.428787 13003 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c08ec290e447678084964c23a930ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:35.430087 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 803a6a0a86a343b4a23f37d8317d5d0d (table default.Table_be9fec10e00d4ea6bbedfbe8346507b1 [id=383c0c58e7b047589f6b496ba8f4ecb0]) successfully deleted
I20260810 13:53:35.432591 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 185031fc211149fe87003c0cf267030d (table default.Table_5b387b0607e24b559bfb3fbfdc9dc431 [id=52650fc2dbe548c2be71514fb532b2f4]) successfully deleted
W20260810 13:53:35.440650 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2327309017db4094907b3e405988f224 consensus state has no leader
I20260810 13:53:35.444947 12739 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 1 got 0
W20260810 13:53:35.435204 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a83ddc3ea3e74b569385b289fe8cf469 consensus state has no leader
I20260810 13:53:35.454720 13981 ts_tablet_manager.cc:1929] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:35.455174 13981 log.cc:1199] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/a47b0b44837544e48e6d63b491180480
I20260810 13:53:35.456061 13981 ts_tablet_manager.cc:1950] T a47b0b44837544e48e6d63b491180480 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:35.468922 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]) successfully deleted
W20260810 13:53:35.472061 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet c549fde3bf9c44ccb18087a7bd64e435 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c549fde3bf9c44ccb18087a7bd64e435 already in progress: creating tablet
W20260810 13:53:35.474776 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 2c6cfbfc47b2484396fcb517d791aae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c6cfbfc47b2484396fcb517d791aae2 already in progress: creating tablet
W20260810 13:53:35.477834 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 9566586ecdd24e94bad62906c2166afd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9566586ecdd24e94bad62906c2166afd already in progress: creating tablet
I20260810 13:53:35.478833 13981 tablet_replica.cc:333] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:35.479619 13981 raft_consensus.cc:2243] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:35.480078 13981 pending_rounds.cc:70] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:53:35.480306 13981 pending_rounds.cc:77] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971570773311488 op_type: NO_OP noop_request { }
I20260810 13:53:35.480656 13981 raft_consensus.cc:2889] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:35.481069 13981 raft_consensus.cc:2272] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:35.480825 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 (DEFAULT_TABLE table=default.Table_1023c03a20e448b4abaa7920a9ae09d9 [id=e1f370bc63c248378875a3361c4e28e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.482345 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 9566586ecdd24e94bad62906c2166afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:35.484751 13429 tablet_service.cc:1511] Processing CreateTablet for tablet a43def9358894b2aa001a7db56706589 (DEFAULT_TABLE table=default.Table_dc36c90216d846139fda4196de0bf1bc [id=fb2df53a2f9540d88c5c64b110471c2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.486327 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 17df06cad1404d96bda5822be6a6e995 (DEFAULT_TABLE table=default.Table_0af09af6fb66466099e6c7b157ee196b [id=eb2b695cdb5c4ee78dc155df3cc8e21f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.486842 12740 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet eef16ac81bb74e71bd015df0d7fcd85f
I20260810 13:53:35.487078 13981 ts_tablet_manager.cc:1916] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:35.488147 13428 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c08ec290e447678084964c23a930ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:35.489866 13382 leader_election.cc:343] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:35.518301 13981 ts_tablet_manager.cc:1929] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:35.518662 13981 log.cc:1199] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/46c08ec290e447678084964c23a930ad
I20260810 13:53:35.519440 13981 ts_tablet_manager.cc:1950] T 46c08ec290e447678084964c23a930ad P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:35.522173 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c]) successfully deleted
I20260810 13:53:35.318562 13989 ts_tablet_manager.cc:1929] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:35.319574 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 (DEFAULT_TABLE table=default.Table_1023c03a20e448b4abaa7920a9ae09d9 [id=e1f370bc63c248378875a3361c4e28e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.549737 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063e3b74a9a248a1aa0c2de4b4b73a06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.548372 13989 log.cc:1199] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/185031fc211149fe87003c0cf267030d
I20260810 13:53:35.570634 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 46c08ec290e447678084964c23a930ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:35.589865 13989 ts_tablet_manager.cc:1950] T 185031fc211149fe87003c0cf267030d P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
W20260810 13:53:35.590405 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 130403us
I20260810 13:53:35.592638 13003 tablet_service.cc:1511] Processing CreateTablet for tablet eb5d7a695c694d1993c2d0c4d3127fca (DEFAULT_TABLE table=default.Table_11e70bf5f071476d8ba0b19c299040e5 [id=b11aa3e242c34bc79d6ccc2d2dcfcda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.593811 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5d7a695c694d1993c2d0c4d3127fca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:35.595168 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 105361us
I20260810 13:53:35.495985 13640 tablet_bootstrap.cc:700] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent opening tablet: real 0.175s user 0.007s sys 0.002s
I20260810 13:53:35.501865 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b84bd35b02f4a1faf15ac9bc21e6146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.613340 13640 tablet_bootstrap.cc:654] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:35.614223 13239 tablet_service.cc:1511] Processing CreateTablet for tablet eb5d7a695c694d1993c2d0c4d3127fca (DEFAULT_TABLE table=default.Table_11e70bf5f071476d8ba0b19c299040e5 [id=b11aa3e242c34bc79d6ccc2d2dcfcda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.615190 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5d7a695c694d1993c2d0c4d3127fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.620123 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17df06cad1404d96bda5822be6a6e995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.620033 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_61931e1060bf4fe3bb18256035837a88" } modify_external_catalogs: true
I20260810 13:53:35.620550 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_61931e1060bf4fe3bb18256035837a88" } modify_external_catalogs: true
I20260810 13:53:35.624847 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43def9358894b2aa001a7db56706589. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:35.495237 14044 consensus_meta.cc:287] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.622s user 0.004s sys 0.010s
I20260810 13:53:35.629606 13382 leader_election.cc:304] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:35.635805 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c33560b05b334449b71faa0da12cab88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:35.637449 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c33560b05b334449b71faa0da12cab88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.648221 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1a54e14ee22f49fd82e23264f470b8b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:35.648634 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d48dc5ee2e94468ab72aa4dc58b0ae01" } new_table_name: "default.Table_40c739cc235b4e4a9d4fbbfb647dbd5e" modify_external_catalogs: true
W20260810 13:53:35.649691 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a54e14ee22f49fd82e23264f470b8b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.654807 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet d2cf90601bf4424aa6dc009415af8db6
I20260810 13:53:35.657326 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet d2cf90601bf4424aa6dc009415af8db6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:35.657389 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 063e3b74a9a248a1aa0c2de4b4b73a06. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:35.658985 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet d2cf90601bf4424aa6dc009415af8db6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d2cf90601bf4424aa6dc009415af8db6 already in progress: creating tablet
I20260810 13:53:35.659593 14048 raft_consensus.cc:2749] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:35.663111 14070 consensus_queue.cc:1048] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:35.663900 14044 raft_consensus.cc:515] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.665549 13475 raft_consensus.cc:2393] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:35.666728 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f3ec47fb314845439746815e3f401bc7" } new_table_name: "default.Table_453ba61c4fad4f2e99635628e3dc94b9" modify_external_catalogs: true
I20260810 13:53:35.671497 14044 leader_election.cc:290] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:35.673828 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f1df2c9593442afa84849da6874f0f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:35.679404 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac2c102382734913bffb5436e06fe0a1 consensus state has no leader
I20260810 13:53:35.705811 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet d2cf90601bf4424aa6dc009415af8db6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:35.710561 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 69a3a4d2724b42da83a523e208b5714b (DEFAULT_TABLE table=default.Table_85163b830b37444787dfe92a72503b29 [id=e4f461aca0304a8dba850e8d24b89841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.711798 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a3a4d2724b42da83a523e208b5714b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.720314 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 69a3a4d2724b42da83a523e208b5714b (DEFAULT_TABLE table=default.Table_85163b830b37444787dfe92a72503b29 [id=e4f461aca0304a8dba850e8d24b89841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.636466 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 114) took 1198 ms. Trace:
W20260810 13:53:35.743477 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 112201us
I20260810 13:53:35.748258 13007 tablet_service.cc:1511] Processing CreateTablet for tablet c0e45366954740528fb37c7cfdc639c6 (DEFAULT_TABLE table=default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 [id=8129beecaba3450c9041bb715af80988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.749329 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e45366954740528fb37c7cfdc639c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.749200 12739 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_68361e8cbef04d1595cb882c8b2e25eb" } modify_external_catalogs: true
I20260810 13:53:35.749703 12739 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_68361e8cbef04d1595cb882c8b2e25eb" } modify_external_catalogs: true
I20260810 13:53:35.756480 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 1 got 0
I20260810 13:53:35.759946 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_41315e4b42524612bd12d99b966f790b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:35.761682 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41315e4b42524612bd12d99b966f790b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.762509 12747 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
I20260810 13:53:35.796208 14049 consensus_queue.cc:1048] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20260810 13:53:35.820758 13638 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.526s user 0.037s sys 0.056s
W20260810 13:53:35.821259 13638 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.527s user 0.037s sys 0.057s
I20260810 13:53:35.825950 13638 tablet_bootstrap.cc:492] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:35.827093 13638 ts_tablet_manager.cc:1403] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 1.020s user 0.043s sys 0.075s
I20260810 13:53:35.829469 13231 tablet_service.cc:1511] Processing CreateTablet for tablet c0e45366954740528fb37c7cfdc639c6 (DEFAULT_TABLE table=default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 [id=8129beecaba3450c9041bb715af80988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.833776 13639 tablet_bootstrap.cc:492] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:35.834903 13639 ts_tablet_manager.cc:1403] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.566s user 0.141s sys 0.158s
I20260810 13:53:35.836256 13638 raft_consensus.cc:359] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.837513 13638 raft_consensus.cc:385] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:35.837809 13638 raft_consensus.cc:740] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:35.838511 13638 consensus_queue.cc:260] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.843614 13638 ts_tablet_manager.cc:1434] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.016s user 0.001s sys 0.006s
I20260810 13:53:35.843969 13639 raft_consensus.cc:359] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.844574 13639 raft_consensus.cc:385] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:35.845006 13639 raft_consensus.cc:740] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:35.845993 13639 consensus_queue.cc:260] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.848202 13639 ts_tablet_manager.cc:1434] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.013s user 0.004s sys 0.004s
I20260810 13:53:35.855576 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8583fd0d8b1043d8845a330710570a5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:35.856773 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:35.867506 12740 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]). Expected version 1 got 0
I20260810 13:53:35.868788 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2560857e4f9f4c45988374f05f107f9c" } modify_external_catalogs: true
I20260810 13:53:35.869592 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2560857e4f9f4c45988374f05f107f9c" } modify_external_catalogs: true
I20260810 13:53:35.885646 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8801796064c39ba1c81c64d622d68" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:35.886463 13050 raft_consensus.cc:3060] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:35.891077 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0af09af6fb66466099e6c7b157ee196b" } new_table_name: "default.Table_ec423adb7aa7471f9b6fb9752fb6861e" modify_external_catalogs: true
W20260810 13:53:35.855158 13164 leader_election.cc:343] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:35.904399 13164 leader_election.cc:304] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:35.905884 14065 raft_consensus.cc:2749] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:35.906211 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 51095.8us
I20260810 13:53:35.909119 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:35.909901 13264 raft_consensus.cc:3060] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:35.913362 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
I20260810 13:53:35.914870 13164 leader_election.cc:304] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:35.916347 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f8801796064c39ba1c81c64d622d68" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:35.917338 13269 raft_consensus.cc:3060] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:35.763478 13989 rpcz_store.cc:276] 0810 13:53:34.438217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.444875 (+ 6658us) service_pool.cc:224] Handling call
0810 13:53:34.585706 (+140831us) ts_tablet_manager.cc:1151] Deleting tablet 185031fc211149fe87003c0cf267030d
0810 13:53:34.585762 (+ 56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:34.696284 (+110522us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:35.318386 (+622102us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:35.636370 (+317984us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":140277}
I20260810 13:53:35.866233 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a3a4d2724b42da83a523e208b5714b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.924660 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e45366954740528fb37c7cfdc639c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.925922 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 185031fc211149fe87003c0cf267030d (table default.Table_5b387b0607e24b559bfb3fbfdc9dc431 [id=52650fc2dbe548c2be71514fb532b2f4]) successfully deleted
I20260810 13:53:35.927155 13989 tablet_replica.cc:333] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:35.928730 13639 tablet_bootstrap.cc:492] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:53:35.937610 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8583fd0d8b1043d8845a330710570a5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:35.938905 13638 tablet_bootstrap.cc:492] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:35.940380 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5ad84fe2604dd2959768db31f66e7c (DEFAULT_TABLE table=default.Table_df442195c83b420ea736308ced6e4594 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.941587 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5ad84fe2604dd2959768db31f66e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.945881 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5ad84fe2604dd2959768db31f66e7c (DEFAULT_TABLE table=default.Table_df442195c83b420ea736308ced6e4594 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:35.947247 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5ad84fe2604dd2959768db31f66e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:35.933369 13264 raft_consensus.cc:2468] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:35.968211 13050 raft_consensus.cc:2468] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:35.973873 13448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 110) took 1018 ms. Trace:
I20260810 13:53:35.970743 13928 raft_consensus.cc:493] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:35.979888 13928 raft_consensus.cc:515] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:35.991361 13269 raft_consensus.cc:2468] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:36.002097 14065 raft_consensus.cc:2749] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:36.003243 13989 raft_consensus.cc:2243] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:36.004068 13989 raft_consensus.cc:2272] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:36.006630 13989 ts_tablet_manager.cc:1916] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:35.999696 13638 tablet_bootstrap.cc:654] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:36.014940 14044 consensus_queue.cc:1048] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260810 13:53:36.024353 14102 log.cc:927] Time spent T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.169s user 0.001s sys 0.000s
I20260810 13:53:36.030606 13640 tablet_bootstrap.cc:492] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:36.031175 13640 ts_tablet_manager.cc:1403] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 1.117s user 0.038s sys 0.017s
I20260810 13:53:36.030958 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 98a59da23cfa4b5a9713b135d7fa4366 (DEFAULT_TABLE table=default.Table_45d852d5a1024cf4ad4560802702a072 [id=ff65e1ef699a4b6384f45675b49e344e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.032055 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a59da23cfa4b5a9713b135d7fa4366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.035866 13638 tablet_bootstrap.cc:492] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:36.036346 13638 ts_tablet_manager.cc:1403] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.098s user 0.016s sys 0.002s
I20260810 13:53:35.974440 13448 rpcz_store.cc:276] 0810 13:53:34.955188 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.955696 (+ 508us) service_pool.cc:224] Handling call
0810 13:53:34.958453 (+ 2757us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:34.958548 (+ 95us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:35.478610 (+520062us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:35.973364 (+494754us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:35.973812 (+ 448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:36.039372 13638 raft_consensus.cc:359] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.051235 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d447b3e1ee6a423dbe29ddad01c780b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:36.052985 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d447b3e1ee6a423dbe29ddad01c780b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:36.053225 13928 leader_election.cc:290] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:36.055265 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:53:36.060001 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
W20260810 13:53:36.061807 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73ad47d29d61456891478a9544594a94 consensus state has no leader
I20260810 13:53:36.063194 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_840fe1ccac954217b7715893c2713712"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:36.072466 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_840fe1ccac954217b7715893c2713712 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:36.076787 13986 ts_tablet_manager.cc:1929] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:36.078159 13986 log.cc:1199] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/a47b0b44837544e48e6d63b491180480
I20260810 13:53:36.078977 13986 ts_tablet_manager.cc:1950] T a47b0b44837544e48e6d63b491180480 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:36.083317 12743 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]). Expected version 1 got 0
I20260810 13:53:36.090431 13640 raft_consensus.cc:359] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.091152 13640 raft_consensus.cc:385] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:36.091462 13640 raft_consensus.cc:740] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:36.092329 13640 consensus_queue.cc:260] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.097661 13640 ts_tablet_manager.cc:1434] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.066s user 0.003s sys 0.003s
I20260810 13:53:36.108752 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc9bef2781f4046a30c5394fc5d5529 (DEFAULT_TABLE table=default.Table_4800a8b17797422cbd7f353288dc4fad [id=b0c2c10c7abb49c0b0026662e9edba2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.110069 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc9bef2781f4046a30c5394fc5d5529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.112221 13640 tablet_bootstrap.cc:492] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:36.114364 13434 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 111) took 1158 ms. Trace:
I20260810 13:53:36.114795 13434 rpcz_store.cc:276] 0810 13:53:34.955542 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.084901 (+129359us) service_pool.cc:224] Handling call
0810 13:53:35.112455 (+ 27554us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:35.112554 (+ 99us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:35.852312 (+739758us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.113787 (+261475us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:36.114277 (+ 490us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:36.066890 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet 0800a52ff0f34efd9541454eb4ecbf4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:36.067816 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 98a59da23cfa4b5a9713b135d7fa4366 (DEFAULT_TABLE table=default.Table_45d852d5a1024cf4ad4560802702a072 [id=ff65e1ef699a4b6384f45675b49e344e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:36.117274 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 149350us
I20260810 13:53:36.119000 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a59da23cfa4b5a9713b135d7fa4366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.119984 13928 consensus_queue.cc:1048] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:36.120713 13639 tablet_bootstrap.cc:654] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:36.128399 14108 consensus_queue.cc:1048] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:36.116842 13638 raft_consensus.cc:385] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:36.130072 13638 raft_consensus.cc:740] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:36.131794 13638 consensus_queue.cc:260] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.136010 13382 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:36.140995 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 108) took 1518 ms. Trace:
I20260810 13:53:36.142338 13986 rpcz_store.cc:276] 0810 13:53:34.622607 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.622733 (+ 126us) service_pool.cc:224] Handling call
0810 13:53:34.770598 (+147865us) ts_tablet_manager.cc:1151] Deleting tablet a47b0b44837544e48e6d63b491180480
0810 13:53:34.770641 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:35.553691 (+783050us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.076606 (+522915us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.140862 (+ 64256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22480,"tablet-delete.queue_time_us":55823}
I20260810 13:53:36.141817 13928 raft_consensus.cc:2804] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:36.144021 13928 raft_consensus.cc:697] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:36.145265 13928 consensus_queue.cc:237] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.152978 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc9bef2781f4046a30c5394fc5d5529 (DEFAULT_TABLE table=default.Table_4800a8b17797422cbd7f353288dc4fad [id=b0c2c10c7abb49c0b0026662e9edba2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.154058 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc9bef2781f4046a30c5394fc5d5529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.154659 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 106) took 1532 ms. Trace:
I20260810 13:53:36.155079 13986 rpcz_store.cc:276] 0810 13:53:34.622010 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.623021 (+ 1011us) service_pool.cc:224] Handling call
0810 13:53:36.154141 (+1531120us) ts_tablet_manager.cc:1151] Deleting tablet 185031fc211149fe87003c0cf267030d
0810 13:53:36.154198 (+ 57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:36.154589 (+ 391us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1434073}
I20260810 13:53:36.157073 13382 leader_election.cc:304] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:36.159538 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:36.167416 14108 raft_consensus.cc:2804] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:36.168303 14108 raft_consensus.cc:697] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
W20260810 13:53:36.175047 13168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:53:36.178385 13638 ts_tablet_manager.cc:1434] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.142s user 0.001s sys 0.006s
I20260810 13:53:36.197942 12743 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
I20260810 13:53:36.174796 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 112) took 1079 ms. Trace:
I20260810 13:53:36.173840 14108 consensus_queue.cc:237] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.216519 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ada39233e9421d9870565c73f2ee16" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:36.217927 13638 tablet_bootstrap.cc:492] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:36.218559 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:36.213117 13986 rpcz_store.cc:276] 0810 13:53:35.092998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.093218 (+ 220us) service_pool.cc:224] Handling call
0810 13:53:36.156288 (+1063070us) ts_tablet_manager.cc:1151] Deleting tablet c549fde3bf9c44ccb18087a7bd64e435
0810 13:53:36.156345 (+ 57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:36.172033 (+ 15688us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":954638}
I20260810 13:53:36.226138 13986 tablet_replica.cc:333] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:36.227350 13986 raft_consensus.cc:2243] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:36.227984 13986 raft_consensus.cc:2272] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:36.230537 13986 ts_tablet_manager.cc:1916] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:36.238306 13639 tablet_bootstrap.cc:492] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:36.238793 13639 ts_tablet_manager.cc:1403] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.310s user 0.008s sys 0.004s
I20260810 13:53:36.240461 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet d2cf90601bf4424aa6dc009415af8db6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:36.241040 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 69a3a4d2724b42da83a523e208b5714b (DEFAULT_TABLE table=default.Table_85163b830b37444787dfe92a72503b29 [id=e4f461aca0304a8dba850e8d24b89841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.241255 13430 tablet_service.cc:1511] Processing CreateTablet for tablet eb5d7a695c694d1993c2d0c4d3127fca (DEFAULT_TABLE table=default.Table_11e70bf5f071476d8ba0b19c299040e5 [id=b11aa3e242c34bc79d6ccc2d2dcfcda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.242908 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69a3a4d2724b42da83a523e208b5714b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.243166 13445 tablet_service.cc:1511] Processing CreateTablet for tablet c0e45366954740528fb37c7cfdc639c6 (DEFAULT_TABLE table=default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 [id=8129beecaba3450c9041bb715af80988]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.246064 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607]). Expected version 2 got 0
I20260810 13:53:36.247756 13640 tablet_bootstrap.cc:654] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:36.244105 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0e45366954740528fb37c7cfdc639c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.259006 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 4fc9bef2781f4046a30c5394fc5d5529 (DEFAULT_TABLE table=default.Table_4800a8b17797422cbd7f353288dc4fad [id=b0c2c10c7abb49c0b0026662e9edba2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.272382 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5d7a695c694d1993c2d0c4d3127fca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.249001 14118 tablet.cc:1724] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:36.275204 12739 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ee27d158bd40425a8c6fa8cb068daa79
I20260810 13:53:36.278306 13436 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5ad84fe2604dd2959768db31f66e7c (DEFAULT_TABLE table=default.Table_df442195c83b420ea736308ced6e4594 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.281731 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5ad84fe2604dd2959768db31f66e7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.288339 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fc9bef2781f4046a30c5394fc5d5529. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.299589 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet ee27d158bd40425a8c6fa8cb068daa79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:36.327503 13638 tablet_bootstrap.cc:654] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:36.309820 14117 log.cc:927] Time spent T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.063s user 0.002s sys 0.000s
I20260810 13:53:36.322538 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 98a59da23cfa4b5a9713b135d7fa4366 (DEFAULT_TABLE table=default.Table_45d852d5a1024cf4ad4560802702a072 [id=ff65e1ef699a4b6384f45675b49e344e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.354275 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet eaaa924290594d319b02526550416571
I20260810 13:53:36.354714 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a59da23cfa4b5a9713b135d7fa4366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.356967 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet eaaa924290594d319b02526550416571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:36.358584 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 22d96232e31f46e791d739643ffb9257 consensus state has no leader
I20260810 13:53:36.362706 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956e50a9d2ff4af39a349bd93c48f7d9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:36.386386 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17df06cad1404d96bda5822be6a6e995 consensus state has no leader
I20260810 13:53:36.396792 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_22a4a114f5cf4de481c7520fc99963ba" } new_table_name: "default.Table_37e74959a9924be883b2b657294728be" modify_external_catalogs: true
I20260810 13:53:36.405025 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607]). Expected version 2 got 0
I20260810 13:53:36.405856 12745 catalog_manager.cc:5719] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:36.407565 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]). Expected version 1 got 0
I20260810 13:53:36.408324 12745 catalog_manager.cc:5719] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:36.409610 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_71038e51b4474c5e9e8643d25c35a001 [id=5b919872756647048ea2e4fecbe78537]). Expected version 1 got 0
I20260810 13:53:36.411979 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]) successfully deleted
W20260810 13:53:36.412803 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 185031fc211149fe87003c0cf267030d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 185031fc211149fe87003c0cf267030d already in progress: creating tablet
W20260810 13:53:36.413498 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet c549fde3bf9c44ccb18087a7bd64e435 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c549fde3bf9c44ccb18087a7bd64e435 already in progress: creating tablet
W20260810 13:53:36.431058 13382 leader_election.cc:343] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:36.438541 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet ee27d158bd40425a8c6fa8cb068daa79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:36.455351 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet eaaa924290594d319b02526550416571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:36.456067 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 (DEFAULT_TABLE table=default.Table_17e523ba6a3b40999d198d9649600be4 [id=8aed385284dd4b4db81ca50f1541807c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.457463 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.459365 12951 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:36.460265 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet ee27d158bd40425a8c6fa8cb068daa79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:36.475539 14108 raft_consensus.cc:493] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:36.476230 14108 raft_consensus.cc:515] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.479960 14108 leader_election.cc:290] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:36.469914 14094 raft_consensus.cc:3060] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:36.490013 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5f9fcf73b953458c909f7910f76e523b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:36.491896 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f9fcf73b953458c909f7910f76e523b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:36.500591 13639 raft_consensus.cc:359] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.501241 13639 raft_consensus.cc:385] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:36.501538 13639 raft_consensus.cc:740] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:36.520046 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_cf87937d4ae348878fccadff2eca2c6b" } modify_external_catalogs: true
I20260810 13:53:36.520844 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_cf87937d4ae348878fccadff2eca2c6b" } modify_external_catalogs: true
W20260810 13:53:36.534216 13382 leader_election.cc:343] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:36.547967 13640 tablet_bootstrap.cc:492] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:36.548419 13640 ts_tablet_manager.cc:1403] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.443s user 0.010s sys 0.012s
I20260810 13:53:36.551112 13640 raft_consensus.cc:359] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.551789 13640 raft_consensus.cc:385] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:36.552071 13640 raft_consensus.cc:740] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:36.562693 13640 consensus_queue.cc:260] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.573068 13640 ts_tablet_manager.cc:1434] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.024s user 0.005s sys 0.001s
I20260810 13:53:36.573514 13438 tablet_service.cc:1511] Processing CreateTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 (DEFAULT_TABLE table=default.Table_c335d24b7ec048c49b6746c821e813a4 [id=c2257ea8197743dcaa568bfa151a5cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.574492 13640 tablet_bootstrap.cc:492] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:36.574743 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4cd2e5c73e467eb1bc4623e5d5e831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.536500 14107 raft_consensus.cc:493] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:36.581044 14107 raft_consensus.cc:515] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.573678 13436 tablet_service.cc:1511] Processing CreateTablet for tablet ee27d158bd40425a8c6fa8cb068daa79 (DEFAULT_TABLE table=default.Table_68361e8cbef04d1595cb882c8b2e25eb [id=cff2aea45beb46d3b2216174d77de8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.583663 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee27d158bd40425a8c6fa8cb068daa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.585904 13986 ts_tablet_manager.cc:1929] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:36.586566 13986 log.cc:1199] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/266e949bbf6d4a558d73e3cb2efec490
I20260810 13:53:36.586887 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 (DEFAULT_TABLE table=default.Table_17e523ba6a3b40999d198d9649600be4 [id=8aed385284dd4b4db81ca50f1541807c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.587956 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.587795 13986 ts_tablet_manager.cc:1950] T 266e949bbf6d4a558d73e3cb2efec490 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:36.589380 13231 tablet_service.cc:1511] Processing CreateTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 (DEFAULT_TABLE table=default.Table_c335d24b7ec048c49b6746c821e813a4 [id=c2257ea8197743dcaa568bfa151a5cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.590430 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4cd2e5c73e467eb1bc4623e5d5e831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.593966 14107 leader_election.cc:290] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:36.595337 13164 leader_election.cc:343] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:36.596107 13164 leader_election.cc:304] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:36.598516 13164 leader_election.cc:343] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:36.599368 13164 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:36.600862 14065 raft_consensus.cc:2749] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:36.602010 14065 raft_consensus.cc:2749] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:36.611224 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 116) took 1514 ms. Trace:
I20260810 13:53:36.611773 13986 rpcz_store.cc:276] 0810 13:53:35.096374 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.096516 (+ 142us) service_pool.cc:224] Handling call
0810 13:53:36.225935 (+1129419us) ts_tablet_manager.cc:1151] Deleting tablet 266e949bbf6d4a558d73e3cb2efec490
0810 13:53:36.225994 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:36.522372 (+296378us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.585721 (+ 63349us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.611118 (+ 25397us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1023981}
I20260810 13:53:36.614027 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 266e949bbf6d4a558d73e3cb2efec490 (table default.Table_f688a5d2568d4835bc32eb6cc9533ef9 [id=539325ee3b9c41609568f2e02f54dc02]) successfully deleted
I20260810 13:53:36.623296 13640 tablet_bootstrap.cc:654] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:36.624130 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf90601bf4424aa6dc009415af8db6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:36.624531 13986 tablet_replica.cc:333] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:36.625490 13986 raft_consensus.cc:2243] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:36.626011 13986 raft_consensus.cc:2272] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:36.628211 13986 ts_tablet_manager.cc:1916] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:36.517737 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47505.6us
I20260810 13:53:36.525699 14094 raft_consensus.cc:2749] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:36.653147 13640 tablet_bootstrap.cc:492] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:36.653635 13640 ts_tablet_manager.cc:1403] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.079s user 0.008s sys 0.009s
I20260810 13:53:36.526666 14128 consensus_queue.cc:1048] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:36.670176 13640 raft_consensus.cc:359] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.670931 13640 raft_consensus.cc:385] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:36.671232 13640 raft_consensus.cc:740] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:36.673137 13640 consensus_queue.cc:260] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.678432 13639 consensus_queue.cc:260] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.686712 13640 ts_tablet_manager.cc:1434] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.033s user 0.003s sys 0.005s
I20260810 13:53:36.695602 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_11e70bf5f071476d8ba0b19c299040e5" } modify_external_catalogs: true
I20260810 13:53:36.696166 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_11e70bf5f071476d8ba0b19c299040e5" } modify_external_catalogs: true
I20260810 13:53:36.698904 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1da7c92cdb10481480037763b0ec869b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:36.702245 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5151631f180c44e8bb89c91b094f1259" } new_table_name: "default.Table_57aa5df7d41e490da1c7f3cbbf615728" modify_external_catalogs: true
I20260810 13:53:36.709024 13640 tablet_bootstrap.cc:492] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:53:36.713323 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1da7c92cdb10481480037763b0ec869b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:36.714669 13640 tablet_bootstrap.cc:654] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:36.729823 13986 ts_tablet_manager.cc:1929] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:36.731945 13986 log.cc:1199] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/956e50a9d2ff4af39a349bd93c48f7d9
I20260810 13:53:36.740835 13639 ts_tablet_manager.cc:1434] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.502s user 0.008s sys 0.000s
W20260810 13:53:36.741101 13639 ts_tablet_manager.cc:1467] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: Tablet startup took 502ms
W20260810 13:53:36.745332 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 97165.4us
I20260810 13:53:36.746733 13986 ts_tablet_manager.cc:1950] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:53:36.741761 13639 ts_tablet_manager.cc:1469] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: Trace:
0810 13:53:28.713821 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:28.723130 (+ 9309us) service_pool.cc:224] Handling call
0810 13:53:28.990953 (+267823us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:28.994137 (+ 3184us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:29.398625 (+404488us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:29.635909 (+237284us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:29.651700 (+ 15791us) inbound_call.cc:177] Queueing success response
0810 13:53:35.928421 (+6276721us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:53:36.239189 (+310768us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:53:36.240773 (+ 1584us) tablet_replica.cc:261] Starting instrumentation
0810 13:53:36.241415 (+ 642us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":15305,"tablet-open.queue_time_us":6276781}
I20260810 13:53:36.750480 13639 tablet_bootstrap.cc:492] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:36.755385 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 117) took 1658 ms. Trace:
I20260810 13:53:36.757730 13986 rpcz_store.cc:276] 0810 13:53:35.096973 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.329005 (+232032us) service_pool.cc:224] Handling call
0810 13:53:36.624339 (+1295334us) ts_tablet_manager.cc:1151] Deleting tablet 956e50a9d2ff4af39a349bd93c48f7d9
0810 13:53:36.624400 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:36.706427 (+ 82027us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.729246 (+ 22819us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.754939 (+ 25693us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1294644}
I20260810 13:53:36.766626 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 956e50a9d2ff4af39a349bd93c48f7d9 (table default.Table_3de1b4c6b1424eb0ab2183f39131ed74 [id=f800d0ffba7e47e6affc4f8527dfe445]) successfully deleted
I20260810 13:53:36.766484 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:36.769484 13260 raft_consensus.cc:2468] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:36.773990 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 115) took 1678 ms. Trace:
I20260810 13:53:36.776347 13986 rpcz_store.cc:276] 0810 13:53:35.095882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.097046 (+ 1164us) service_pool.cc:224] Handling call
0810 13:53:36.770389 (+1673343us) ts_tablet_manager.cc:1151] Deleting tablet 2c6cfbfc47b2484396fcb517d791aae2
0810 13:53:36.770745 (+ 356us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:36.773556 (+ 2811us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1433751}
W20260810 13:53:36.764395 13164 leader_election.cc:343] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:36.783109 13239 tablet_service.cc:1511] Processing CreateTablet for tablet ee27d158bd40425a8c6fa8cb068daa79 (DEFAULT_TABLE table=default.Table_68361e8cbef04d1595cb882c8b2e25eb [id=cff2aea45beb46d3b2216174d77de8da]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:36.783356 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 2c6cfbfc47b2484396fcb517d791aae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c6cfbfc47b2484396fcb517d791aae2 already in progress: creating tablet
I20260810 13:53:36.784482 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee27d158bd40425a8c6fa8cb068daa79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:36.788872 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 119) took 1306 ms. Trace:
I20260810 13:53:36.791843 13638 tablet_bootstrap.cc:492] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:36.792243 13638 ts_tablet_manager.cc:1403] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.575s user 0.006s sys 0.013s
I20260810 13:53:36.790674 13986 rpcz_store.cc:276] 0810 13:53:35.482019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.482159 (+ 140us) service_pool.cc:224] Handling call
0810 13:53:36.785982 (+1303823us) ts_tablet_manager.cc:1151] Deleting tablet 9566586ecdd24e94bad62906c2166afd
0810 13:53:36.786279 (+ 297us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:36.788511 (+ 2232us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1302385}
I20260810 13:53:36.794657 13638 raft_consensus.cc:359] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.795258 13638 raft_consensus.cc:385] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:36.795532 13638 raft_consensus.cc:740] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:36.796556 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 9566586ecdd24e94bad62906c2166afd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9566586ecdd24e94bad62906c2166afd already in progress: creating tablet
I20260810 13:53:36.799273 13986 tablet_replica.cc:333] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:36.796128 13638 consensus_queue.cc:260] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.805042 13986 raft_consensus.cc:2243] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:36.805646 13986 pending_rounds.cc:70] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Trying to abort 1 pending ops.
I20260810 13:53:36.805883 13986 pending_rounds.cc:77] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316971583815942144 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "46c08ec290e447678084964c23a930ad" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_19de196adf7f448b9beee85f7221ea70" dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" new_extra_config { } }
W20260810 13:53:36.807111 13986 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43224: Aborted: Op aborted
I20260810 13:53:36.807649 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 122) took 1320 ms. Trace:
I20260810 13:53:36.807947 13986 rpcz_store.cc:276] 0810 13:53:35.487165 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.487271 (+ 106us) service_pool.cc:224] Handling call
0810 13:53:36.807583 (+1320312us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:35.579413 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:35.579885 (+ 472us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:35.579941 (+ 56us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:35.580009 (+ 68us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:35.580157 (+ 148us) alter_schema_op.cc:128] START. Timestamp: 1786370015580064
0810 13:53:35.580196 (+ 39us) op_driver.cc:348] REPLICATION: starting
0810 13:53:35.580980 (+ 784us) log.cc:844] Serialized 173 byte log entry
0810 13:53:36.806875 (+1225895us) op_driver.cc:464] REPLICATION: finished
0810 13:53:36.806964 (+ 89us) op_driver.cc:389] HandleFailure(Aborted: Op aborted)
0810 13:53:36.807011 (+ 47us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":78495,"prepare.run_cpu_time_us":1992,"prepare.run_wall_time_us":138917,"replication_time_us":1226534,"thread_start_us":81613,"threads_started":1}]]}
I20260810 13:53:36.810463 13986 raft_consensus.cc:2272] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:36.810971 14087 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:43224: Illegal state: RaftConsensus is not running: State = Stopped
I20260810 13:53:36.812660 13382 leader_election.cc:304] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:36.814213 14108 raft_consensus.cc:2804] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:36.814641 14108 raft_consensus.cc:493] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:36.814983 14108 raft_consensus.cc:3060] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:36.834781 13989 ts_tablet_manager.cc:1929] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:36.835289 13989 log.cc:1199] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/a47b0b44837544e48e6d63b491180480
I20260810 13:53:36.836155 13989 ts_tablet_manager.cc:1950] T a47b0b44837544e48e6d63b491180480 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:36.841187 12742 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 1 got 0
I20260810 13:53:36.844955 14065 raft_consensus.cc:493] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:36.826713 13986 ts_tablet_manager.cc:1916] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:36.845403 14065 raft_consensus.cc:515] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.846988 14108 raft_consensus.cc:515] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.849949 14108 leader_election.cc:290] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:36.862515 13986 ts_tablet_manager.cc:1929] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:36.862902 13986 log.cc:1199] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/46c08ec290e447678084964c23a930ad
I20260810 13:53:36.863648 13986 ts_tablet_manager.cc:1950] T 46c08ec290e447678084964c23a930ad P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:36.865691 13986 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 123) took 1378 ms. Trace:
I20260810 13:53:36.866010 13986 rpcz_store.cc:276] 0810 13:53:35.487707 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.487871 (+ 164us) service_pool.cc:224] Handling call
0810 13:53:36.798325 (+1310454us) ts_tablet_manager.cc:1151] Deleting tablet 46c08ec290e447678084964c23a930ad
0810 13:53:36.798591 (+ 266us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:36.854600 (+ 56009us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.862408 (+ 7808us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.865619 (+ 3211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1309534}
I20260810 13:53:36.867151 13986 tablet_replica.cc:333] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:36.867373 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c]) successfully deleted
I20260810 13:53:36.867837 13986 raft_consensus.cc:2243] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:36.868381 13986 raft_consensus.cc:2272] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:36.868517 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:53:36.887599 13640 tablet_bootstrap.cc:492] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:36.888041 13640 ts_tablet_manager.cc:1403] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.179s user 0.052s sys 0.061s
I20260810 13:53:36.890753 13640 raft_consensus.cc:359] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.891438 13640 raft_consensus.cc:385] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:36.891708 13640 raft_consensus.cc:740] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:36.897476 13986 ts_tablet_manager.cc:1916] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:36.905648 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:36.906242 13269 raft_consensus.cc:3060] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:36.908947 13640 consensus_queue.cc:260] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:36.909700 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0800a52ff0f34efd9541454eb4ecbf4c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:36.881413 14065 leader_election.cc:290] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:36.913654 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 116) took 2330 ms. Trace:
I20260810 13:53:36.914117 13989 rpcz_store.cc:276] 0810 13:53:34.583273 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.584011 (+ 738us) service_pool.cc:224] Handling call
0810 13:53:35.926942 (+1342931us) ts_tablet_manager.cc:1151] Deleting tablet a47b0b44837544e48e6d63b491180480
0810 13:53:35.927023 (+ 81us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:36.127824 (+200801us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.834661 (+706837us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.913569 (+ 78908us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84731,"tablet-delete.queue_time_us":1342237}
I20260810 13:53:36.916168 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet a47b0b44837544e48e6d63b491180480 (table default.Table_af3b17037c8442559ad5c099a9370b2d [id=6a58f36b9cc94db892c400b918a3d6ae]) successfully deleted
I20260810 13:53:36.917223 13640 ts_tablet_manager.cc:1434] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.029s user 0.006s sys 0.001s
I20260810 13:53:36.922439 13640 tablet_bootstrap.cc:492] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:53:36.927104 13164 leader_election.cc:343] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:36.941035 13640 tablet_bootstrap.cc:654] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:36.953135 13986 ts_tablet_manager.cc:1929] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:36.953533 13986 log.cc:1199] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/d2cf90601bf4424aa6dc009415af8db6
I20260810 13:53:36.954195 13986 ts_tablet_manager.cc:1950] T d2cf90601bf4424aa6dc009415af8db6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:36.975416 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956e50a9d2ff4af39a349bd93c48f7d9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:36.977069 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:36.980139 14146 consensus_queue.cc:1048] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:36.981889 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 120) took 2265 ms. Trace:
I20260810 13:53:36.993147 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:36.982645 13989 rpcz_store.cc:276] 0810 13:53:34.716957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.752782 (+ 35825us) service_pool.cc:224] Handling call
0810 13:53:36.960611 (+2207829us) ts_tablet_manager.cc:1151] Deleting tablet c549fde3bf9c44ccb18087a7bd64e435
0810 13:53:36.960658 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:36.981813 (+ 21155us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2207139}
I20260810 13:53:36.994321 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 (DEFAULT_TABLE table=default.Table_17e523ba6a3b40999d198d9649600be4 [id=8aed385284dd4b4db81ca50f1541807c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:36.995231 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet eaaa924290594d319b02526550416571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:36.996157 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.013515 13004 tablet_service.cc:1511] Processing CreateTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 (DEFAULT_TABLE table=default.Table_c335d24b7ec048c49b6746c821e813a4 [id=c2257ea8197743dcaa568bfa151a5cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.015924 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4cd2e5c73e467eb1bc4623e5d5e831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.018201 13269 raft_consensus.cc:2468] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:37.044449 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet d2cf90601bf4424aa6dc009415af8db6 (table default.Table_61931e1060bf4fe3bb18256035837a88 [id=be32b50a9d45438b86b5ab8bca95243c]) successfully deleted
W20260810 13:53:37.045482 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet ee27d158bd40425a8c6fa8cb068daa79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee27d158bd40425a8c6fa8cb068daa79 already in progress: creating tablet
W20260810 13:53:37.046366 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet eaaa924290594d319b02526550416571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eaaa924290594d319b02526550416571 already in progress: creating tablet
W20260810 13:53:37.048214 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet c549fde3bf9c44ccb18087a7bd64e435 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c549fde3bf9c44ccb18087a7bd64e435 already in progress: creating tablet
I20260810 13:53:37.014318 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 122) took 2210 ms. Trace:
I20260810 13:53:37.052140 13989 rpcz_store.cc:276] 0810 13:53:34.803511 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.803713 (+ 202us) service_pool.cc:224] Handling call
0810 13:53:37.013322 (+2209609us) ts_tablet_manager.cc:1151] Deleting tablet 2c6cfbfc47b2484396fcb517d791aae2
0810 13:53:37.013421 (+ 99us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:37.014226 (+ 805us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2208879}
W20260810 13:53:37.055289 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 2c6cfbfc47b2484396fcb517d791aae2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2c6cfbfc47b2484396fcb517d791aae2 already in progress: creating tablet
I20260810 13:53:37.055276 13007 tablet_service.cc:1511] Processing CreateTablet for tablet ee27d158bd40425a8c6fa8cb068daa79 (DEFAULT_TABLE table=default.Table_68361e8cbef04d1595cb882c8b2e25eb [id=cff2aea45beb46d3b2216174d77de8da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.056406 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee27d158bd40425a8c6fa8cb068daa79. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:37.057086 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ee27d158bd40425a8c6fa8cb068daa79 because the tablet was not found. No further retry: Not found: Tablet not found: ee27d158bd40425a8c6fa8cb068daa79
I20260810 13:53:37.074849 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb (DEFAULT_TABLE table=default.Table_5306ac6359cd4033b2c54ad5db69828c [id=66a8a9b05b3a45f681081deace48b4a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.076998 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c640dce5dd4fc8a49f07fb983c50eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.064517 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 123) took 2247 ms. Trace:
I20260810 13:53:37.078168 13989 rpcz_store.cc:276] 0810 13:53:34.817442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.818671 (+ 1229us) service_pool.cc:224] Handling call
0810 13:53:37.064020 (+2245349us) ts_tablet_manager.cc:1151] Deleting tablet 803a6a0a86a343b4a23f37d8317d5d0d
0810 13:53:37.064107 (+ 87us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:37.064420 (+ 313us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2244699}
I20260810 13:53:37.095185 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_7ef25000b5b24c7e967819fa18512810"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:37.096992 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ef25000b5b24c7e967819fa18512810 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:37.100431 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_676bf4ad882d40c3b4ee02bcc60c973a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:37.101748 13382 leader_election.cc:304] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
W20260810 13:53:37.101966 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_676bf4ad882d40c3b4ee02bcc60c973a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:37.103803 14108 raft_consensus.cc:2804] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:37.104209 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb (DEFAULT_TABLE table=default.Table_5306ac6359cd4033b2c54ad5db69828c [id=66a8a9b05b3a45f681081deace48b4a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.104573 14108 raft_consensus.cc:697] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:37.113566 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c640dce5dd4fc8a49f07fb983c50eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.115196 13639 tablet_bootstrap.cc:654] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:37.121258 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_4800a8b17797422cbd7f353288dc4fad" } new_table_name: "default.Table_1efc108552b047538e81a19f9d985680" modify_external_catalogs: true
I20260810 13:53:37.106261 14108 consensus_queue.cc:237] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:37.146548 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet eaaa924290594d319b02526550416571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eaaa924290594d319b02526550416571 already in progress: creating tablet
W20260810 13:53:37.147627 13382 leader_election.cc:343] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:37.147972 14146 consensus_queue.cc:1048] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:37.158303 13638 ts_tablet_manager.cc:1434] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.366s user 0.002s sys 0.018s
I20260810 13:53:37.159541 13638 tablet_bootstrap.cc:492] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:37.158743 13640 tablet_bootstrap.cc:492] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:37.160244 13640 ts_tablet_manager.cc:1403] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.238s user 0.030s sys 0.065s
I20260810 13:53:37.147985 13382 leader_election.cc:304] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:37.161574 13382 raft_consensus.cc:2686] T 956e50a9d2ff4af39a349bd93c48f7d9 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:37.163900 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 125) took 2114 ms. Trace:
I20260810 13:53:37.164459 13989 rpcz_store.cc:276] 0810 13:53:35.049946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.050095 (+ 149us) service_pool.cc:224] Handling call
0810 13:53:37.163171 (+2113076us) ts_tablet_manager.cc:1151] Deleting tablet 9566586ecdd24e94bad62906c2166afd
0810 13:53:37.163239 (+ 68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:37.163812 (+ 573us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2112472}
I20260810 13:53:37.166131 13989 tablet_replica.cc:333] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:37.167375 13989 raft_consensus.cc:2243] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:37.168147 14146 raft_consensus.cc:493] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:37.168748 14146 raft_consensus.cc:515] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:37.173728 13382 leader_election.cc:343] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:37.174295 14146 leader_election.cc:290] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:37.174962 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet f7afa380245248f5bac203b0905721c6
I20260810 13:53:37.176613 14168 raft_consensus.cc:493] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:37.177557 14168 raft_consensus.cc:515] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.179834 13640 raft_consensus.cc:359] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.186275 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet eb5d7a695c694d1993c2d0c4d3127fca
I20260810 13:53:37.180492 13640 raft_consensus.cc:385] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:37.189321 13640 raft_consensus.cc:740] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:37.192253 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_71038e51b4474c5e9e8643d25c35a001 [id=5b919872756647048ea2e4fecbe78537]). Expected version 1 got 0
I20260810 13:53:37.192888 13640 consensus_queue.cc:260] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.197844 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]). Expected version 1 got 0
I20260810 13:53:37.198303 14168 leader_election.cc:290] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:37.198578 13640 ts_tablet_manager.cc:1434] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.038s user 0.005s sys 0.002s
I20260810 13:53:37.200414 13233 tablet_service.cc:1511] Processing CreateTablet for tablet ce9243eda3974532aff0425885f54166 (DEFAULT_TABLE table=default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.202009 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9243eda3974532aff0425885f54166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.202486 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet 956e50a9d2ff4af39a349bd93c48f7d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:37.203058 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet f7afa380245248f5bac203b0905721c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:37.209537 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 1 got 0
W20260810 13:53:37.204360 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 803a6a0a86a343b4a23f37d8317d5d0d because the tablet was not found. No further retry: Not found: Tablet not found: 803a6a0a86a343b4a23f37d8317d5d0d
I20260810 13:53:37.217543 13640 tablet_bootstrap.cc:492] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:37.218129 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2cf90601bf4424aa6dc009415af8db6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:37.222440 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0800a52ff0f34efd9541454eb4ecbf4c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:37.226164 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 51491.6us
W20260810 13:53:37.227406 13382 leader_election.cc:343] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:37.238570 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 9566586ecdd24e94bad62906c2166afd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9566586ecdd24e94bad62906c2166afd already in progress: creating tablet
I20260810 13:53:37.250861 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet f7afa380245248f5bac203b0905721c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:37.251323 13014 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5d7a695c694d1993c2d0c4d3127fca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:37.253377 13000 tablet_service.cc:1511] Processing CreateTablet for tablet ef59f7013ab4489dadd9084d065533a8 (DEFAULT_TABLE table=default.Table_5a8f2e65e00343b594afce9f25120ab4 [id=0865aeb0877147babbc3f19c5efb175d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.256593 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 32721630ac494c07b015c02f4741cad8 (DEFAULT_TABLE table=default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.265600 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef59f7013ab4489dadd9084d065533a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.257319 13007 tablet_service.cc:1511] Processing CreateTablet for tablet ce9243eda3974532aff0425885f54166 (DEFAULT_TABLE table=default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.268926 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb (DEFAULT_TABLE table=default.Table_5306ac6359cd4033b2c54ad5db69828c [id=66a8a9b05b3a45f681081deace48b4a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.270896 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_27966be3dfde47f48e04540a47399a69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:37.272886 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27966be3dfde47f48e04540a47399a69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:37.280396 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9243eda3974532aff0425885f54166. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:37.281879 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet eb5d7a695c694d1993c2d0c4d3127fca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb5d7a695c694d1993c2d0c4d3127fca already in progress: creating tablet
W20260810 13:53:37.283897 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet f7afa380245248f5bac203b0905721c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7afa380245248f5bac203b0905721c6 already in progress: creating tablet
I20260810 13:53:37.285277 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32721630ac494c07b015c02f4741cad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.305612 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c640dce5dd4fc8a49f07fb983c50eb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:37.313632 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 92ba87c833e5459884173b65fb5645b6 consensus state has no leader
I20260810 13:53:37.328246 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ada39233e9421d9870565c73f2ee16" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:37.328277 14128 raft_consensus.cc:493] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:37.331800 14128 raft_consensus.cc:515] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.352717 14146 consensus_queue.cc:1048] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:37.359865 13438 tablet_service.cc:1511] Processing CreateTablet for tablet ce9243eda3974532aff0425885f54166 (DEFAULT_TABLE table=default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.362799 13436 tablet_service.cc:1511] Processing CreateTablet for tablet ef59f7013ab4489dadd9084d065533a8 (DEFAULT_TABLE table=default.Table_5a8f2e65e00343b594afce9f25120ab4 [id=0865aeb0877147babbc3f19c5efb175d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.342483 14128 leader_election.cc:290] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:37.366163 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef59f7013ab4489dadd9084d065533a8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:37.369403 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 92ba87c833e5459884173b65fb5645b6 (table default.Table_57aa5df7d41e490da1c7f3cbbf615728 [id=8b0d7ace0c6f4b9592148341b6da7c50], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 92ba87c833e5459884173b65fb5645b6 consensus state has no leader
I20260810 13:53:37.373155 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9243eda3974532aff0425885f54166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.374158 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet f7afa380245248f5bac203b0905721c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:37.377182 13639 tablet_bootstrap.cc:492] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:37.377688 13639 ts_tablet_manager.cc:1403] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.627s user 0.020s sys 0.001s
I20260810 13:53:37.381973 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5d7a695c694d1993c2d0c4d3127fca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:37.383708 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 185031fc211149fe87003c0cf267030d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:37.384377 13986 tablet_replica.cc:333] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:37.385106 13986 raft_consensus.cc:2243] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:37.385584 13986 raft_consensus.cc:2272] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:37.393570 13986 ts_tablet_manager.cc:1916] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:37.381289 13989 pending_rounds.cc:70] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:37.397934 13230 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5d7a695c694d1993c2d0c4d3127fca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:37.406719 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 32721630ac494c07b015c02f4741cad8 (DEFAULT_TABLE table=default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.407855 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32721630ac494c07b015c02f4741cad8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:37.385978 13167 leader_election.cc:343] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:37.417479 13382 consensus_peers.cc:597] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:53:37.418438 13382 leader_election.cc:343] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:37.418982 13382 leader_election.cc:343] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 185031fc211149fe87003c0cf267030d
W20260810 13:53:37.422412 12952 leader_election.cc:343] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 266e949bbf6d4a558d73e3cb2efec490
I20260810 13:53:37.425889 13638 tablet_bootstrap.cc:654] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:37.426788 13640 tablet_bootstrap.cc:654] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:37.427817 14185 tablet.cc:1724] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:37.428221 13007 tablet_service.cc:1511] Processing CreateTablet for tablet fe4755e4fcfd4af087ce5831a4e02022 (DEFAULT_TABLE table=default.Table_8dc89b56ec51450ab5cde9cd49f3c526 [id=6ec5427039a4417b98471e08ccf0b2c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.429420 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe4755e4fcfd4af087ce5831a4e02022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.428462 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ada39233e9421d9870565c73f2ee16" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:37.431581 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 9334ba72cfd94fa4a7062a29445c69f9 (DEFAULT_TABLE table=default.Table_da227c8b756041528b3a4dd7196645fe [id=4d5771db00ae42b9957c6453d83f81ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.443679 13264 raft_consensus.cc:2468] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:37.444126 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9334ba72cfd94fa4a7062a29445c69f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.431638 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 32721630ac494c07b015c02f4741cad8 (DEFAULT_TABLE table=default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.447522 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32721630ac494c07b015c02f4741cad8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:37.447481 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet f7afa380245248f5bac203b0905721c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7afa380245248f5bac203b0905721c6 already in progress: creating tablet
I20260810 13:53:37.417548 13167 leader_election.cc:304] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:37.448150 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet eb5d7a695c694d1993c2d0c4d3127fca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb5d7a695c694d1993c2d0c4d3127fca already in progress: creating tablet
I20260810 13:53:37.399024 13989 pending_rounds.cc:77] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316971583815942144 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "46c08ec290e447678084964c23a930ad" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_19de196adf7f448b9beee85f7221ea70" dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" new_extra_config { } }
I20260810 13:53:37.435415 13230 tablet_service.cc:1511] Processing CreateTablet for tablet ef59f7013ab4489dadd9084d065533a8 (DEFAULT_TABLE table=default.Table_5a8f2e65e00343b594afce9f25120ab4 [id=0865aeb0877147babbc3f19c5efb175d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:37.458635 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 73889.1us
I20260810 13:53:37.460130 14065 raft_consensus.cc:2749] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:37.461700 13382 leader_election.cc:343] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 185031fc211149fe87003c0cf267030d
I20260810 13:53:37.462209 13382 leader_election.cc:304] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:37.462384 13989 raft_consensus.cc:2272] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:37.462913 13382 raft_consensus.cc:2686] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:37.463730 13382 leader_election.cc:304] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:37.464553 14172 raft_consensus.cc:2804] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:37.465106 14172 raft_consensus.cc:493] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:37.465745 14172 raft_consensus.cc:3060] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:37.475307 14146 raft_consensus.cc:493] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:37.475988 14146 raft_consensus.cc:515] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.478965 14191 tablet.cc:1724] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:37.479743 14146 leader_election.cc:290] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:37.474680 13000 tablet_service.cc:1511] Processing CreateTablet for tablet 9334ba72cfd94fa4a7062a29445c69f9 (DEFAULT_TABLE table=default.Table_da227c8b756041528b3a4dd7196645fe [id=4d5771db00ae42b9957c6453d83f81ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.489379 12749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9656a7ccd188461fa55387c96150bb80" } modify_external_catalogs: true
I20260810 13:53:37.489989 12749 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9656a7ccd188461fa55387c96150bb80" } modify_external_catalogs: true
I20260810 13:53:37.490804 13640 tablet_bootstrap.cc:492] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:37.491290 13640 ts_tablet_manager.cc:1403] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.274s user 0.013s sys 0.018s
I20260810 13:53:37.494396 13986 ts_tablet_manager.cc:1929] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:37.494867 13986 log.cc:1199] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/185031fc211149fe87003c0cf267030d
I20260810 13:53:37.495592 13986 ts_tablet_manager.cc:1950] T 185031fc211149fe87003c0cf267030d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:37.497244 14172 raft_consensus.cc:515] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.500164 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet 266e949bbf6d4a558d73e3cb2efec490 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:37.501046 14125 tablet_replica.cc:333] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:37.500370 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3687705a4de844f59a3c7e3af511980e" } modify_external_catalogs: true
I20260810 13:53:37.501929 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3687705a4de844f59a3c7e3af511980e" } modify_external_catalogs: true
I20260810 13:53:37.502600 14125 raft_consensus.cc:2243] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:37.503379 14125 raft_consensus.cc:2272] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:37.500619 14172 leader_election.cc:290] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:37.506419 12743 catalog_manager.cc:5719] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:37.507786 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607]). Expected version 2 got 0
I20260810 13:53:37.483759 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9334ba72cfd94fa4a7062a29445c69f9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:37.520527 12951 leader_election.cc:343] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 266e949bbf6d4a558d73e3cb2efec490
I20260810 13:53:37.520965 12951 leader_election.cc:304] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:37.521498 12951 raft_consensus.cc:2686] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:37.522568 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 1 got 0
I20260810 13:53:37.523283 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_71038e51b4474c5e9e8643d25c35a001 [id=5b919872756647048ea2e4fecbe78537]). Expected version 1 got 0
I20260810 13:53:37.525653 13639 raft_consensus.cc:359] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.526280 13639 raft_consensus.cc:385] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:37.526574 13639 raft_consensus.cc:740] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:37.527702 14125 ts_tablet_manager.cc:1916] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:37.528858 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
I20260810 13:53:37.535399 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_41315e4b42524612bd12d99b966f790b" } new_table_name: "default.Table_fbe0f651fe2e4328b7e2a126d989afab" modify_external_catalogs: true
I20260810 13:53:37.537015 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0800a52ff0f34efd9541454eb4ecbf4c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:37.540221 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f8b9ea9b553b4effb76fe1c6046b7592"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:37.541774 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8b9ea9b553b4effb76fe1c6046b7592 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:37.545020 13640 raft_consensus.cc:359] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.545616 13640 raft_consensus.cc:385] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:37.545878 13640 raft_consensus.cc:740] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:37.546482 13640 consensus_queue.cc:260] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.546723 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f98c8ce886d84413a005fa4b80373027"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:37.548561 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f98c8ce886d84413a005fa4b80373027 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:37.460273 13167 leader_election.cc:343] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:37.539196 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ada39233e9421d9870565c73f2ee16" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:37.552589 13640 ts_tablet_manager.cc:1434] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.061s user 0.004s sys 0.008s
I20260810 13:53:37.554874 13640 tablet_bootstrap.cc:492] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:37.560029 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 9334ba72cfd94fa4a7062a29445c69f9 (DEFAULT_TABLE table=default.Table_da227c8b756041528b3a4dd7196645fe [id=4d5771db00ae42b9957c6453d83f81ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.553619 13167 leader_election.cc:304] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:37.561342 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9334ba72cfd94fa4a7062a29445c69f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.566509 13640 tablet_bootstrap.cc:654] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:37.566761 12728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111) [suppressed 8 similar messages]
I20260810 13:53:37.565537 14153 raft_consensus.cc:2749] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:37.577225 13436 tablet_service.cc:1511] Processing CreateTablet for tablet fe4755e4fcfd4af087ce5831a4e02022 (DEFAULT_TABLE table=default.Table_8dc89b56ec51450ab5cde9cd49f3c526 [id=6ec5427039a4417b98471e08ccf0b2c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.578490 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe4755e4fcfd4af087ce5831a4e02022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.581277 14108 consensus_queue.cc:1048] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:53:37.584089 13382 leader_election.cc:343] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:37.584787 13382 leader_election.cc:343] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:37.591205 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ada39233e9421d9870565c73f2ee16" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:37.591838 13265 raft_consensus.cc:3060] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:37.598196 13989 ts_tablet_manager.cc:1916] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:37.599498 13230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef59f7013ab4489dadd9084d065533a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.542235 14193 tablet.cc:1724] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:37.566234 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0800a52ff0f34efd9541454eb4ecbf4c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:37.602234 13268 raft_consensus.cc:2468] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:37.603992 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 185031fc211149fe87003c0cf267030d (table default.Table_5b387b0607e24b559bfb3fbfdc9dc431 [id=52650fc2dbe548c2be71514fb532b2f4]) successfully deleted
I20260810 13:53:37.639530 13233 tablet_service.cc:1511] Processing CreateTablet for tablet fe4755e4fcfd4af087ce5831a4e02022 (DEFAULT_TABLE table=default.Table_8dc89b56ec51450ab5cde9cd49f3c526 [id=6ec5427039a4417b98471e08ccf0b2c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.645463 14185 tablet.cc:1724] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:37.649438 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 00a7bce2378f482d81d2ad08e9d15b0c (DEFAULT_TABLE table=default.Table_750e154b9a7a4141baa6de859c042732 [id=6e90d1effcf2446982739abe04249eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.653174 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a7bce2378f482d81d2ad08e9d15b0c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:37.568549 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 108357us
I20260810 13:53:37.670500 13382 leader_election.cc:304] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:37.673729 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4fc9bef2781f4046a30c5394fc5d5529 consensus state has no leader
I20260810 13:53:37.675004 14065 raft_consensus.cc:493] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:37.675832 14065 raft_consensus.cc:515] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.688028 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 4b0ffad7efc24519957f2fb3be945b7d
I20260810 13:53:37.692205 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 07ff9e8a8ca845b89154ed0626d34c5c
I20260810 13:53:37.692210 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b0ffad7efc24519957f2fb3be945b7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:37.691721 14191 tablet.cc:1724] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:37.693957 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:37.696025 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:37.698894 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 132193us
I20260810 13:53:37.709671 14172 raft_consensus.cc:2804] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:37.710083 14172 raft_consensus.cc:493] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:37.710464 14172 raft_consensus.cc:3060] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:37.711063 13640 tablet_bootstrap.cc:492] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
W20260810 13:53:37.711472 12728 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 -> Peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Couldn't send request to peer 2928f7d4503145b182d99007d240334d. Status: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260810 13:53:37.711619 13640 ts_tablet_manager.cc:1403] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.157s user 0.017s sys 0.030s
I20260810 13:53:37.719571 14065 leader_election.cc:290] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:37.720666 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "956e50a9d2ff4af39a349bd93c48f7d9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:37.721787 14185 tablet.cc:1724] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 13:53:37.723919 13167 leader_election.cc:343] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:37.730115 13018 tablet_service.cc:1511] Processing CreateTablet for tablet b449377349514576874b6c295ead5e9a (DEFAULT_TABLE table=default.Table_d310fa96aa3e455590195ac9bf3b4825 [id=147b038d3de54c8d85e666747153cb7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.730279 13640 raft_consensus.cc:359] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.730959 13640 raft_consensus.cc:385] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:37.731102 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b449377349514576874b6c295ead5e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.731248 13640 raft_consensus.cc:740] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:37.737041 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe4755e4fcfd4af087ce5831a4e02022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.731897 13640 consensus_queue.cc:260] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.750110 13265 raft_consensus.cc:2468] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:37.751756 14169 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:37.752434 14169 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.758284 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b0ffad7efc24519957f2fb3be945b7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:37.759238 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:37.547039 13639 consensus_queue.cc:260] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.778576 14169 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:37.762279 13239 tablet_service.cc:1511] Processing CreateTablet for tablet b449377349514576874b6c295ead5e9a (DEFAULT_TABLE table=default.Table_d310fa96aa3e455590195ac9bf3b4825 [id=147b038d3de54c8d85e666747153cb7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.783056 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b449377349514576874b6c295ead5e9a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:37.789256 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 64e93928dcb94ae296590c4dedfd1781 has no consensus state
I20260810 13:53:37.796700 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b0ffad7efc24519957f2fb3be945b7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:37.803251 13640 ts_tablet_manager.cc:1434] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.091s user 0.010s sys 0.002s
I20260810 13:53:37.804138 12747 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]). Expected version 1 got 0
I20260810 13:53:37.805106 12747 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 1 got 0
I20260810 13:53:37.806399 14196 tablet.cc:1724] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 13:53:37.810201 14200 log.cc:927] Time spent T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.110s user 0.001s sys 0.000s
I20260810 13:53:37.817484 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 00a7bce2378f482d81d2ad08e9d15b0c (DEFAULT_TABLE table=default.Table_750e154b9a7a4141baa6de859c042732 [id=6e90d1effcf2446982739abe04249eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.819789 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a7bce2378f482d81d2ad08e9d15b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.843189 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]). Expected version 1 got 0
I20260810 13:53:37.781657 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 00a7bce2378f482d81d2ad08e9d15b0c (DEFAULT_TABLE table=default.Table_750e154b9a7a4141baa6de859c042732 [id=6e90d1effcf2446982739abe04249eee]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:37.844053 13164 leader_election.cc:343] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 956e50a9d2ff4af39a349bd93c48f7d9
I20260810 13:53:37.844750 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a7bce2378f482d81d2ad08e9d15b0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.844615 13164 leader_election.cc:304] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:37.847944 14065 raft_consensus.cc:2749] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:37.822966 14172 raft_consensus.cc:515] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.854255 14172 leader_election.cc:290] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:37.838682 13429 tablet_service.cc:1511] Processing CreateTablet for tablet b449377349514576874b6c295ead5e9a (DEFAULT_TABLE table=default.Table_d310fa96aa3e455590195ac9bf3b4825 [id=147b038d3de54c8d85e666747153cb7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:37.855264 13638 tablet_bootstrap.cc:492] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:37.855733 13638 ts_tablet_manager.cc:1403] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.697s user 0.020s sys 0.000s
I20260810 13:53:37.856132 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b449377349514576874b6c295ead5e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:37.860335 13638 raft_consensus.cc:359] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:37.880548 13638 raft_consensus.cc:385] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:37.880963 13638 raft_consensus.cc:740] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:37.887768 13639 ts_tablet_manager.cc:1434] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.510s user 0.008s sys 0.001s
W20260810 13:53:37.888170 13639 ts_tablet_manager.cc:1467] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3: Tablet startup took 510ms
W20260810 13:53:37.888444 13639 ts_tablet_manager.cc:1469] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3: Trace:
0810 13:53:28.705332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:28.714058 (+ 8726us) service_pool.cc:224] Handling call
0810 13:53:28.818584 (+104526us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:28.821151 (+ 2567us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:29.443566 (+622415us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:29.639007 (+195441us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:29.652163 (+ 13156us) inbound_call.cc:177] Queueing success response
0810 13:53:36.750100 (+7097937us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:53:37.377969 (+627869us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:53:37.378562 (+ 593us) tablet_replica.cc:261] Starting instrumentation
0810 13:53:37.379034 (+ 472us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":12765,"raft.queue_time_us":20299,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":243,"tablet-open.queue_time_us":7097975}
I20260810 13:53:37.890915 13639 tablet_bootstrap.cc:492] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:37.901575 13638 consensus_queue.cc:260] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:37.910104 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 4b0ffad7efc24519957f2fb3be945b7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b0ffad7efc24519957f2fb3be945b7d already in progress: creating tablet
W20260810 13:53:37.910833 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 07ff9e8a8ca845b89154ed0626d34c5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07ff9e8a8ca845b89154ed0626d34c5c already in progress: creating tablet
I20260810 13:53:37.928750 13640 tablet_bootstrap.cc:492] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:37.950001 13640 tablet_bootstrap.cc:654] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:37.950796 13638 ts_tablet_manager.cc:1434] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.095s user 0.008s sys 0.000s
I20260810 13:53:37.959190 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0800a52ff0f34efd9541454eb4ecbf4c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:37.960145 13269 raft_consensus.cc:3060] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:37.906036 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:37.912011 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0800a52ff0f34efd9541454eb4ecbf4c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:37.989029 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 0800a52ff0f34efd9541454eb4ecbf4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:37.989867 13986 tablet_replica.cc:333] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:37.990686 13986 raft_consensus.cc:2243] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:37.991133 13986 raft_consensus.cc:2272] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:37.991254 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f1d421b3f5d24a3c8e327158f173e218"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:37.992908 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1d421b3f5d24a3c8e327158f173e218 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:37.995909 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_cb09b1a8472e4349bbbac0669af3d045" } modify_external_catalogs: true
I20260810 13:53:37.996372 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_cb09b1a8472e4349bbbac0669af3d045" } modify_external_catalogs: true
I20260810 13:53:37.999707 13986 ts_tablet_manager.cc:1916] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:38.003872 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_900358de324449a0b42140427aef559b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:38.005568 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_900358de324449a0b42140427aef559b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:38.006326 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9b5c5b4c45b147b2bf013c380d097db7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:38.007799 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b5c5b4c45b147b2bf013c380d097db7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:38.015436 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_856c6384b7c04d27bfcbcdd38d5ccb4d" } new_table_name: "default.Table_839f7239fe6c416ba32bb1fe17bfdda9" modify_external_catalogs: true
I20260810 13:53:38.020159 14204 tablet.cc:1724] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:38.028971 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_81b4a7eba14c4cc4835272fbaf08f02a" } modify_external_catalogs: true
W20260810 13:53:38.029402 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 43709.2us
I20260810 13:53:37.909264 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:38.029711 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_81b4a7eba14c4cc4835272fbaf08f02a" } modify_external_catalogs: true
I20260810 13:53:38.029986 13382 leader_election.cc:304] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:38.030735 13638 tablet_bootstrap.cc:492] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:38.030690 14108 raft_consensus.cc:2804] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:38.031276 14108 raft_consensus.cc:697] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:38.039059 13261 raft_consensus.cc:2468] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:38.032485 14108 consensus_queue.cc:237] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.056921 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 1108f64f1260448b8a68ea9fe30ea494 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:38.061573 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5a8f2e65e00343b594afce9f25120ab4" } new_table_name: "default.Table_2750add756654c54aaf63edfb3f51b3c" modify_external_catalogs: true
I20260810 13:53:38.068238 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b2ca1dc6dae5408e9a741e48f3afd33c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:38.075644 13382 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:38.076576 14169 raft_consensus.cc:2804] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:38.077203 14169 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:38.077759 14169 raft_consensus.cc:3060] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:38.081120 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2ca1dc6dae5408e9a741e48f3afd33c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:38.112416 13382 leader_election.cc:343] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.032259 14206 tablet.cc:1724] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 13:53:38.118682 13382 leader_election.cc:343] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:38.119402 13382 consensus_peers.cc:597] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:38.127192 13986 ts_tablet_manager.cc:1929] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:38.127591 13986 log.cc:1199] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/0800a52ff0f34efd9541454eb4ecbf4c
I20260810 13:53:38.128243 13986 ts_tablet_manager.cc:1950] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:38.132143 14172 consensus_queue.cc:1048] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:38.137688 14185 tablet.cc:1724] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:38.154006 13269 raft_consensus.cc:2468] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:38.167521 13640 tablet_bootstrap.cc:492] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:38.167960 13640 ts_tablet_manager.cc:1403] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.239s user 0.011s sys 0.011s
I20260810 13:53:38.169341 14169 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.174002 12750 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396] alter complete (version 1)
W20260810 13:53:38.181941 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 155846us
W20260810 13:53:38.189117 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 47980.9us
I20260810 13:53:38.192106 13382 leader_election.cc:304] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:38.192762 13382 raft_consensus.cc:2686] T 0800a52ff0f34efd9541454eb4ecbf4c P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:38.193488 13056 raft_consensus.cc:3060] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:38.200037 14125 ts_tablet_manager.cc:1929] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:38.200424 14125 log.cc:1199] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/266e949bbf6d4a558d73e3cb2efec490
I20260810 13:53:38.200851 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:38.201143 14125 ts_tablet_manager.cc:1950] T 266e949bbf6d4a558d73e3cb2efec490 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:38.204572 13640 raft_consensus.cc:359] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.205295 13640 raft_consensus.cc:385] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.205205 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 0800a52ff0f34efd9541454eb4ecbf4c (table default.Table_0682d4d59c234e6f8c2e1f986ec9796e [id=6ebba3be39a64bc6a44e31673adb90df]) successfully deleted
I20260810 13:53:38.205566 13640 raft_consensus.cc:740] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.206462 14169 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:38.232780 13640 consensus_queue.cc:260] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.242821 13639 tablet_bootstrap.cc:654] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.245445 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 266e949bbf6d4a558d73e3cb2efec490 (table default.Table_f688a5d2568d4835bc32eb6cc9533ef9 [id=539325ee3b9c41609568f2e02f54dc02]) successfully deleted
W20260810 13:53:38.247444 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 07ff9e8a8ca845b89154ed0626d34c5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07ff9e8a8ca845b89154ed0626d34c5c already in progress: creating tablet
I20260810 13:53:38.247872 13640 ts_tablet_manager.cc:1434] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.080s user 0.008s sys 0.000s
W20260810 13:53:38.249405 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 4b0ffad7efc24519957f2fb3be945b7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b0ffad7efc24519957f2fb3be945b7d already in progress: creating tablet
I20260810 13:53:38.260474 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 1b84bd35b02f4a1faf15ac9bc21e6146
I20260810 13:53:38.263782 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 2d04860a72c64a5db966e2784c6dbbf0
I20260810 13:53:38.266396 13638 tablet_bootstrap.cc:654] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.266631 13640 tablet_bootstrap.cc:492] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:38.271622 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]). Expected version 1 got 0
I20260810 13:53:38.273928 13230 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:38.277601 13230 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:38.281589 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:38.282989 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:38.286165 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 2d04860a72c64a5db966e2784c6dbbf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d04860a72c64a5db966e2784c6dbbf0 already in progress: creating tablet
W20260810 13:53:38.288749 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b84bd35b02f4a1faf15ac9bc21e6146 already in progress: creating tablet
I20260810 13:53:38.296030 13640 tablet_bootstrap.cc:654] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.275606 14196 tablet.cc:1724] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:38.313627 13640 tablet_bootstrap.cc:492] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:38.314085 13640 ts_tablet_manager.cc:1403] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.048s user 0.013s sys 0.003s
I20260810 13:53:38.296167 13989 ts_tablet_manager.cc:1929] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:38.317421 13989 log.cc:1199] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/46c08ec290e447678084964c23a930ad
I20260810 13:53:38.318746 13989 ts_tablet_manager.cc:1950] T 46c08ec290e447678084964c23a930ad P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:38.324187 13640 raft_consensus.cc:359] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.325577 13640 raft_consensus.cc:385] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.325881 13640 raft_consensus.cc:740] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.326623 13640 consensus_queue.cc:260] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.346678 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:38.347519 13261 raft_consensus.cc:3060] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:38.349651 13640 ts_tablet_manager.cc:1434] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.035s user 0.007s sys 0.002s
I20260810 13:53:38.363538 13640 tablet_bootstrap.cc:492] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:38.364769 14169 raft_consensus.cc:493] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:38.365242 14169 raft_consensus.cc:515] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.367506 14169 leader_election.cc:290] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:38.369513 13640 tablet_bootstrap.cc:654] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.376673 13639 tablet_bootstrap.cc:492] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:38.377250 13639 ts_tablet_manager.cc:1403] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.487s user 0.012s sys 0.002s
I20260810 13:53:38.379823 13639 raft_consensus.cc:359] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.381950 13640 tablet_bootstrap.cc:492] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:38.382371 13640 ts_tablet_manager.cc:1403] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.007s
I20260810 13:53:38.385250 13640 raft_consensus.cc:359] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.385911 13640 raft_consensus.cc:385] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.386176 13640 raft_consensus.cc:740] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.386782 13640 consensus_queue.cc:260] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.400655 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:38.402531 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:38.404500 13382 leader_election.cc:343] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.412727 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607]). Expected version 2 got 0
W20260810 13:53:38.428318 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef59f7013ab4489dadd9084d065533a8 consensus state has no leader
I20260810 13:53:38.421885 13640 ts_tablet_manager.cc:1434] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.034s user 0.008s sys 0.000s
I20260810 13:53:38.438433 13640 tablet_bootstrap.cc:492] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:38.444912 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 129) took 2875 ms. Trace:
I20260810 13:53:38.445386 13989 rpcz_store.cc:276] 0810 13:53:35.569117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.569262 (+ 145us) service_pool.cc:224] Handling call
0810 13:53:37.165968 (+1596706us) ts_tablet_manager.cc:1151] Deleting tablet 46c08ec290e447678084964c23a930ad
0810 13:53:37.166010 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:37.839654 (+673644us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:38.279115 (+439461us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:38.444836 (+165721us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1576742}
I20260810 13:53:38.447031 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 46c08ec290e447678084964c23a930ad (table default.Table_19de196adf7f448b9beee85f7221ea70 [id=b560a46577fe4470bc512466f972a18c]) successfully deleted
I20260810 13:53:38.447999 13989 tablet_replica.cc:333] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:38.449242 13640 tablet_bootstrap.cc:654] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:38.450727 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 64e93928dcb94ae296590c4dedfd1781 (table default.Table_fbe0f651fe2e4328b7e2a126d989afab [id=da2f9e6861694d889e45f1fc34a63469], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 64e93928dcb94ae296590c4dedfd1781 has no consensus state
I20260810 13:53:38.454552 13989 raft_consensus.cc:2243] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:38.455294 13989 raft_consensus.cc:2272] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:38.456944 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 52484.5us
I20260810 13:53:38.462481 13639 raft_consensus.cc:385] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.462991 13639 raft_consensus.cc:740] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.363495 13261 raft_consensus.cc:2468] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:38.470665 12749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_57aa5df7d41e490da1c7f3cbbf615728" } modify_external_catalogs: true
I20260810 13:53:38.471177 12749 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_57aa5df7d41e490da1c7f3cbbf615728" } modify_external_catalogs: true
I20260810 13:53:38.465092 13989 ts_tablet_manager.cc:1916] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:38.474048 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b857cf97c0244ef4be73f17e0a30fa3c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:38.476169 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b857cf97c0244ef4be73f17e0a30fa3c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:38.476559 12739 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f1d421b3f5d24a3c8e327158f173e218" } modify_external_catalogs: true
I20260810 13:53:38.477063 12739 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f1d421b3f5d24a3c8e327158f173e218" } modify_external_catalogs: true
I20260810 13:53:38.481362 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ad168069ee724269847a89933edb81f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:38.482887 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad168069ee724269847a89933edb81f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:38.486634 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b84bd35b02f4a1faf15ac9bc21e6146 already in progress: creating tablet
I20260810 13:53:38.486445 14193 tablet.cc:1724] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 13:53:38.487257 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 2d04860a72c64a5db966e2784c6dbbf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d04860a72c64a5db966e2784c6dbbf0 already in progress: creating tablet
I20260810 13:53:38.488299 13639 consensus_queue.cc:260] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.494410 13640 tablet_bootstrap.cc:492] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:38.494808 13640 ts_tablet_manager.cc:1403] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.001s
I20260810 13:53:38.497361 13639 ts_tablet_manager.cc:1434] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.120s user 0.006s sys 0.000s
I20260810 13:53:38.499716 13639 tablet_bootstrap.cc:492] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:38.509414 13382 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:38.510802 13382 leader_election.cc:343] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.511068 14172 raft_consensus.cc:2804] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:38.511516 14172 raft_consensus.cc:697] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:38.512243 14172 consensus_queue.cc:237] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:38.513978 13382 leader_election.cc:343] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.518514 14065 raft_consensus.cc:493] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:38.519753 14065 raft_consensus.cc:515] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.533911 14065 leader_election.cc:290] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:38.544088 13638 tablet_bootstrap.cc:492] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:38.544557 13638 ts_tablet_manager.cc:1403] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.517s user 0.014s sys 0.004s
I20260810 13:53:38.547247 13638 raft_consensus.cc:359] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.547937 13638 raft_consensus.cc:385] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.548236 13638 raft_consensus.cc:740] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.549021 13638 consensus_queue.cc:260] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.554911 13382 leader_election.cc:304] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:38.555596 14168 raft_consensus.cc:2749] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:38.557348 13638 ts_tablet_manager.cc:1434] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260810 13:53:38.564630 13638 tablet_bootstrap.cc:492] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:38.578127 14172 raft_consensus.cc:493] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:38.578354 13640 raft_consensus.cc:359] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.578627 14172 raft_consensus.cc:515] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.579205 13640 raft_consensus.cc:385] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.579793 13640 raft_consensus.cc:740] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.580610 14172 leader_election.cc:290] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:38.580462 13640 consensus_queue.cc:260] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.583774 13638 tablet_bootstrap.cc:654] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.584255 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1108f64f1260448b8a68ea9fe30ea494" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:38.590090 13640 ts_tablet_manager.cc:1434] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.095s user 0.004s sys 0.004s
I20260810 13:53:38.590956 13640 tablet_bootstrap.cc:492] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:38.600523 12750 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_37e74959a9924be883b2b657294728be [id=5c116d56fd00422f80495064d32a7f4e] alter complete (version 2)
W20260810 13:53:38.602345 12750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 45) took 809 ms (client timeout 1000 ms). Trace:
I20260810 13:53:38.603787 12739 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 6305977dafba4059945c679ab94e2f85
I20260810 13:53:38.605806 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1108f64f1260448b8a68ea9fe30ea494" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:38.609531 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fde3bf9c44ccb18087a7bd64e435" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:38.602803 12750 rpcz_store.cc:269] 0810 13:53:37.792666 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:37.792858 (+ 192us) service_pool.cc:224] Handling call
0810 13:53:38.602284 (+809426us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:37.871191 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:37.871595 (+ 404us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:37.871620 (+ 25us) write_op.cc:435] Acquired schema lock
0810 13:53:37.871633 (+ 13us) tablet.cc:662] Decoding operations
0810 13:53:37.871883 (+ 250us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:37.871923 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:37.871944 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:37.872088 (+ 144us) tablet.cc:701] Row locks acquired
0810 13:53:37.872102 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:37.872231 (+ 129us) write_op.cc:270] Start()
0810 13:53:37.872313 (+ 82us) write_op.cc:276] Timestamp: P: 1786370017872146 usec, L: 0
0810 13:53:37.872330 (+ 17us) op_driver.cc:348] REPLICATION: starting
0810 13:53:37.986505 (+114175us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400010a98. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6f2fc964 00007fec6e512d19 00007fec6e4cea01 00007fec6e4ce6da 00007fec6e552d45 00007fec6e5531e9 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319
0810 13:53:37.986806 (+ 301us) log.cc:844] Serialized 356 byte log entry
0810 13:53:38.159913 (+173107us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b58000503d0. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e4b181c 00007fec6e4b8133 00007fec6e4b80b9 00007fec6e4b8049 00007fec6e4b8011 00007fec6e4b71dd 00000000005bd8c4 00000000005bd6f9 00007fec673f1db5 00007fec673f4121
0810 13:53:38.170962 (+ 11049us) op_driver.cc:464] REPLICATION: finished
0810 13:53:38.171468 (+ 506us) write_op.cc:301] APPLY: starting
0810 13:53:38.171560 (+ 92us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:38.171780 (+ 220us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:38.171827 (+ 47us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:38.172118 (+ 291us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:38.172465 (+ 347us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:38.172538 (+ 73us) write_op.cc:312] APPLY: finished
0810 13:53:38.172860 (+ 322us) log.cc:844] Serialized 23 byte log entry
0810 13:53:38.173159 (+ 299us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:38.173284 (+ 125us) write_op.cc:454] Released schema lock
0810 13:53:38.173348 (+ 64us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 13:53:38.487799 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:38.488175 (+ 376us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:38.488196 (+ 21us) write_op.cc:435] Acquired schema lock
0810 13:53:38.488207 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:38.488447 (+ 240us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:38.488483 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:38.488504 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:38.488643 (+ 139us) tablet.cc:701] Row locks acquired
0810 13:53:38.488656 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:53:38.488791 (+ 135us) write_op.cc:270] Start()
0810 13:53:38.488878 (+ 87us) write_op.cc:276] Timestamp: P: 1786370018488753 usec, L: 0
0810 13:53:38.488895 (+ 17us) op_driver.cc:348] REPLICATION: starting
0810 13:53:38.489334 (+ 439us) log.cc:844] Serialized 356 byte log entry
0810 13:53:38.595660 (+106326us) op_driver.cc:464] REPLICATION: finished
0810 13:53:38.596557 (+ 897us) write_op.cc:301] APPLY: starting
0810 13:53:38.596612 (+ 55us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:38.596733 (+ 121us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:38.596828 (+ 95us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:38.596955 (+ 127us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:38.597087 (+ 132us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:38.597129 (+ 42us) write_op.cc:312] APPLY: finished
0810 13:53:38.597283 (+ 154us) log.cc:844] Serialized 23 byte log entry
0810 13:53:38.597388 (+ 105us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:38.597440 (+ 52us) write_op.cc:454] Released schema lock
0810 13:53:38.597468 (+ 28us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:38.597687 (+ 219us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:38.597728 (+ 41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":240,"apply.run_cpu_time_us":2239,"apply.run_wall_time_us":2238,"num_ops":1,"prepare.queue_time_us":60468,"prepare.run_cpu_time_us":3858,"prepare.run_wall_time_us":116019,"raft.queue_time_us":3733,"raft.run_cpu_time_us":4023,"raft.run_wall_time_us":172421,"replication_time_us":298363,"spinlock_wait_cycles":650672768}],["op",{"apply.queue_time_us":759,"apply.run_cpu_time_us":1098,"apply.run_wall_time_us":1098,"num_ops":1,"prepare.queue_time_us":311101,"prepare.run_cpu_time_us":1727,"prepare.run_wall_time_us":1727,"replication_time_us":106689}]]}
W20260810 13:53:38.600522 12747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 36) took 1050 ms (client timeout 1000 ms). Trace:
W20260810 13:53:38.614904 12747 rpcz_store.cc:269] 0810 13:53:37.549830 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:37.565238 (+ 15408us) service_pool.cc:224] Handling call
0810 13:53:37.801069 (+235831us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:38.600450 (+799381us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":538974592}
I20260810 13:53:38.625540 13639 tablet_bootstrap.cc:654] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.638921 12432 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
/tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.36.61:35861
--webserver_interface=127.12.36.61
--webserver_port=36613
--builtin_ntp_servers=127.12.36.20:41503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260810 13:53:38.588346 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fde3bf9c44ccb18087a7bd64e435" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:38.595408 13164 leader_election.cc:343] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:38.642829 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47458us
W20260810 13:53:38.643751 13167 leader_election.cc:343] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.645546 13167 leader_election.cc:304] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:38.645628 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5d42b950252445e0bf75ab4e88f08ff5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:38.647200 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d42b950252445e0bf75ab4e88f08ff5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:38.649875 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6076d5112f5c4c6096f5bb41abee7ff1" } new_table_name: "default.Table_e88a2434008d41cfbcd95faf0a6ebb94" modify_external_catalogs: true
I20260810 13:53:38.651695 14065 raft_consensus.cc:2749] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:38.653070 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_38574d5b763c4a5197c7431ebb1bac4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:38.654870 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38574d5b763c4a5197c7431ebb1bac4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:38.639945 13989 ts_tablet_manager.cc:1929] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 13:53:38.669711 13382 leader_election.cc:343] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:38.673354 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 58195.6us
I20260810 13:53:38.674082 13989 log.cc:1199] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/d2cf90601bf4424aa6dc009415af8db6
I20260810 13:53:38.676438 14185 tablet.cc:1724] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:38.677975 14146 raft_consensus.cc:493] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:38.678416 14146 raft_consensus.cc:515] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.680243 14146 leader_election.cc:290] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:38.686712 13382 leader_election.cc:343] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.687054 13382 leader_election.cc:304] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:38.687513 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307a6b609b674afbb684147005b66d87" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:38.687685 14172 raft_consensus.cc:2749] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:38.691565 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307a6b609b674afbb684147005b66d87" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:38.699824 14196 tablet.cc:1724] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 13:53:38.700634 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b54b73458a4c4201bc3b44259bc12436 consensus state has no leader
W20260810 13:53:38.713729 13382 leader_election.cc:343] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.720146 13640 tablet_bootstrap.cc:654] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:38.721958 13382 leader_election.cc:343] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.724648 13382 leader_election.cc:304] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:38.728627 13989 ts_tablet_manager.cc:1950] T d2cf90601bf4424aa6dc009415af8db6 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:38.730605 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 131) took 3025 ms. Trace:
I20260810 13:53:38.730970 13989 rpcz_store.cc:276] 0810 13:53:35.705556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:35.705670 (+ 114us) service_pool.cc:224] Handling call
0810 13:53:38.447839 (+2742169us) ts_tablet_manager.cc:1151] Deleting tablet d2cf90601bf4424aa6dc009415af8db6
0810 13:53:38.447887 (+ 48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:38.539765 (+ 91878us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:38.639781 (+100016us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:38.730543 (+ 90762us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2741585}
I20260810 13:53:38.732095 13989 tablet_replica.cc:333] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:38.732427 13639 tablet_bootstrap.cc:492] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:38.732340 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet d2cf90601bf4424aa6dc009415af8db6 (table default.Table_61931e1060bf4fe3bb18256035837a88 [id=be32b50a9d45438b86b5ab8bca95243c]) successfully deleted
I20260810 13:53:38.732414 14168 raft_consensus.cc:2749] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:38.732997 13989 raft_consensus.cc:2243] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:38.733189 13639 ts_tablet_manager.cc:1403] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.234s user 0.013s sys 0.000s
I20260810 13:53:38.733484 13989 raft_consensus.cc:2272] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:38.743767 13989 ts_tablet_manager.cc:1916] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:38.756122 14185 tablet.cc:1719] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6: Skipping requested alter to schema version 2, tablet already version 2
I20260810 13:53:38.756711 13638 tablet_bootstrap.cc:492] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:38.769236 13638 ts_tablet_manager.cc:1403] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.205s user 0.010s sys 0.020s
I20260810 13:53:38.768800 13639 raft_consensus.cc:359] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.769819 13639 raft_consensus.cc:385] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.770147 13639 raft_consensus.cc:740] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.771711 13638 raft_consensus.cc:359] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.772300 13638 raft_consensus.cc:385] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.772537 13638 raft_consensus.cc:740] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.775898 13638 consensus_queue.cc:260] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.788094 13638 ts_tablet_manager.cc:1434] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.019s user 0.003s sys 0.002s
I20260810 13:53:38.791101 13638 tablet_bootstrap.cc:492] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:38.800185 13639 consensus_queue.cc:260] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.801107 14196 tablet.cc:1719] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb: Skipping requested alter to schema version 2, tablet already version 2
I20260810 13:53:38.803469 13638 tablet_bootstrap.cc:654] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.805694 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ec423adb7aa7471f9b6fb9752fb6861e" } new_table_name: "default.Table_3d1b1152401f41e39045b7afa5c9ac5d" modify_external_catalogs: true
I20260810 13:53:38.806217 13639 ts_tablet_manager.cc:1434] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.073s user 0.004s sys 0.004s
I20260810 13:53:38.807588 13639 tablet_bootstrap.cc:492] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:38.817896 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5306ac6359cd4033b2c54ad5db69828c" } modify_external_catalogs: true
I20260810 13:53:38.818424 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5306ac6359cd4033b2c54ad5db69828c" } modify_external_catalogs: true
I20260810 13:53:38.823227 14108 raft_consensus.cc:493] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:38.823398 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_866916d7d8234bcb8dfc9bff54ada066"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:38.823657 14108 raft_consensus.cc:515] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.825500 14108 leader_election.cc:290] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:38.825855 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_866916d7d8234bcb8dfc9bff54ada066 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:38.827732 13640 tablet_bootstrap.cc:492] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:38.828117 13640 ts_tablet_manager.cc:1403] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.237s user 0.004s sys 0.012s
I20260810 13:53:38.829950 14185 tablet.cc:1724] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:38.830137 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_57a088306e614a01aa3e18ad8ab5c91c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:38.831593 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_57a088306e614a01aa3e18ad8ab5c91c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:38.830538 13640 raft_consensus.cc:359] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.833117 13640 raft_consensus.cc:385] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.833364 13640 raft_consensus.cc:740] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:53:38.833683 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17df06cad1404d96bda5822be6a6e995 consensus state has no leader
I20260810 13:53:38.833909 13640 consensus_queue.cc:260] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.837617 13640 ts_tablet_manager.cc:1434] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.009s user 0.005s sys 0.002s
I20260810 13:53:38.839697 13640 tablet_bootstrap.cc:492] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:38.843076 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:38.845767 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:38.850405 13640 tablet_bootstrap.cc:654] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.853551 14196 tablet.cc:1724] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:38.876272 14193 tablet.cc:1724] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 13:53:38.893812 13382 leader_election.cc:343] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:38.913791 13382 leader_election.cc:343] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.914342 13382 leader_election.cc:304] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:38.915311 14108 raft_consensus.cc:2749] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:38.922732 13638 tablet_bootstrap.cc:492] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:38.923156 13638 ts_tablet_manager.cc:1403] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.132s user 0.013s sys 0.009s
I20260810 13:53:38.925944 13638 raft_consensus.cc:359] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.926580 13638 raft_consensus.cc:385] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:38.926854 13638 raft_consensus.cc:740] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.927495 13638 consensus_queue.cc:260] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.930641 13056 raft_consensus.cc:3060] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:38.930999 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_965e8f5a4e8e4157ba58581ac36802d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:38.932328 13638 ts_tablet_manager.cc:1434] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260810 13:53:38.932778 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d283456f26db4b0ba1923f3730dac318" } new_table_name: "default.Table_815335f73b844dffae6ce956bc049c96" modify_external_catalogs: true
I20260810 13:53:38.934969 13638 tablet_bootstrap.cc:492] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:38.936105 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6defacc9cc904ccf847ba25f0234e97c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:38.951834 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5dac7ad18d3c4fb58171ff8ab959d98a consensus state has no leader
I20260810 13:53:38.958514 13638 tablet_bootstrap.cc:654] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.900585 13639 tablet_bootstrap.cc:654] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:38.966235 14108 raft_consensus.cc:493] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:38.966682 14108 raft_consensus.cc:515] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.968739 14108 leader_election.cc:290] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:38.971163 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0ffad7efc24519957f2fb3be945b7d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:38.973155 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0ffad7efc24519957f2fb3be945b7d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:38.974756 13382 leader_election.cc:343] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:38.976235 13382 leader_election.cc:343] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:38.977054 13382 leader_election.cc:304] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:38.978156 14108 raft_consensus.cc:2749] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:38.978168 13640 tablet_bootstrap.cc:492] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:38.980657 13640 ts_tablet_manager.cc:1403] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.141s user 0.011s sys 0.001s
W20260810 13:53:38.983395 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6defacc9cc904ccf847ba25f0234e97c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:38.969465 13989 ts_tablet_manager.cc:1929] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:38.985351 13989 log.cc:1199] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/0800a52ff0f34efd9541454eb4ecbf4c
I20260810 13:53:38.986603 13989 ts_tablet_manager.cc:1950] T 0800a52ff0f34efd9541454eb4ecbf4c P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:38.983417 13640 raft_consensus.cc:359] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:38.987588 13640 raft_consensus.cc:385] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:53:38.987583 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_965e8f5a4e8e4157ba58581ac36802d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:38.990094 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 136) took 2924 ms. Trace:
I20260810 13:53:38.990584 13640 raft_consensus.cc:740] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:38.991458 13640 consensus_queue.cc:260] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.005980 13640 ts_tablet_manager.cc:1434] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.025s user 0.002s sys 0.004s
I20260810 13:53:39.006459 13989 rpcz_store.cc:276] 0810 13:53:36.065402 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:36.066733 (+ 1331us) service_pool.cc:224] Handling call
0810 13:53:38.731955 (+2665222us) ts_tablet_manager.cc:1151] Deleting tablet 0800a52ff0f34efd9541454eb4ecbf4c
0810 13:53:38.731995 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:38.887473 (+155478us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:38.969339 (+ 81866us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:38.990018 (+ 20679us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2614938}
I20260810 13:53:39.009099 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 138) took 2710 ms. Trace:
I20260810 13:53:39.011588 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 0800a52ff0f34efd9541454eb4ecbf4c (table default.Table_0682d4d59c234e6f8c2e1f986ec9796e [id=6ebba3be39a64bc6a44e31673adb90df]) successfully deleted
I20260810 13:53:39.021534 13640 tablet_bootstrap.cc:492] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:39.037281 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_434066270df645e9b8616951cfc588ba" } new_table_name: "default.Table_5b59b711a1d0406b978d28c419f8e4a5" modify_external_catalogs: true
I20260810 13:53:39.040393 13989 rpcz_store.cc:276] 0810 13:53:36.299263 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:36.299399 (+ 136us) service_pool.cc:224] Handling call
0810 13:53:39.008589 (+2709190us) ts_tablet_manager.cc:1151] Deleting tablet ee27d158bd40425a8c6fa8cb068daa79
0810 13:53:39.008650 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.009031 (+ 381us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2708461}
W20260810 13:53:39.046303 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ee27d158bd40425a8c6fa8cb068daa79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ee27d158bd40425a8c6fa8cb068daa79 already in progress: creating tablet
I20260810 13:53:39.046970 14193 tablet.cc:1724] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:39.053009 14108 raft_consensus.cc:493] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:39.053468 14108 raft_consensus.cc:515] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.055401 14108 leader_election.cc:290] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:39.058911 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435f585d225b492cb2b2e83fdb3a2b3d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:39.060456 13382 leader_election.cc:343] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:39.069002 12746 master_service.cc:960] ReplaceTablet: received request to replace tablet eaaa924290594d319b02526550416571 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:39.068238 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435f585d225b492cb2b2e83fdb3a2b3d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:39.072649 13382 leader_election.cc:343] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:39.073089 13382 leader_election.cc:304] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:39.073788 14168 raft_consensus.cc:2749] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:39.076802 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_34691af4c4ad46eb81e74d8394e253c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:39.078964 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34691af4c4ad46eb81e74d8394e253c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.045975 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 139) took 2689 ms. Trace:
I20260810 13:53:39.083927 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_71f0bf08f0c6412fa6b6e5037d57d8fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:39.081229 13989 rpcz_store.cc:276] 0810 13:53:36.356711 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:36.356823 (+ 112us) service_pool.cc:224] Handling call
0810 13:53:39.044515 (+2687692us) ts_tablet_manager.cc:1151] Deleting tablet eaaa924290594d319b02526550416571
0810 13:53:39.044672 (+ 157us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.045799 (+ 1127us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2686912}
W20260810 13:53:39.086215 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71f0bf08f0c6412fa6b6e5037d57d8fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.086413 13989 tablet_replica.cc:333] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:39.088627 14193 tablet.cc:1719] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3: Skipping requested alter to schema version 2, tablet already version 2
W20260810 13:53:39.089620 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet eaaa924290594d319b02526550416571 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eaaa924290594d319b02526550416571 already in progress: creating tablet
I20260810 13:53:39.090358 13989 raft_consensus.cc:2243] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:39.091058 13989 raft_consensus.cc:2272] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:39.093344 13989 ts_tablet_manager.cc:1916] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:39.094276 12739 master_service.cc:960] ReplaceTablet: received request to replace tablet c5f2e89d61854ee5bf6955b8244215eb from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:39.098011 13640 tablet_bootstrap.cc:654] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:39.111322 13639 tablet_bootstrap.cc:492] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:39.111826 13639 ts_tablet_manager.cc:1403] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.304s user 0.008s sys 0.004s
I20260810 13:53:39.114755 13639 raft_consensus.cc:359] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.115528 13639 raft_consensus.cc:385] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:39.115811 13639 raft_consensus.cc:740] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:39.120211 13638 tablet_bootstrap.cc:492] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:39.120739 13638 ts_tablet_manager.cc:1403] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.186s user 0.023s sys 0.009s
I20260810 13:53:39.123886 13638 raft_consensus.cc:359] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.124715 13638 raft_consensus.cc:385] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:39.124994 13638 raft_consensus.cc:740] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:39.125768 13638 consensus_queue.cc:260] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.137880 13639 consensus_queue.cc:260] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.159385 13989 ts_tablet_manager.cc:1929] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:39.159855 13989 log.cc:1199] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/956e50a9d2ff4af39a349bd93c48f7d9
I20260810 13:53:39.160226 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_603963be19d14370b9a5093b52e009f7" } new_table_name: "default.Table_6b195ecd5f17492f81064d6d53d8fde9" modify_external_catalogs: true
I20260810 13:53:39.160566 13989 ts_tablet_manager.cc:1950] T 956e50a9d2ff4af39a349bd93c48f7d9 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:39.162750 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 144) took 1964 ms. Trace:
I20260810 13:53:39.163137 13989 rpcz_store.cc:276] 0810 13:53:37.198798 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:37.202342 (+ 3544us) service_pool.cc:224] Handling call
0810 13:53:39.086181 (+1883839us) ts_tablet_manager.cc:1151] Deleting tablet 956e50a9d2ff4af39a349bd93c48f7d9
0810 13:53:39.086244 (+ 63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.151361 (+ 65117us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:39.159256 (+ 7895us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:39.162689 (+ 3433us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1883298}
W20260810 13:53:39.164666 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce consensus state has no leader
I20260810 13:53:39.173573 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 956e50a9d2ff4af39a349bd93c48f7d9 (table default.Table_3de1b4c6b1424eb0ab2183f39131ed74 [id=f800d0ffba7e47e6affc4f8527dfe445]) successfully deleted
I20260810 13:53:39.173723 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 146) took 1973 ms. Trace:
I20260810 13:53:39.174181 13989 rpcz_store.cc:276] 0810 13:53:37.199869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:37.202945 (+ 3076us) service_pool.cc:224] Handling call
0810 13:53:39.173207 (+1970262us) ts_tablet_manager.cc:1151] Deleting tablet f7afa380245248f5bac203b0905721c6
0810 13:53:39.173273 (+ 66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.173647 (+ 374us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1969789}
W20260810 13:53:39.175899 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet f7afa380245248f5bac203b0905721c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7afa380245248f5bac203b0905721c6 already in progress: creating tablet
I20260810 13:53:39.175851 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 147) took 1975 ms. Trace:
I20260810 13:53:39.176277 13989 rpcz_store.cc:276] 0810 13:53:37.200310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:37.385845 (+185535us) service_pool.cc:224] Handling call
0810 13:53:39.175400 (+1789555us) ts_tablet_manager.cc:1151] Deleting tablet eb5d7a695c694d1993c2d0c4d3127fca
0810 13:53:39.175461 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.175785 (+ 324us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1767327}
W20260810 13:53:39.177881 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet eb5d7a695c694d1993c2d0c4d3127fca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eb5d7a695c694d1993c2d0c4d3127fca already in progress: creating tablet
I20260810 13:53:39.177991 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 152) took 1486 ms. Trace:
I20260810 13:53:39.178426 13989 rpcz_store.cc:276] 0810 13:53:37.691857 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:37.692055 (+ 198us) service_pool.cc:224] Handling call
0810 13:53:39.177498 (+1485443us) ts_tablet_manager.cc:1151] Deleting tablet 4b0ffad7efc24519957f2fb3be945b7d
0810 13:53:39.177556 (+ 58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.177922 (+ 366us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1484872}
I20260810 13:53:39.163574 13638 ts_tablet_manager.cc:1434] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.043s user 0.006s sys 0.000s
W20260810 13:53:39.179937 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 4b0ffad7efc24519957f2fb3be945b7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4b0ffad7efc24519957f2fb3be945b7d already in progress: creating tablet
I20260810 13:53:39.165091 14146 consensus_queue.cc:1048] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260810 13:53:39.188091 13054 raft_consensus.cc:3060] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:39.192975 14146 raft_consensus.cc:493] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:39.193389 13639 ts_tablet_manager.cc:1434] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.081s user 0.006s sys 0.001s
I20260810 13:53:39.193408 14146 raft_consensus.cc:515] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.194298 13639 tablet_bootstrap.cc:492] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:39.195295 14146 leader_election.cc:290] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:39.196410 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:39.197167 13269 raft_consensus.cc:2468] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:39.197566 13638 tablet_bootstrap.cc:492] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:39.198447 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:39.199630 13382 leader_election.cc:304] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:39.200382 14146 raft_consensus.cc:2804] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:39.200767 14146 raft_consensus.cc:493] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:39.201146 14146 raft_consensus.cc:3060] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:39.201674 13382 leader_election.cc:343] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:39.213050 14131 raft_consensus.cc:493] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:39.213452 14131 raft_consensus.cc:515] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.215557 14131 leader_election.cc:290] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:39.217563 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ada39233e9421d9870565c73f2ee16" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:39.220031 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9ada39233e9421d9870565c73f2ee16" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:39.220885 14108 consensus_queue.cc:1048] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:39.221925 12951 leader_election.cc:304] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:39.222226 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1cc7e2bca3cc43cda9ace3f7194fc23e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:39.222853 14131 raft_consensus.cc:2749] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:53:39.223855 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cc7e2bca3cc43cda9ace3f7194fc23e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.226114 13639 tablet_bootstrap.cc:654] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:39.232786 13640 tablet_bootstrap.cc:492] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:39.233229 13640 ts_tablet_manager.cc:1403] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.212s user 0.020s sys 0.014s
I20260810 13:53:39.208483 14146 raft_consensus.cc:515] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.239795 13638 tablet_bootstrap.cc:654] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:39.241505 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:39.241580 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2a27c95d054b44dd84ede3639a6395c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:39.242810 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
W20260810 13:53:39.243036 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a27c95d054b44dd84ede3639a6395c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.243445 13269 raft_consensus.cc:3060] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:39.260555 13382 leader_election.cc:343] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:39.262323 14065 raft_consensus.cc:493] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:39.262912 14065 raft_consensus.cc:515] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.267508 14065 leader_election.cc:290] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:39.268013 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:39.180035 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 153) took 1484 ms. Trace:
I20260810 13:53:39.268810 13989 rpcz_store.cc:276] 0810 13:53:37.695565 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:37.695883 (+ 318us) service_pool.cc:224] Handling call
0810 13:53:39.179621 (+1483738us) ts_tablet_manager.cc:1151] Deleting tablet 07ff9e8a8ca845b89154ed0626d34c5c
0810 13:53:39.179675 (+ 54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.179970 (+ 295us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1483193}
W20260810 13:53:39.270298 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 07ff9e8a8ca845b89154ed0626d34c5c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07ff9e8a8ca845b89154ed0626d34c5c already in progress: creating tablet
W20260810 13:53:39.270210 13167 leader_election.cc:343] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:39.275895 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:39.277639 13164 leader_election.cc:343] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:39.278059 13164 leader_election.cc:304] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:39.279148 14065 raft_consensus.cc:2749] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:39.283383 14065 raft_consensus.cc:493] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:39.283893 14065 raft_consensus.cc:515] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.287626 13989 tablet_replica.cc:333] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:39.287420 14065 leader_election.cc:290] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:39.288371 13989 raft_consensus.cc:2243] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:39.288815 13989 raft_consensus.cc:2272] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:39.290477 13989 ts_tablet_manager.cc:1916] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:39.290171 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b857cf97c0244ef4be73f17e0a30fa3c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:39.292407 13167 leader_election.cc:343] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:39.297654 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b857cf97c0244ef4be73f17e0a30fa3c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:39.298538 13475 raft_consensus.cc:2468] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:53:39.300210 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4dea61b84b614ead8830873568f9b7c4 consensus state has no leader
I20260810 13:53:39.315308 13000 tablet_service.cc:1511] Processing CreateTablet for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 (DEFAULT_TABLE table=default.Table_f98c8ce886d84413a005fa4b80373027 [id=10e4d51c28b7401bbf53fdcf117f9e3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.318811 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_839f7239fe6c416ba32bb1fe17bfdda9 [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 2 got 1
I20260810 13:53:39.319409 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]). Expected version 1 got 0
I20260810 13:53:39.320218 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_71038e51b4474c5e9e8643d25c35a001 [id=5b919872756647048ea2e4fecbe78537]). Expected version 1 got 0
I20260810 13:53:39.322862 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bfb69a7ce74175b4f1f5f4db583aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.328908 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607]). Expected version 2 got 0
I20260810 13:53:39.329572 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_839f7239fe6c416ba32bb1fe17bfdda9 [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 2 got 1
I20260810 13:53:39.336076 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:39.337508 13164 leader_election.cc:304] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:39.336920 12740 catalog_manager.cc:5719] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:39.338903 14065 raft_consensus.cc:2804] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:39.338979 12740 catalog_manager.cc:5719] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:39.339486 14065 raft_consensus.cc:493] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:39.340164 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]). Expected version 1 got 0
I20260810 13:53:39.340118 14065 raft_consensus.cc:3060] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:39.347929 13429 tablet_service.cc:1511] Processing CreateTablet for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 (DEFAULT_TABLE table=default.Table_f98c8ce886d84413a005fa4b80373027 [id=10e4d51c28b7401bbf53fdcf117f9e3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.349488 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bfb69a7ce74175b4f1f5f4db583aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.353371 13238 tablet_service.cc:1511] Processing CreateTablet for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 (DEFAULT_TABLE table=default.Table_f98c8ce886d84413a005fa4b80373027 [id=10e4d51c28b7401bbf53fdcf117f9e3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.354420 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6bfb69a7ce74175b4f1f5f4db583aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.362558 14131 raft_consensus.cc:493] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:39.363498 14131 raft_consensus.cc:515] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.368088 14146 leader_election.cc:290] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:39.374591 12952 leader_election.cc:343] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 0800a52ff0f34efd9541454eb4ecbf4c
I20260810 13:53:39.379988 13019 tablet_service.cc:1511] Processing CreateTablet for tablet cb8aea1057f445a9b060d138952324ca (DEFAULT_TABLE table=default.Table_d447b3e1ee6a423dbe29ddad01c780b8 [id=bd6753e3ed074939b250f9fa448e47ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.380874 14131 leader_election.cc:290] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:39.382097 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8aea1057f445a9b060d138952324ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.390081 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:39.395020 13269 raft_consensus.cc:2468] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:39.398588 13230 tablet_service.cc:1511] Processing CreateTablet for tablet cb8aea1057f445a9b060d138952324ca (DEFAULT_TABLE table=default.Table_d447b3e1ee6a423dbe29ddad01c780b8 [id=bd6753e3ed074939b250f9fa448e47ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.281068 13640 raft_consensus.cc:359] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.400142 13640 raft_consensus.cc:385] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:39.400523 13640 raft_consensus.cc:740] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:39.403646 13018 tablet_service.cc:1511] Processing CreateTablet for tablet fe5796052fd94c1e8fce159a6a90830c (DEFAULT_TABLE table=default.Table_8583fd0d8b1043d8845a330710570a5b [id=ec8b097f455e4160a1aee6dc4866fc98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.404130 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_965e8f5a4e8e4157ba58581ac36802d0" } new_table_name: "default.Table_270fa13ea58646819bcf21cf12afc107" modify_external_catalogs: true
I20260810 13:53:39.405385 13230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8aea1057f445a9b060d138952324ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:39.405694 12951 leader_election.cc:343] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 0800a52ff0f34efd9541454eb4ecbf4c
I20260810 13:53:39.406227 12951 leader_election.cc:304] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:39.407677 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5796052fd94c1e8fce159a6a90830c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.411299 14131 raft_consensus.cc:2749] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:39.412645 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_fdebbaf3b87843e1b686fc556cfcda94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:39.414168 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fdebbaf3b87843e1b686fc556cfcda94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.417258 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c7eb242f15844cdebd526a6dee37d0ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:39.418678 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7eb242f15844cdebd526a6dee37d0ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.440889 13233 tablet_service.cc:1511] Processing CreateTablet for tablet fe5796052fd94c1e8fce159a6a90830c (DEFAULT_TABLE table=default.Table_8583fd0d8b1043d8845a330710570a5b [id=ec8b097f455e4160a1aee6dc4866fc98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.442080 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5796052fd94c1e8fce159a6a90830c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.457463 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 64e93928dcb94ae296590c4dedfd1781 (DEFAULT_TABLE table=default.Table_fbe0f651fe2e4328b7e2a126d989afab [id=da2f9e6861694d889e45f1fc34a63469]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.459007 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e93928dcb94ae296590c4dedfd1781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.401510 13640 consensus_queue.cc:260] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.430578 13430 tablet_service.cc:1511] Processing CreateTablet for tablet cb8aea1057f445a9b060d138952324ca (DEFAULT_TABLE table=default.Table_d447b3e1ee6a423dbe29ddad01c780b8 [id=bd6753e3ed074939b250f9fa448e47ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.461855 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8aea1057f445a9b060d138952324ca. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:39.462473 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 4dea61b84b614ead8830873568f9b7c4 (table default.Table_6b195ecd5f17492f81064d6d53d8fde9 [id=e4c6b90e139246beac835146660eb0ad], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4dea61b84b614ead8830873568f9b7c4 consensus state has no leader
W20260810 13:53:39.425246 14264 log.cc:927] Time spent T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.143s user 0.001s sys 0.000s
I20260810 13:53:39.485077 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 03c640dce5dd4fc8a49f07fb983c50eb
I20260810 13:53:39.489286 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 92ba87c833e5459884173b65fb5645b6
I20260810 13:53:39.491039 12749 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 236) took 1020 ms. Trace:
I20260810 13:53:39.495139 13638 tablet_bootstrap.cc:492] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:39.495452 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ba87c833e5459884173b65fb5645b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:39.495828 13638 ts_tablet_manager.cc:1403] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.298s user 0.000s sys 0.018s
I20260810 13:53:39.495970 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:39.498538 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ba87c833e5459884173b65fb5645b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:39.500434 13989 ts_tablet_manager.cc:1929] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:39.500847 13989 log.cc:1199] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/1108f64f1260448b8a68ea9fe30ea494
I20260810 13:53:39.501536 13989 ts_tablet_manager.cc:1950] T 1108f64f1260448b8a68ea9fe30ea494 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:39.501262 13638 raft_consensus.cc:359] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.502153 13638 raft_consensus.cc:385] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:39.502481 13638 raft_consensus.cc:740] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:39.491436 12749 rpcz_store.cc:276] 0810 13:53:38.470233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:38.470359 (+ 126us) service_pool.cc:224] Handling call
0810 13:53:38.471569 (+ 1210us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:38.472271 (+ 702us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:38.472424 (+ 153us) catalog_manager.cc:2850] Locking tablets
0810 13:53:39.315215 (+842791us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:39.488938 (+173723us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:39.489115 (+ 177us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:39.489205 (+ 90us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:39.490975 (+ 1770us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:39.429536 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:39.429914 (+ 378us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:39.429936 (+ 22us) write_op.cc:435] Acquired schema lock
0810 13:53:39.429947 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:39.430333 (+ 386us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:39.430367 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:39.430387 (+ 20us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:39.431124 (+ 737us) tablet.cc:701] Row locks acquired
0810 13:53:39.431137 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:53:39.431235 (+ 98us) write_op.cc:270] Start()
0810 13:53:39.431307 (+ 72us) write_op.cc:276] Timestamp: P: 1786370019431199 usec, L: 0
0810 13:53:39.431321 (+ 14us) op_driver.cc:348] REPLICATION: starting
0810 13:53:39.431978 (+ 657us) log.cc:844] Serialized 756 byte log entry
0810 13:53:39.479862 (+ 47884us) op_driver.cc:464] REPLICATION: finished
0810 13:53:39.482988 (+ 3126us) write_op.cc:301] APPLY: starting
0810 13:53:39.483110 (+ 122us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:39.483331 (+ 221us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:39.483470 (+ 139us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:39.483968 (+ 498us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:39.487817 (+ 3849us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:39.487897 (+ 80us) write_op.cc:312] APPLY: finished
0810 13:53:39.488167 (+ 270us) log.cc:844] Serialized 29 byte log entry
0810 13:53:39.488370 (+ 203us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:39.488472 (+ 102us) write_op.cc:454] Released schema lock
0810 13:53:39.488513 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2898,"apply.run_cpu_time_us":2364,"apply.run_wall_time_us":10155,"num_ops":2,"prepare.queue_time_us":112670,"prepare.run_cpu_time_us":2091,"prepare.run_wall_time_us":3725,"replication_time_us":48353}]]}
I20260810 13:53:39.510598 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_71f0bf08f0c6412fa6b6e5037d57d8fe" } new_table_name: "default.Table_cb722d2f9cb34e7895f9e8c6b3ea2249" modify_external_catalogs: true
W20260810 13:53:39.515060 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 03c640dce5dd4fc8a49f07fb983c50eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03c640dce5dd4fc8a49f07fb983c50eb already in progress: creating tablet
W20260810 13:53:39.518445 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 92ba87c833e5459884173b65fb5645b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92ba87c833e5459884173b65fb5645b6 already in progress: creating tablet
W20260810 13:53:39.524168 12744 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 37) took 893 ms (client timeout 1000 ms). Trace:
I20260810 13:53:39.524811 12750 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648] alter complete (version 1)
I20260810 13:53:39.525803 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 156) took 1476 ms. Trace:
W20260810 13:53:39.524499 12744 rpcz_store.cc:269] 0810 13:53:38.631557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:38.631768 (+ 211us) service_pool.cc:224] Handling call
0810 13:53:38.661364 (+ 29596us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:39.524107 (+862743us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":36907904}
I20260810 13:53:39.526183 13989 rpcz_store.cc:276] 0810 13:53:38.049714 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:38.056769 (+ 7055us) service_pool.cc:224] Handling call
0810 13:53:39.287470 (+1230701us) ts_tablet_manager.cc:1151] Deleting tablet 1108f64f1260448b8a68ea9fe30ea494
0810 13:53:39.287514 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.380199 (+ 92685us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:39.500245 (+120046us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:39.525732 (+ 25487us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1229861}
I20260810 13:53:39.527634 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 1108f64f1260448b8a68ea9fe30ea494 (table default.Table_339aa1d8438e452eb0447748597f32fb [id=444e5f8f6be54ddc8ec01e68ecb0e3c1]) successfully deleted
W20260810 13:53:39.529747 12750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 47) took 874 ms (client timeout 1000 ms). Trace:
I20260810 13:53:39.532652 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:39.537489 13640 ts_tablet_manager.cc:1434] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.304s user 0.006s sys 0.000s
I20260810 13:53:39.540401 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:39.541962 13640 tablet_bootstrap.cc:492] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:39.544523 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 157) took 1271 ms. Trace:
I20260810 13:53:39.544866 13989 rpcz_store.cc:276] 0810 13:53:38.273553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:38.273704 (+ 151us) service_pool.cc:224] Handling call
0810 13:53:39.544140 (+1270436us) ts_tablet_manager.cc:1151] Deleting tablet 1b84bd35b02f4a1faf15ac9bc21e6146
0810 13:53:39.544198 (+ 58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.544467 (+ 269us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1269540}
I20260810 13:53:39.549661 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a8e82044d7a5494cb551eb7ca19322fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:39.551599 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8e82044d7a5494cb551eb7ca19322fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.556116 13438 tablet_service.cc:1511] Processing CreateTablet for tablet fe5796052fd94c1e8fce159a6a90830c (DEFAULT_TABLE table=default.Table_8583fd0d8b1043d8845a330710570a5b [id=ec8b097f455e4160a1aee6dc4866fc98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.556923 13436 tablet_service.cc:1558] Processing DeleteTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:39.558034 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ba87c833e5459884173b65fb5645b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:39.560091 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5796052fd94c1e8fce159a6a90830c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:39.577346 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d78892783474b329e31bf2df7d2952c has no consensus state
I20260810 13:53:39.546066 13989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 158) took 1271 ms. Trace:
I20260810 13:53:39.581097 13989 rpcz_store.cc:276] 0810 13:53:38.275276 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:38.276728 (+ 1452us) service_pool.cc:224] Handling call
0810 13:53:39.545739 (+1269011us) ts_tablet_manager.cc:1151] Deleting tablet 2d04860a72c64a5db966e2784c6dbbf0
0810 13:53:39.545779 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:39.546015 (+ 236us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1267402}
I20260810 13:53:39.583271 13989 tablet_replica.cc:333] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
W20260810 13:53:39.585628 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1b84bd35b02f4a1faf15ac9bc21e6146 already in progress: creating tablet
W20260810 13:53:39.586390 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 2d04860a72c64a5db966e2784c6dbbf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d04860a72c64a5db966e2784c6dbbf0 already in progress: creating tablet
W20260810 13:53:39.587092 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 92ba87c833e5459884173b65fb5645b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92ba87c833e5459884173b65fb5645b6 already in progress: creating tablet
I20260810 13:53:39.570362 14065 raft_consensus.cc:515] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.595508 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b857cf97c0244ef4be73f17e0a30fa3c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:53:39.598688 13167 leader_election.cc:343] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:39.598949 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ac680b589bb24167b9765450ff434f90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:39.574532 13638 consensus_queue.cc:260] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.603528 13382 leader_election.cc:304] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:39.605518 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac680b589bb24167b9765450ff434f90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.618122 14065 leader_election.cc:290] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:39.619500 14146 raft_consensus.cc:2804] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:39.622128 14146 raft_consensus.cc:697] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:39.623858 14146 consensus_queue.cc:237] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:39.626447 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 03c640dce5dd4fc8a49f07fb983c50eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03c640dce5dd4fc8a49f07fb983c50eb already in progress: creating tablet
W20260810 13:53:39.627085 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 92ba87c833e5459884173b65fb5645b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92ba87c833e5459884173b65fb5645b6 already in progress: creating tablet
I20260810 13:53:39.627377 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]). Expected version 1 got 0
I20260810 13:53:39.633121 13989 raft_consensus.cc:2243] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 13:53:39.533437 12750 rpcz_store.cc:269] 0810 13:53:38.654963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:38.663895 (+ 8932us) service_pool.cc:224] Handling call
0810 13:53:39.529669 (+865774us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:39.433362 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:39.434848 (+ 1486us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:39.434871 (+ 23us) write_op.cc:435] Acquired schema lock
0810 13:53:39.434883 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:39.435109 (+ 226us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:39.435142 (+ 33us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:39.435162 (+ 20us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:39.435287 (+ 125us) tablet.cc:701] Row locks acquired
0810 13:53:39.435304 (+ 17us) write_op.cc:260] PREPARE: finished
0810 13:53:39.435416 (+ 112us) write_op.cc:270] Start()
0810 13:53:39.435507 (+ 91us) write_op.cc:276] Timestamp: P: 1786370019435372 usec, L: 0
0810 13:53:39.435523 (+ 16us) op_driver.cc:348] REPLICATION: starting
0810 13:53:39.474654 (+ 39131us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b5400010a20. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e4d4900 00007fec6e55df22 00007fec6e553347 00007fec6e553184 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1
0810 13:53:39.475256 (+ 602us) log.cc:844] Serialized 356 byte log entry
0810 13:53:39.514133 (+ 38877us) op_driver.cc:464] REPLICATION: finished
0810 13:53:39.517028 (+ 2895us) write_op.cc:301] APPLY: starting
0810 13:53:39.517176 (+ 148us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:39.517393 (+ 217us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:39.517446 (+ 53us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:39.517797 (+ 351us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:39.519698 (+ 1901us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:39.519828 (+ 130us) write_op.cc:312] APPLY: finished
0810 13:53:39.520213 (+ 385us) log.cc:844] Serialized 23 byte log entry
0810 13:53:39.521034 (+ 821us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:39.521124 (+ 90us) write_op.cc:454] Released schema lock
0810 13:53:39.521185 (+ 61us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":41111,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":2512,"apply.run_cpu_time_us":2487,"apply.run_wall_time_us":69324,"mutex_wait_us":65473,"num_ops":1,"prepare.queue_time_us":32398,"prepare.run_cpu_time_us":3148,"prepare.run_wall_time_us":42225,"raft.queue_time_us":168,"raft.run_cpu_time_us":1185,"raft.run_wall_time_us":5592,"replication_time_us":78458,"spinlock_wait_cycles":87547648}]]}
I20260810 13:53:39.649085 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b857cf97c0244ef4be73f17e0a30fa3c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:39.649978 13475 raft_consensus.cc:3060] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:39.650444 13638 ts_tablet_manager.cc:1434] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.154s user 0.002s sys 0.009s
I20260810 13:53:39.671552 13638 tablet_bootstrap.cc:492] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:39.675411 13639 tablet_bootstrap.cc:492] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:39.676036 13639 ts_tablet_manager.cc:1403] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.482s user 0.006s sys 0.004s
I20260810 13:53:39.678889 12743 master_service.cc:960] ReplaceTablet: received request to replace tablet f62023d553cd46cab920de44baa96eec from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:39.679484 13639 raft_consensus.cc:359] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.680127 13639 raft_consensus.cc:385] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:39.680886 13639 raft_consensus.cc:740] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:39.681278 13989 raft_consensus.cc:2272] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:39.681638 13639 consensus_queue.cc:260] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.684020 13639 ts_tablet_manager.cc:1434] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260810 13:53:39.688568 13639 tablet_bootstrap.cc:492] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:39.692970 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]). Expected version 1 got 0
I20260810 13:53:39.693928 13475 raft_consensus.cc:2468] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
W20260810 13:53:39.705018 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 56245.2us
I20260810 13:53:39.705842 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_815335f73b844dffae6ce956bc049c96 [id=9a3a9159f7634bc999c5c10834eb41d3]). Expected version 1 got 0
I20260810 13:53:39.705951 13164 leader_election.cc:304] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:39.706568 13164 raft_consensus.cc:2686] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:39.706663 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:39.711143 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 64e93928dcb94ae296590c4dedfd1781 (DEFAULT_TABLE table=default.Table_fbe0f651fe2e4328b7e2a126d989afab [id=da2f9e6861694d889e45f1fc34a63469]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.712287 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e93928dcb94ae296590c4dedfd1781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.712598 14172 consensus_queue.cc:1048] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:39.714423 13230 tablet_service.cc:1511] Processing CreateTablet for tablet 64e93928dcb94ae296590c4dedfd1781 (DEFAULT_TABLE table=default.Table_fbe0f651fe2e4328b7e2a126d989afab [id=da2f9e6861694d889e45f1fc34a63469]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.715060 13639 tablet_bootstrap.cc:654] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:39.716288 13230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e93928dcb94ae296590c4dedfd1781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.723425 13019 tablet_service.cc:1511] Processing CreateTablet for tablet a2a2e00edb244e54b04a511dd0e76c9f (DEFAULT_TABLE table=default.Table_5022f9898a2b4343b457ad28e07a933f [id=a31aa9b4d20f46b4bd283aca2d2b446c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.726326 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a2e00edb244e54b04a511dd0e76c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.726994 13989 ts_tablet_manager.cc:1916] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:39.730837 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6b195ecd5f17492f81064d6d53d8fde9" } modify_external_catalogs: true
I20260810 13:53:39.731482 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6b195ecd5f17492f81064d6d53d8fde9" } modify_external_catalogs: true
I20260810 13:53:39.733873 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_37e74959a9924be883b2b657294728be" } modify_external_catalogs: true
I20260810 13:53:39.734352 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_37e74959a9924be883b2b657294728be" } modify_external_catalogs: true
W20260810 13:53:39.736294 13382 consensus_peers.cc:597] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:39.680542 13640 tablet_bootstrap.cc:654] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:39.746192 13639 tablet_bootstrap.cc:492] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:39.746745 13639 ts_tablet_manager.cc:1403] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.058s user 0.008s sys 0.010s
I20260810 13:53:39.747612 14131 raft_consensus.cc:493] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:39.748195 14131 raft_consensus.cc:515] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:39.754767 12952 leader_election.cc:343] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: d2cf90601bf4424aa6dc009415af8db6
I20260810 13:53:39.751246 14131 leader_election.cc:290] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:39.760660 13639 raft_consensus.cc:359] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.761471 13639 raft_consensus.cc:385] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:39.761766 13639 raft_consensus.cc:740] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:39.762483 13639 consensus_queue.cc:260] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.764952 13639 ts_tablet_manager.cc:1434] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20260810 13:53:39.766021 13639 tablet_bootstrap.cc:492] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:39.790539 13639 tablet_bootstrap.cc:654] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:39.788477 12740 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607] alter complete (version 2)
I20260810 13:53:39.800379 13238 tablet_service.cc:1511] Processing CreateTablet for tablet a2a2e00edb244e54b04a511dd0e76c9f (DEFAULT_TABLE table=default.Table_5022f9898a2b4343b457ad28e07a933f [id=a31aa9b4d20f46b4bd283aca2d2b446c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.801514 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a2e00edb244e54b04a511dd0e76c9f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:39.801430 12951 leader_election.cc:343] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: d2cf90601bf4424aa6dc009415af8db6
I20260810 13:53:39.801831 12951 leader_election.cc:304] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:39.803596 13018 tablet_service.cc:1511] Processing CreateTablet for tablet b820c99b33264add8df5fd443981d0cc (DEFAULT_TABLE table=default.Table_b48c394590b6458487d9402067fc9889 [id=8169bbe19c43404bb723ba96fce6d27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.804962 14131 raft_consensus.cc:2749] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:39.804620 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b820c99b33264add8df5fd443981d0cc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:39.806212 12740 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 46) took 1088 ms (client timeout 1000 ms). Trace:
I20260810 13:53:39.818238 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:39.818337 13430 tablet_service.cc:1511] Processing CreateTablet for tablet a2a2e00edb244e54b04a511dd0e76c9f (DEFAULT_TABLE table=default.Table_5022f9898a2b4343b457ad28e07a933f [id=a31aa9b4d20f46b4bd283aca2d2b446c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.819492 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a2e00edb244e54b04a511dd0e76c9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.819571 14273 tablet_replica.cc:333] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:39.820739 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_bcd4624cfe8441918229192ed0a7d742" } new_table_name: "default.Table_670f5f1855c14840917ede9ad5abd859" modify_external_catalogs: true
I20260810 13:53:39.821125 14273 raft_consensus.cc:2243] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:39.822021 14273 raft_consensus.cc:2272] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:39.823954 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8600457273c64f1297922ee566a298bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:39.825601 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8600457273c64f1297922ee566a298bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.828896 14273 ts_tablet_manager.cc:1916] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:39.829154 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5ac9d00cb7b3422e9810b51a4f20e029"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:39.831025 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5ac9d00cb7b3422e9810b51a4f20e029 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.835333 13638 tablet_bootstrap.cc:654] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:39.806586 12740 rpcz_store.cc:269] 0810 13:53:38.717227 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:38.724176 (+ 6949us) service_pool.cc:224] Handling call
0810 13:53:39.805222 (+1081046us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:39.551566 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:39.551942 (+ 376us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:39.551965 (+ 23us) write_op.cc:435] Acquired schema lock
0810 13:53:39.551978 (+ 13us) tablet.cc:662] Decoding operations
0810 13:53:39.552264 (+ 286us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:39.552303 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:39.552326 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:39.552572 (+ 246us) tablet.cc:701] Row locks acquired
0810 13:53:39.552586 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:39.556215 (+ 3629us) write_op.cc:270] Start()
0810 13:53:39.556309 (+ 94us) write_op.cc:276] Timestamp: P: 1786370019552639 usec, L: 0
0810 13:53:39.556327 (+ 18us) op_driver.cc:348] REPLICATION: starting
0810 13:53:39.556828 (+ 501us) log.cc:844] Serialized 901 byte log entry
0810 13:53:39.599738 (+ 42910us) op_driver.cc:464] REPLICATION: finished
0810 13:53:39.609930 (+ 10192us) write_op.cc:301] APPLY: starting
0810 13:53:39.610008 (+ 78us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:39.610189 (+ 181us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:39.610394 (+ 205us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:39.610912 (+ 518us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:39.611255 (+ 343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:39.611349 (+ 94us) write_op.cc:312] APPLY: finished
0810 13:53:39.611629 (+ 280us) log.cc:844] Serialized 29 byte log entry
0810 13:53:39.611868 (+ 239us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:39.611933 (+ 65us) write_op.cc:454] Released schema lock
0810 13:53:39.611964 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:39.612254 (+ 290us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:39.612295 (+ 41us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 13:53:39.737219 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:39.737585 (+ 366us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:39.737608 (+ 23us) write_op.cc:435] Acquired schema lock
0810 13:53:39.737620 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:39.737861 (+ 241us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:39.737907 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:39.737926 (+ 19us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:39.738066 (+ 140us) tablet.cc:701] Row locks acquired
0810 13:53:39.738077 (+ 11us) write_op.cc:260] PREPARE: finished
0810 13:53:39.738195 (+ 118us) write_op.cc:270] Start()
0810 13:53:39.738278 (+ 83us) write_op.cc:276] Timestamp: P: 1786370019738122 usec, L: 0
0810 13:53:39.738293 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:39.738727 (+ 434us) log.cc:844] Serialized 356 byte log entry
0810 13:53:39.770790 (+ 32063us) op_driver.cc:464] REPLICATION: finished
0810 13:53:39.786388 (+ 15598us) write_op.cc:301] APPLY: starting
0810 13:53:39.786466 (+ 78us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:39.786586 (+ 120us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:39.786712 (+ 126us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:39.786950 (+ 238us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:39.787223 (+ 273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:39.787322 (+ 99us) write_op.cc:312] APPLY: finished
0810 13:53:39.787635 (+ 313us) log.cc:844] Serialized 23 byte log entry
0810 13:53:39.787935 (+ 300us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:39.788059 (+ 124us) write_op.cc:454] Released schema lock
0810 13:53:39.788118 (+ 59us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:39.809625 (+ 21507us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:39.809649 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10766,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":10036,"apply.run_cpu_time_us":2286,"apply.run_wall_time_us":2286,"num_ops":2,"prepare.queue_time_us":114799,"prepare.run_cpu_time_us":1976,"prepare.run_wall_time_us":5452,"replication_time_us":43298}],["op",{"apply.queue_time_us":15394,"apply.run_cpu_time_us":2035,"apply.run_wall_time_us":2569,"num_ops":1,"prepare.queue_time_us":108360,"prepare.run_cpu_time_us":1864,"prepare.run_wall_time_us":72402,"raft.queue_time_us":132,"raft.run_cpu_time_us":1078,"raft.run_wall_time_us":1936,"replication_time_us":32313}]]}
W20260810 13:53:39.862120 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0be536894b164edfb4310ff521e2fb42 has no consensus state
I20260810 13:53:39.867604 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 4dea61b84b614ead8830873568f9b7c4
I20260810 13:53:39.871786 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dea61b84b614ead8830873568f9b7c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:39.876372 14276 raft_consensus.cc:493] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:39.877045 14276 raft_consensus.cc:515] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.881378 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9eaa998ba18d4f539d5f28362896f421"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:39.882221 14276 leader_election.cc:290] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:39.882766 13233 tablet_service.cc:1511] Processing CreateTablet for tablet b820c99b33264add8df5fd443981d0cc (DEFAULT_TABLE table=default.Table_b48c394590b6458487d9402067fc9889 [id=8169bbe19c43404bb723ba96fce6d27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.882664 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fde3bf9c44ccb18087a7bd64e435" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:39.883386 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9eaa998ba18d4f539d5f28362896f421 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:39.883983 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b820c99b33264add8df5fd443981d0cc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:39.884974 13167 leader_election.cc:343] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:39.886406 13639 tablet_bootstrap.cc:492] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:39.886829 13639 ts_tablet_manager.cc:1403] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.121s user 0.011s sys 0.007s
I20260810 13:53:39.893744 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b0ffad7efc24519957f2fb3be945b7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:39.897645 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 (DEFAULT_TABLE table=default.Table_e383a6bbbf2247478200482d22a378e3 [id=223e495b001c43a8b728880aafcdb751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.898936 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa729726a7f4603b0f5085a56cf89f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.905814 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 (DEFAULT_TABLE table=default.Table_e383a6bbbf2247478200482d22a378e3 [id=223e495b001c43a8b728880aafcdb751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.906807 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa729726a7f4603b0f5085a56cf89f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.910003 13003 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dea61b84b614ead8830873568f9b7c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:39.911461 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_997579d4e5fe4ddcb862569a19d7391f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:39.913059 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_997579d4e5fe4ddcb862569a19d7391f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:39.918258 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 4dea61b84b614ead8830873568f9b7c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dea61b84b614ead8830873568f9b7c4 already in progress: creating tablet
I20260810 13:53:39.912647 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:39.922904 13639 raft_consensus.cc:359] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.923662 13639 raft_consensus.cc:385] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:39.924050 13639 raft_consensus.cc:740] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:39.924422 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_71038e51b4474c5e9e8643d25c35a001 [id=5b919872756647048ea2e4fecbe78537]). Expected version 1 got 0
I20260810 13:53:39.926986 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet e4f7173588194000bb6ff0e9f72ced98
I20260810 13:53:39.933231 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet c549fde3bf9c44ccb18087a7bd64e435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:39.934582 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f7173588194000bb6ff0e9f72ced98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:39.935081 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f7173588194000bb6ff0e9f72ced98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:39.934924 13436 tablet_service.cc:1511] Processing CreateTablet for tablet b820c99b33264add8df5fd443981d0cc (DEFAULT_TABLE table=default.Table_b48c394590b6458487d9402067fc9889 [id=8169bbe19c43404bb723ba96fce6d27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.936667 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 (DEFAULT_TABLE table=default.Table_e383a6bbbf2247478200482d22a378e3 [id=223e495b001c43a8b728880aafcdb751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.937937 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dea61b84b614ead8830873568f9b7c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:39.940351 13638 tablet_bootstrap.cc:492] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:39.947839 13000 tablet_service.cc:1511] Processing CreateTablet for tablet 39ff3a48af494009bb53ee8d4e2a08cd (DEFAULT_TABLE table=default.Table_e7fae8b89720488f8787d4413e238fa4 [id=10d47f8e5d674a1585588be79dbef00b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.950654 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:39.952996 13003 tablet_service.cc:1558] Processing DeleteTablet for tablet e4f7173588194000bb6ff0e9f72ced98 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:39.957808 14272 tablet_replica.cc:333] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:39.957901 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]). Expected version 1 got 0
I20260810 13:53:39.953068 13639 consensus_queue.cc:260] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.959038 14272 raft_consensus.cc:2243] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:39.959731 14272 raft_consensus.cc:2272] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:39.964167 13638 ts_tablet_manager.cc:1403] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.300s user 0.006s sys 0.014s
I20260810 13:53:39.964309 14272 ts_tablet_manager.cc:1916] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:39.969395 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ff3a48af494009bb53ee8d4e2a08cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.956872 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 39ff3a48af494009bb53ee8d4e2a08cd (DEFAULT_TABLE table=default.Table_e7fae8b89720488f8787d4413e238fa4 [id=10d47f8e5d674a1585588be79dbef00b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:39.979560 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ff3a48af494009bb53ee8d4e2a08cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.980211 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b820c99b33264add8df5fd443981d0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.976634 12739 catalog_manager.cc:5719] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:39.981002 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_815335f73b844dffae6ce956bc049c96 [id=9a3a9159f7634bc999c5c10834eb41d3]). Expected version 1 got 0
I20260810 13:53:39.985267 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fa729726a7f4603b0f5085a56cf89f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:39.958029 14168 raft_consensus.cc:493] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:39.989461 14168 raft_consensus.cc:515] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.992201 13989 ts_tablet_manager.cc:1929] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:39.992777 13638 raft_consensus.cc:359] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:39.994084 12750 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_839f7239fe6c416ba32bb1fe17bfdda9 [id=c9ebbfcd82964aa798abcf82aaf3e881] alter complete (version 2)
I20260810 13:53:40.010926 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet 0800a52ff0f34efd9541454eb4ecbf4c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:28 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:40.013826 14168 leader_election.cc:290] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:40.020290 13640 tablet_bootstrap.cc:492] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:40.020780 13640 ts_tablet_manager.cc:1403] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.479s user 0.021s sys 0.004s
I20260810 13:53:40.025182 13640 raft_consensus.cc:359] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.025975 13640 raft_consensus.cc:385] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:40.026278 13640 raft_consensus.cc:740] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:39.992573 13989 log.cc:1199] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/b857cf97c0244ef4be73f17e0a30fa3c
I20260810 13:53:40.036808 13989 ts_tablet_manager.cc:1950] T b857cf97c0244ef4be73f17e0a30fa3c P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:40.040073 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet b857cf97c0244ef4be73f17e0a30fa3c (table default.Table_e63e2032b3d546d68f72a9add7b0ccaa [id=75a3bda0a82c4e94b96551672ea3550a]) successfully deleted
I20260810 13:53:40.041358 13989 tablet_replica.cc:333] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
W20260810 13:53:40.041324 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 03c640dce5dd4fc8a49f07fb983c50eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 03c640dce5dd4fc8a49f07fb983c50eb already in progress: creating tablet
W20260810 13:53:40.041937 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 4dea61b84b614ead8830873568f9b7c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dea61b84b614ead8830873568f9b7c4 already in progress: creating tablet
I20260810 13:53:40.042179 13989 raft_consensus.cc:2243] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:40.042666 13989 raft_consensus.cc:2272] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:40.045384 13989 ts_tablet_manager.cc:1916] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:40.047538 12745 master_service.cc:960] ReplaceTablet: received request to replace tablet 4fc9bef2781f4046a30c5394fc5d5529 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:40.048822 13638 raft_consensus.cc:385] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:40.049196 13638 raft_consensus.cc:740] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:40.024643 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet c549fde3bf9c44ccb18087a7bd64e435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:40.027117 13640 consensus_queue.cc:260] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.059602 13638 consensus_queue.cc:260] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.068282 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_839f7239fe6c416ba32bb1fe17bfdda9" } new_table_name: "default.Table_e0bb4403efd84db5ac45ace77b9b1a90" modify_external_catalogs: true
I20260810 13:53:40.073076 12749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_900358de324449a0b42140427aef559b" } modify_external_catalogs: true
I20260810 13:53:40.073699 12749 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_900358de324449a0b42140427aef559b" } modify_external_catalogs: true
I20260810 13:53:40.073937 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fde3bf9c44ccb18087a7bd64e435" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:40.074846 13475 raft_consensus.cc:2468] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:40.081763 13640 ts_tablet_manager.cc:1434] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.061s user 0.007s sys 0.000s
I20260810 13:53:40.082935 13640 tablet_bootstrap.cc:492] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:39.959853 13639 ts_tablet_manager.cc:1434] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.073s user 0.007s sys 0.000s
I20260810 13:53:40.095952 13000 tablet_service.cc:1511] Processing CreateTablet for tablet fb30ebe9520d4224bdfd45a5e915d8bd (DEFAULT_TABLE table=default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.096992 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb30ebe9520d4224bdfd45a5e915d8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.097751 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:40.098294 13639 tablet_bootstrap.cc:492] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:40.098591 13269 raft_consensus.cc:2468] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:40.100329 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:40.102758 13164 leader_election.cc:304] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:40.104226 14276 raft_consensus.cc:2804] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:40.104741 14276 raft_consensus.cc:493] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:40.105271 14276 raft_consensus.cc:3060] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:40.127066 13989 ts_tablet_manager.cc:1929] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 13:53:40.127475 13989 log.cc:1199] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/e4f7173588194000bb6ff0e9f72ced98
I20260810 13:53:40.128242 13989 ts_tablet_manager.cc:1950] T e4f7173588194000bb6ff0e9f72ced98 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:40.129444 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 39ff3a48af494009bb53ee8d4e2a08cd (DEFAULT_TABLE table=default.Table_e7fae8b89720488f8787d4413e238fa4 [id=10d47f8e5d674a1585588be79dbef00b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.130450 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ff3a48af494009bb53ee8d4e2a08cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.132457 13233 tablet_service.cc:1511] Processing CreateTablet for tablet fb30ebe9520d4224bdfd45a5e915d8bd (DEFAULT_TABLE table=default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.133567 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb30ebe9520d4224bdfd45a5e915d8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.136855 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1efc108552b047538e81a19f9d985680" } modify_external_catalogs: true
I20260810 13:53:40.137439 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1efc108552b047538e81a19f9d985680" } modify_external_catalogs: true
I20260810 13:53:40.144094 13238 tablet_service.cc:1511] Processing CreateTablet for tablet ba05f4940220459f951adf3491f60b93 (DEFAULT_TABLE table=default.Table_27966be3dfde47f48e04540a47399a69 [id=3801464b14e64234ae26f024ec8a6b0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.145925 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba05f4940220459f951adf3491f60b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.062100 13638 ts_tablet_manager.cc:1434] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.098s user 0.005s sys 0.003s
I20260810 13:53:40.151682 13638 tablet_bootstrap.cc:492] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:53:40.167124 13382 leader_election.cc:343] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:40.169072 13018 tablet_service.cc:1511] Processing CreateTablet for tablet d5aa1374d37a4918af34a5e9b15c16b3 (DEFAULT_TABLE table=default.Table_676bf4ad882d40c3b4ee02bcc60c973a [id=6b29e21f3d24403c8fe03d131e5edb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.170202 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5aa1374d37a4918af34a5e9b15c16b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.169994 13382 leader_election.cc:304] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:40.170764 14168 raft_consensus.cc:2804] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:40.171216 14168 raft_consensus.cc:493] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:40.171712 14168 raft_consensus.cc:3060] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:40.177588 13019 tablet_service.cc:1511] Processing CreateTablet for tablet ba05f4940220459f951adf3491f60b93 (DEFAULT_TABLE table=default.Table_27966be3dfde47f48e04540a47399a69 [id=3801464b14e64234ae26f024ec8a6b0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.178836 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba05f4940220459f951adf3491f60b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.185007 13434 tablet_service.cc:1511] Processing CreateTablet for tablet ba05f4940220459f951adf3491f60b93 (DEFAULT_TABLE table=default.Table_27966be3dfde47f48e04540a47399a69 [id=3801464b14e64234ae26f024ec8a6b0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.186058 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba05f4940220459f951adf3491f60b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.188047 13438 tablet_service.cc:1511] Processing CreateTablet for tablet fb30ebe9520d4224bdfd45a5e915d8bd (DEFAULT_TABLE table=default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.189139 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb30ebe9520d4224bdfd45a5e915d8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.206116 13640 tablet_bootstrap.cc:654] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:40.230697 13239 tablet_service.cc:1511] Processing CreateTablet for tablet d5aa1374d37a4918af34a5e9b15c16b3 (DEFAULT_TABLE table=default.Table_676bf4ad882d40c3b4ee02bcc60c973a [id=6b29e21f3d24403c8fe03d131e5edb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.231734 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5aa1374d37a4918af34a5e9b15c16b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.231698 13000 tablet_service.cc:1511] Processing CreateTablet for tablet ac9e3d3430044a5e85e2d812b7e221f5 (DEFAULT_TABLE table=default.Table_1a54e14ee22f49fd82e23264f470b8b7 [id=84d0c77358d442f1bd63d7a263de40e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.234009 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac9e3d3430044a5e85e2d812b7e221f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.238941 13639 tablet_bootstrap.cc:654] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:40.241752 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_815335f73b844dffae6ce956bc049c96" } new_table_name: "default.Table_e96d10ab0bc341a3b9b5a18ef701ee95" modify_external_catalogs: true
I20260810 13:53:40.246126 14276 raft_consensus.cc:515] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.248253 14131 raft_consensus.cc:493] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:40.257635 13429 tablet_service.cc:1511] Processing CreateTablet for tablet d5aa1374d37a4918af34a5e9b15c16b3 (DEFAULT_TABLE table=default.Table_676bf4ad882d40c3b4ee02bcc60c973a [id=6b29e21f3d24403c8fe03d131e5edb38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.257369 14131 raft_consensus.cc:515] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.259370 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5aa1374d37a4918af34a5e9b15c16b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.262435 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet e4f7173588194000bb6ff0e9f72ced98 (table default.Table_37e74959a9924be883b2b657294728be [id=5c116d56fd00422f80495064d32a7f4e]) successfully deleted
I20260810 13:53:40.263890 13989 tablet_replica.cc:333] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:40.265615 13989 raft_consensus.cc:2243] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:40.267803 14131 leader_election.cc:290] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:40.274250 13989 raft_consensus.cc:2272] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:40.276204 13230 tablet_service.cc:1511] Processing CreateTablet for tablet ac9e3d3430044a5e85e2d812b7e221f5 (DEFAULT_TABLE table=default.Table_1a54e14ee22f49fd82e23264f470b8b7 [id=84d0c77358d442f1bd63d7a263de40e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.283527 13230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac9e3d3430044a5e85e2d812b7e221f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.290953 14168 raft_consensus.cc:515] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.291386 14296 raft_consensus.cc:493] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:40.291909 14296 raft_consensus.cc:515] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.293062 14273 ts_tablet_manager.cc:1929] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:40.293538 14273 log.cc:1199] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/b857cf97c0244ef4be73f17e0a30fa3c
I20260810 13:53:40.280540 14276 leader_election.cc:290] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:40.295450 14276 raft_consensus.cc:493] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:40.295718 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c631f6ff87f046ac8fcbc07f3f32209a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:40.296049 14276 raft_consensus.cc:515] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:40.297411 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c631f6ff87f046ac8fcbc07f3f32209a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:40.313097 13238 tablet_service.cc:1511] Processing CreateTablet for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (DEFAULT_TABLE table=default.Table_1da7c92cdb10481480037763b0ec869b [id=3765b3af1ce6416fb8e3d79c7a4aa86e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.314517 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5b9e218c1f4f4083acc59a651f0cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.315378 14273 ts_tablet_manager.cc:1950] T b857cf97c0244ef4be73f17e0a30fa3c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:40.329268 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8d67329481324de9a0e2b07b786da24e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:40.330940 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d67329481324de9a0e2b07b786da24e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:40.341890 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:40.347160 13638 tablet_bootstrap.cc:654] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:40.351166 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee6e694366543328526313d7018b5db (DEFAULT_TABLE table=default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:40.352185 12952 leader_election.cc:343] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 956e50a9d2ff4af39a349bd93c48f7d9
I20260810 13:53:40.352043 14131 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:40.359135 14131 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.319857 14273 tablet_replica.cc:333] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:40.345818 13640 tablet_bootstrap.cc:492] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:40.361855 13640 ts_tablet_manager.cc:1403] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.279s user 0.012s sys 0.005s
I20260810 13:53:40.367750 13640 raft_consensus.cc:359] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.369441 13640 raft_consensus.cc:385] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:40.369722 13640 raft_consensus.cc:740] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:40.370669 13640 consensus_queue.cc:260] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.382128 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1d54dcbe3b494e9faf816d519e475447"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:40.383798 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d54dcbe3b494e9faf816d519e475447 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:40.341858 14168 leader_election.cc:290] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:40.387112 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee6e694366543328526313d7018b5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.394093 13640 ts_tablet_manager.cc:1434] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.032s user 0.005s sys 0.003s
I20260810 13:53:40.402413 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:40.417485 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_10638f441f654317829d436d2e7eb979"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:40.419252 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10638f441f654317829d436d2e7eb979 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:40.419804 13989 ts_tablet_manager.cc:1916] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:40.422442 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 65c3b03d5f1543b28ea6c439c3cfb07e (DEFAULT_TABLE table=default.Table_7ef25000b5b24c7e967819fa18512810 [id=75bdbd75db42408084bd9eb00e8c3b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.423508 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c3b03d5f1543b28ea6c439c3cfb07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.429111 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet b857cf97c0244ef4be73f17e0a30fa3c (table default.Table_e63e2032b3d546d68f72a9add7b0ccaa [id=75a3bda0a82c4e94b96551672ea3550a]) successfully deleted
I20260810 13:53:40.432495 14131 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:40.433425 14273 raft_consensus.cc:2243] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:40.433957 14273 raft_consensus.cc:2272] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:40.436372 13640 tablet_bootstrap.cc:492] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:40.441628 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:40.447628 14272 ts_tablet_manager.cc:1929] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 13:53:40.447618 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1b35d369474ba9bee379089796bd3c (DEFAULT_TABLE table=default.Table_c33560b05b334449b71faa0da12cab88 [id=1a0c5b7e411144e186003762b5dc3ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.448201 14272 log.cc:1199] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/e4f7173588194000bb6ff0e9f72ced98
I20260810 13:53:40.448665 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1b35d369474ba9bee379089796bd3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.449383 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fde3bf9c44ccb18087a7bd64e435" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:40.450019 13474 raft_consensus.cc:3060] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:40.458020 14272 ts_tablet_manager.cc:1950] T e4f7173588194000bb6ff0e9f72ced98 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:40.463874 13639 tablet_bootstrap.cc:492] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:40.465548 13639 ts_tablet_manager.cc:1403] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.368s user 0.019s sys 0.004s
I20260810 13:53:40.468981 14276 leader_election.cc:290] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:40.473639 13438 tablet_service.cc:1511] Processing CreateTablet for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (DEFAULT_TABLE table=default.Table_1da7c92cdb10481480037763b0ec869b [id=3765b3af1ce6416fb8e3d79c7a4aa86e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.474906 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee6e694366543328526313d7018b5db (DEFAULT_TABLE table=default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.475379 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5b9e218c1f4f4083acc59a651f0cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.476197 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 65c3b03d5f1543b28ea6c439c3cfb07e (DEFAULT_TABLE table=default.Table_7ef25000b5b24c7e967819fa18512810 [id=75bdbd75db42408084bd9eb00e8c3b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.477102 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c3b03d5f1543b28ea6c439c3cfb07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.481051 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee6e694366543328526313d7018b5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.481256 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 4fc9bef2781f4046a30c5394fc5d5529
I20260810 13:53:40.482762 12745 catalog_manager.cc:6807] ReplaceTablet: tablet 4fc9bef2781f4046a30c5394fc5d5529 deleted and replaced by tablet 121d7abf368a4cf99fd045b8c8ba4b69
I20260810 13:53:40.488009 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc9bef2781f4046a30c5394fc5d5529 with delete_type TABLET_DATA_DELETED (replaced by tablet 121d7abf368a4cf99fd045b8c8ba4b69) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:40.490136 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:40.490931 13261 raft_consensus.cc:3060] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:40.494429 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_cb722d2f9cb34e7895f9e8c6b3ea2249 [id=6708e032457744e299b929d795585c2c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0be536894b164edfb4310ff521e2fb42 has no consensus state
I20260810 13:53:40.496371 13429 tablet_service.cc:1511] Processing CreateTablet for tablet ac9e3d3430044a5e85e2d812b7e221f5 (DEFAULT_TABLE table=default.Table_1a54e14ee22f49fd82e23264f470b8b7 [id=84d0c77358d442f1bd63d7a263de40e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.497658 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac9e3d3430044a5e85e2d812b7e221f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.502066 14321 tablet.cc:1724] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:40.503302 13474 raft_consensus.cc:2468] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:40.504856 14296 leader_election.cc:290] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:40.511938 13640 tablet_bootstrap.cc:654] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:40.516396 12747 master_service.cc:960] ReplaceTablet: received request to replace tablet 9081f957f5824ed29603b1d84eff6906 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:40.522258 14272 tablet_replica.cc:333] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:40.523452 14272 raft_consensus.cc:2243] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:40.524186 14272 raft_consensus.cc:2272] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:40.530160 13639 raft_consensus.cc:359] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.530802 13639 raft_consensus.cc:385] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:40.530916 12749 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet cfba074bd3c845fa8ce81bdc3d8a1e44
I20260810 13:53:40.531049 13639 raft_consensus.cc:740] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:40.436347 14273 ts_tablet_manager.cc:1916] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:40.535709 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5dac7ad18d3c4fb58171ff8ab959d98a consensus state has no leader
W20260810 13:53:40.540155 12739 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 47) took 755 ms (client timeout 1000 ms). Trace:
I20260810 13:53:40.541585 13639 consensus_queue.cc:260] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.543218 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 953f83dab3ca406f8638e446911614b0 (DEFAULT_TABLE table=default.Table_840fe1ccac954217b7715893c2713712 [id=c09b5ac2aeb74f1eaae14574cb8fe582]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.544226 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953f83dab3ca406f8638e446911614b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:40.541245 12739 rpcz_store.cc:269] 0810 13:53:39.784524 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:39.784654 (+ 130us) service_pool.cc:224] Handling call
0810 13:53:39.825635 (+ 40981us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:40.540096 (+714461us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:40.241898 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:40.242302 (+ 404us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:40.242323 (+ 21us) write_op.cc:435] Acquired schema lock
0810 13:53:40.242334 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:40.242581 (+ 247us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:40.242621 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:40.242645 (+ 24us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:40.242820 (+ 175us) tablet.cc:701] Row locks acquired
0810 13:53:40.242833 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:53:40.242936 (+ 103us) write_op.cc:270] Start()
0810 13:53:40.243010 (+ 74us) write_op.cc:276] Timestamp: P: 1786370020242877 usec, L: 0
0810 13:53:40.243025 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:40.290115 (+ 47090us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b5400010a98. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6f2fc964 00007fec6e512d19 00007fec6e4cea01 00007fec6e4ce6da 00007fec6e552d45 00007fec6e5531e9 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319
0810 13:53:40.290395 (+ 280us) log.cc:844] Serialized 527 byte log entry
0810 13:53:40.330897 (+ 40502us) op_driver.cc:464] REPLICATION: finished
0810 13:53:40.331291 (+ 394us) write_op.cc:301] APPLY: starting
0810 13:53:40.331347 (+ 56us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:40.331518 (+ 171us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:40.331539 (+ 21us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:40.331745 (+ 206us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:40.331876 (+ 131us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:40.331922 (+ 46us) write_op.cc:312] APPLY: finished
0810 13:53:40.332108 (+ 186us) log.cc:844] Serialized 23 byte log entry
0810 13:53:40.332259 (+ 151us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:40.332315 (+ 56us) write_op.cc:454] Released schema lock
0810 13:53:40.332344 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:40.332580 (+ 236us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:40.332605 (+ 25us) write_op.cc:454] Released schema lock
0810 13:53:40.340993 (+ 8388us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b58000503d0. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e4b181c 00007fec6e4b8133 00007fec6e4b80b9 00007fec6e4b8049 00007fec6e4b8011 00007fec6e4b71dd 00000000005bd8c4 00000000005bd6f9 00007fec673f1db5 00007fec673f4121
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":86790016,"child_traces":[["op",{"apply.queue_time_us":246,"apply.run_cpu_time_us":1255,"apply.run_wall_time_us":1254,"num_ops":1,"prepare.queue_time_us":259026,"prepare.run_cpu_time_us":3588,"prepare.run_wall_time_us":64777,"raft.queue_time_us":166,"raft.run_cpu_time_us":2019,"raft.run_wall_time_us":49950,"replication_time_us":87773,"spinlock_wait_cycles":200070912}]]}
I20260810 13:53:40.545332 14272 ts_tablet_manager.cc:1916] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:40.546326 14314 log.cc:927] Time spent T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.084s user 0.001s sys 0.000s
I20260810 13:53:40.555719 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 1ee6e694366543328526313d7018b5db (DEFAULT_TABLE table=default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.557055 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee6e694366543328526313d7018b5db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.557399 13000 tablet_service.cc:1511] Processing CreateTablet for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (DEFAULT_TABLE table=default.Table_1da7c92cdb10481480037763b0ec869b [id=3765b3af1ce6416fb8e3d79c7a4aa86e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.558360 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc5b9e218c1f4f4083acc59a651f0cb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.573611 13261 raft_consensus.cc:2468] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:40.578305 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet d2cf90601bf4424aa6dc009415af8db6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:40.580111 13639 ts_tablet_manager.cc:1434] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.114s user 0.000s sys 0.006s
I20260810 13:53:40.584121 13638 tablet_bootstrap.cc:492] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:40.588047 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet 956e50a9d2ff4af39a349bd93c48f7d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:40.589622 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 65c3b03d5f1543b28ea6c439c3cfb07e (DEFAULT_TABLE table=default.Table_7ef25000b5b24c7e967819fa18512810 [id=75bdbd75db42408084bd9eb00e8c3b61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.590976 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65c3b03d5f1543b28ea6c439c3cfb07e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.591286 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1b35d369474ba9bee379089796bd3c (DEFAULT_TABLE table=default.Table_c33560b05b334449b71faa0da12cab88 [id=1a0c5b7e411144e186003762b5dc3ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.584766 13638 ts_tablet_manager.cc:1403] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.433s user 0.009s sys 0.011s
I20260810 13:53:40.592191 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1b35d369474ba9bee379089796bd3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.594666 13638 raft_consensus.cc:359] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.595382 13638 raft_consensus.cc:385] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:40.595671 13638 raft_consensus.cc:740] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:40.609987 13639 tablet_bootstrap.cc:492] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:40.613513 14172 raft_consensus.cc:493] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:40.613672 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307a6b609b674afbb684147005b66d87" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:40.614059 14172 raft_consensus.cc:515] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.614423 13475 raft_consensus.cc:2468] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:40.615959 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc9bef2781f4046a30c5394fc5d5529 with delete_type TABLET_DATA_DELETED (replaced by tablet 121d7abf368a4cf99fd045b8c8ba4b69) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:40.616354 14172 leader_election.cc:290] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:40.616101 14323 tablet.cc:1724] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:40.618029 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc9bef2781f4046a30c5394fc5d5529 with delete_type TABLET_DATA_DELETED (replaced by tablet 121d7abf368a4cf99fd045b8c8ba4b69) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:40.617799 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 3a1b35d369474ba9bee379089796bd3c (DEFAULT_TABLE table=default.Table_c33560b05b334449b71faa0da12cab88 [id=1a0c5b7e411144e186003762b5dc3ace]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.619767 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 953f83dab3ca406f8638e446911614b0 (DEFAULT_TABLE table=default.Table_840fe1ccac954217b7715893c2713712 [id=c09b5ac2aeb74f1eaae14574cb8fe582]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.620990 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953f83dab3ca406f8638e446911614b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.620630 13638 consensus_queue.cc:260] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.629173 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a1b35d369474ba9bee379089796bd3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:40.630856 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:40.630915 13436 tablet_service.cc:1558] Processing DeleteTablet for tablet 435f585d225b492cb2b2e83fdb3a2b3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:40.624645 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:40.634050 13474 raft_consensus.cc:2468] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:40.639652 13164 leader_election.cc:304] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:40.641664 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c549fde3bf9c44ccb18087a7bd64e435" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:40.646354 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307a6b609b674afbb684147005b66d87" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:40.649309 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:40.649379 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:40.653575 13989 ts_tablet_manager.cc:1929] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:40.653985 13989 log.cc:1199] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/c549fde3bf9c44ccb18087a7bd64e435
I20260810 13:53:40.654635 13989 ts_tablet_manager.cc:1950] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:40.656798 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet c549fde3bf9c44ccb18087a7bd64e435 (table default.Table_1befb4abf1054ff0900cb2c6dfe3b126 [id=35cc992f73c943c3a468c8ef4e5c0283]) successfully deleted
I20260810 13:53:40.666862 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 953f83dab3ca406f8638e446911614b0 (DEFAULT_TABLE table=default.Table_840fe1ccac954217b7715893c2713712 [id=c09b5ac2aeb74f1eaae14574cb8fe582]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:40.668040 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 953f83dab3ca406f8638e446911614b0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:40.670856 13164 raft_consensus.cc:2686] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:40.672075 13164 leader_election.cc:304] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:40.672886 13164 leader_election.cc:304] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:40.673581 14276 raft_consensus.cc:2804] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:40.673902 14276 raft_consensus.cc:493] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:40.674196 14276 raft_consensus.cc:3060] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:40.676888 14296 raft_consensus.cc:2804] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:40.677223 14296 raft_consensus.cc:493] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:40.677513 14296 raft_consensus.cc:3060] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:40.689751 13167 leader_election.cc:343] T c549fde3bf9c44ccb18087a7bd64e435 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:40.691815 13167 leader_election.cc:343] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:40.695389 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_060b551b964e40d1a67a29b0927f2ed5" } new_table_name: "default.Table_8e6c5eec20c54d91b4021f43b8783007" modify_external_catalogs: true
I20260810 13:53:40.701049 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet e4f7173588194000bb6ff0e9f72ced98 (table default.Table_37e74959a9924be883b2b657294728be [id=5c116d56fd00422f80495064d32a7f4e]) successfully deleted
W20260810 13:53:40.702019 13167 leader_election.cc:343] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:40.705226 13382 consensus_peers.cc:597] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4f7173588194000bb6ff0e9f72ced98. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:53:40.705614 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 61570.3us
I20260810 13:53:40.710050 13639 tablet_bootstrap.cc:654] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:40.711481 14276 raft_consensus.cc:515] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.717728 14276 leader_election.cc:290] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:40.718966 13382 leader_election.cc:304] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:40.716166 14296 raft_consensus.cc:515] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.720183 13638 ts_tablet_manager.cc:1434] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.128s user 0.003s sys 0.002s
I20260810 13:53:40.735416 12742 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 121d7abf368a4cf99fd045b8c8ba4b69
I20260810 13:53:40.736580 14146 raft_consensus.cc:2804] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:40.738481 13638 tablet_bootstrap.cc:492] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:40.752532 14296 leader_election.cc:290] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:40.757913 12951 leader_election.cc:343] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 956e50a9d2ff4af39a349bd93c48f7d9
I20260810 13:53:40.758376 12951 leader_election.cc:304] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:40.759287 14315 raft_consensus.cc:2749] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:40.760408 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:53:40.763577 13382 leader_election.cc:343] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 1108f64f1260448b8a68ea9fe30ea494
I20260810 13:53:40.768649 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d49256ba75124489b6c3228921d95041"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:40.770243 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d49256ba75124489b6c3228921d95041 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:40.764197 13638 tablet_bootstrap.cc:654] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:40.773149 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f607f9e067574d68809ebee30bc17d75" } modify_external_catalogs: true
I20260810 13:53:40.773617 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f607f9e067574d68809ebee30bc17d75" } modify_external_catalogs: true
I20260810 13:53:40.777462 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_34691af4c4ad46eb81e74d8394e253c5" } new_table_name: "default.Table_7ca4f403487544ddbcdae3db90d957f1" modify_external_catalogs: true
I20260810 13:53:40.778004 14321 tablet.cc:1724] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:40.781479 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 9081f957f5824ed29603b1d84eff6906
I20260810 13:53:40.782896 12747 catalog_manager.cc:6807] ReplaceTablet: tablet 9081f957f5824ed29603b1d84eff6906 deleted and replaced by tablet ca4c0fea312c418f8ebd5c0619e7e220
I20260810 13:53:40.785684 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet 9081f957f5824ed29603b1d84eff6906 with delete_type TABLET_DATA_DELETED (replaced by tablet ca4c0fea312c418f8ebd5c0619e7e220) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:40.786185 13640 tablet_bootstrap.cc:492] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:40.786628 13640 ts_tablet_manager.cc:1403] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.350s user 0.014s sys 0.004s
I20260810 13:53:40.786878 13989 tablet_replica.cc:333] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:40.787591 13989 raft_consensus.cc:2243] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:40.787989 13989 pending_rounds.cc:70] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:40.788183 13989 pending_rounds.cc:77] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7316971602731651072 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "9081f957f5824ed29603b1d84eff6906" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_670f5f1855c14840917ede9ad5abd859" dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" new_extra_config { } }
I20260810 13:53:40.789139 13989 raft_consensus.cc:2272] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:40.789132 14172 consensus_queue.cc:1048] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:40.791946 13989 ts_tablet_manager.cc:1916] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:40.801158 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1108f64f1260448b8a68ea9fe30ea494" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:40.801788 13054 raft_consensus.cc:2468] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:40.805042 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307a6b609b674afbb684147005b66d87" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:40.806449 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:40.807631 12951 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:40.806442 12746 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_e0bb4403efd84db5ac45ace77b9b1a90 [id=c9ebbfcd82964aa798abcf82aaf3e881]). Expected version 3 got 2
I20260810 13:53:40.808336 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 9081f957f5824ed29603b1d84eff6906 with delete_type TABLET_DATA_DELETED (replaced by tablet ca4c0fea312c418f8ebd5c0619e7e220) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:40.811223 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5fc84c8a61ad484e925fb92300a57223"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:40.812942 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fc84c8a61ad484e925fb92300a57223 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:40.810925 12746 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]). Expected version 1 got 0
I20260810 13:53:40.817469 12746 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
I20260810 13:53:40.833745 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
W20260810 13:53:40.836953 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a0bfa7b61a334886b0bc1583c7d7fee9 consensus state has no leader
I20260810 13:53:40.844602 14305 raft_consensus.cc:2749] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:40.846858 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 9081f957f5824ed29603b1d84eff6906 with delete_type TABLET_DATA_DELETED (replaced by tablet ca4c0fea312c418f8ebd5c0619e7e220) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:40.851277 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:40.851452 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307a6b609b674afbb684147005b66d87" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:40.851905 13475 raft_consensus.cc:3060] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:40.851969 13474 raft_consensus.cc:3060] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:40.857084 13167 leader_election.cc:343] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:40.857870 13167 leader_election.cc:343] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:40.860090 13474 raft_consensus.cc:2468] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:40.861039 13475 raft_consensus.cc:2468] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:40.878190 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 1108f64f1260448b8a68ea9fe30ea494 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:40.882555 13640 raft_consensus.cc:359] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:40.883354 13640 raft_consensus.cc:385] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:40.883663 13640 raft_consensus.cc:740] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:40.884985 14146 raft_consensus.cc:697] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:40.900171 14146 consensus_queue.cc:237] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:40.903962 13382 consensus_peers.cc:597] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4f7173588194000bb6ff0e9f72ced98. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:53:40.904543 13382 leader_election.cc:343] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:40.905579 13640 consensus_queue.cc:260] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:40.908784 13639 tablet_bootstrap.cc:492] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:40.907030 13638 tablet_bootstrap.cc:492] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:40.909166 13640 ts_tablet_manager.cc:1434] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.122s user 0.008s sys 0.000s
I20260810 13:53:40.910645 13638 ts_tablet_manager.cc:1403] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.172s user 0.011s sys 0.014s
I20260810 13:53:40.913246 13638 raft_consensus.cc:359] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.918656 14273 ts_tablet_manager.cc:1929] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:40.919165 14273 log.cc:1199] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/4b0ffad7efc24519957f2fb3be945b7d
I20260810 13:53:40.920058 14273 ts_tablet_manager.cc:1950] T 4b0ffad7efc24519957f2fb3be945b7d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:53:40.905043 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3db559714d84493ebaf7d3b51719d81c has no consensus state
I20260810 13:53:40.897033 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_7b48ac1f84df4984b491045d0aa9b2c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:40.927043 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b48ac1f84df4984b491045d0aa9b2c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:40.934897 13639 ts_tablet_manager.cc:1403] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.325s user 0.012s sys 0.002s
I20260810 13:53:40.920145 13989 ts_tablet_manager.cc:1929] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:40.937533 13638 raft_consensus.cc:385] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:40.937671 13989 log.cc:1199] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/9081f957f5824ed29603b1d84eff6906
I20260810 13:53:40.937920 13638 raft_consensus.cc:740] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:40.938635 13989 ts_tablet_manager.cc:1950] T 9081f957f5824ed29603b1d84eff6906 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:40.946029 13640 tablet_bootstrap.cc:492] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:40.949213 13382 leader_election.cc:304] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:53:40.965045 14172 raft_consensus.cc:2804] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:40.965678 14172 raft_consensus.cc:493] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:40.966312 14172 raft_consensus.cc:3060] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:40.974555 13638 consensus_queue.cc:260] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.980396 14328 tablet.cc:1724] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:40.985121 13164 leader_election.cc:304] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:40.989753 14296 raft_consensus.cc:2804] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:40.990551 14296 raft_consensus.cc:697] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:40.992163 14296 consensus_queue.cc:237] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:40.928103 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet b7dded9a7c2c4652b41131f0bc14a6b5
I20260810 13:53:41.003628 13638 ts_tablet_manager.cc:1434] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.093s user 0.004s sys 0.002s
I20260810 13:53:41.005012 13638 tablet_bootstrap.cc:492] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:40.951886 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_98e0a167c936447b8b277bc3c9ab07bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:41.006577 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98e0a167c936447b8b277bc3c9ab07bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:41.007565 13164 leader_election.cc:304] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:40.952921 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f98c8ce886d84413a005fa4b80373027" } modify_external_catalogs: true
I20260810 13:53:41.009045 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f98c8ce886d84413a005fa4b80373027" } modify_external_catalogs: true
I20260810 13:53:41.009390 14276 raft_consensus.cc:2804] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:40.953877 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 9081f957f5824ed29603b1d84eff6906 (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]) successfully deleted
W20260810 13:53:41.010703 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 56844.1us
I20260810 13:53:41.013432 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet b7dded9a7c2c4652b41131f0bc14a6b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:40 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:41.013738 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet b7dded9a7c2c4652b41131f0bc14a6b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:40 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:41.015800 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet b7dded9a7c2c4652b41131f0bc14a6b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7dded9a7c2c4652b41131f0bc14a6b5 already in progress: creating tablet
I20260810 13:53:41.054656 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d49256ba75124489b6c3228921d95041" } new_table_name: "default.Table_2449eba54b934f32b8c0063459e57139" modify_external_catalogs: true
I20260810 13:53:41.059752 13639 raft_consensus.cc:359] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.060563 13639 raft_consensus.cc:385] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:41.060871 13639 raft_consensus.cc:740] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:41.066941 14335 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:41.079169 14335 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.061628 13639 consensus_queue.cc:260] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.084580 14272 ts_tablet_manager.cc:1929] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:41.086264 14272 log.cc:1199] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/0800a52ff0f34efd9541454eb4ecbf4c
I20260810 13:53:41.085886 14350 tablet.cc:1724] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:41.087528 14272 ts_tablet_manager.cc:1950] T 0800a52ff0f34efd9541454eb4ecbf4c P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:41.084613 13639 ts_tablet_manager.cc:1434] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.149s user 0.021s sys 0.009s
I20260810 13:53:41.089587 13639 tablet_bootstrap.cc:492] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:41.091751 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 168) took 1081 ms. Trace:
I20260810 13:53:41.097922 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 170) took 1204 ms. Trace:
I20260810 13:53:41.098203 14276 raft_consensus.cc:697] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:41.099538 14276 consensus_queue.cc:237] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.098500 14273 rpcz_store.cc:276] 0810 13:53:39.893467 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:39.893600 (+ 133us) service_pool.cc:224] Handling call
0810 13:53:40.319632 (+426032us) ts_tablet_manager.cc:1151] Deleting tablet 4b0ffad7efc24519957f2fb3be945b7d
0810 13:53:40.319705 (+ 73us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:40.691747 (+372042us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:40.892648 (+200901us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:41.097810 (+205162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99910,"tablet-delete.queue_time_us":425273}
I20260810 13:53:41.110169 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_40207e9a8f484b5d9f5da8790cb646b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:41.116181 14273 tablet_replica.cc:333] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
W20260810 13:53:41.125103 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 729ffbfd767f4aa0b95f6545011aae3d has no consensus state
I20260810 13:53:41.125928 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c335d24b7ec048c49b6746c821e813a4" } new_table_name: "default.Table_d05254c620f14c3c862d5d77ab3a8a54" modify_external_catalogs: true
W20260810 13:53:41.135819 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40207e9a8f484b5d9f5da8790cb646b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:41.137393 14273 raft_consensus.cc:2243] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:41.138396 14273 raft_consensus.cc:2272] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:41.134720 14335 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:41.121604 14172 raft_consensus.cc:515] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:41.158221 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 99918.5us
W20260810 13:53:41.159010 13382 consensus_peers.cc:597] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:41.161358 12744 master_service.cc:960] ReplaceTablet: received request to replace tablet eaaa924290594d319b02526550416571 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:41.150239 14321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 177) took 1021 ms. Trace:
I20260810 13:53:41.167701 14273 ts_tablet_manager.cc:1916] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:41.175064 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 63123.8us
I20260810 13:53:41.187253 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d460b63b63de413ebdeeb708b4be6b10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:41.189352 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d460b63b63de413ebdeeb708b4be6b10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:41.190093 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab4cd2e5c73e467eb1bc4623e5d5e831 consensus state has no leader
I20260810 13:53:41.106158 14272 rpcz_store.cc:276] 0810 13:53:40.010535 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.010659 (+ 124us) service_pool.cc:224] Handling call
0810 13:53:40.522043 (+511384us) ts_tablet_manager.cc:1151] Deleting tablet 0800a52ff0f34efd9541454eb4ecbf4c
0810 13:53:40.522105 (+ 62us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:40.700573 (+178468us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:41.084439 (+383866us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:41.091667 (+ 7228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816,"tablet-delete.queue_time_us":510549}
I20260810 13:53:41.215039 14272 tablet_replica.cc:333] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:41.217025 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 0800a52ff0f34efd9541454eb4ecbf4c (table default.Table_0682d4d59c234e6f8c2e1f986ec9796e [id=6ebba3be39a64bc6a44e31673adb90df]) successfully deleted
I20260810 13:53:41.224211 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_fdebbaf3b87843e1b686fc556cfcda94" } modify_external_catalogs: true
I20260810 13:53:41.225426 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_fdebbaf3b87843e1b686fc556cfcda94" } modify_external_catalogs: true
I20260810 13:53:41.231232 13639 tablet_bootstrap.cc:654] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:41.216401 14272 raft_consensus.cc:2243] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:41.233970 14272 raft_consensus.cc:2272] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:41.243618 14272 ts_tablet_manager.cc:1916] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:41.307643 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b0c0a349b4324ceeb021d00f05947b8d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:41.309331 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0c0a349b4324ceeb021d00f05947b8d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:41.313653 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c94325b8ad884fbf8fa662c283cbaf83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:41.315179 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c94325b8ad884fbf8fa662c283cbaf83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:41.332473 13638 tablet_bootstrap.cc:654] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:41.333967 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9fcafa456d124c5d95b8e9e9f76dba13" } new_table_name: "default.Table_a49a2f11e36d4162bc5847bacee456e7" modify_external_catalogs: true
I20260810 13:53:41.341398 14315 raft_consensus.cc:493] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:41.342152 14315 raft_consensus.cc:515] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.351689 14315 leader_election.cc:290] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:41.161947 14321 rpcz_store.cc:276] 0810 13:53:40.129063 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.129172 (+ 109us) service_pool.cc:224] Handling call
0810 13:53:41.150149 (+1020977us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:40.197285 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:40.197931 (+ 646us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:40.197993 (+ 62us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:40.198096 (+ 103us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:40.198336 (+ 240us) alter_schema_op.cc:128] START. Timestamp: 1786370020198157
0810 13:53:40.198354 (+ 18us) op_driver.cc:348] REPLICATION: starting
0810 13:53:40.199331 (+ 977us) log.cc:844] Serialized 173 byte log entry
0810 13:53:40.718170 (+518839us) op_driver.cc:464] REPLICATION: finished
0810 13:53:40.777917 (+ 59747us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:53:40.779466 (+ 1549us) log.cc:844] Serialized 5 byte log entry
0810 13:53:40.936652 (+157186us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:41.050902 (+114250us) log.cc:844] Serialized 14 byte log entry
0810 13:53:41.149997 (+ 99095us) alter_schema_op.cc:73] Released schema lock
0810 13:53:41.150040 (+ 43us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":59556,"prepare.queue_time_us":67175,"prepare.run_cpu_time_us":10949,"prepare.run_wall_time_us":86106,"raft.queue_time_us":2598,"raft.run_cpu_time_us":2694,"raft.run_wall_time_us":2693,"replication_time_us":519670,"thread_start_us":228576,"threads_started":2,"wal-append.queue_time_us":76114}]]}
I20260810 13:53:41.185472 14172 leader_election.cc:290] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
W20260810 13:53:41.268806 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 109183us
I20260810 13:53:41.372386 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 4b0ffad7efc24519957f2fb3be945b7d (table default.Table_3687705a4de844f59a3c7e3af511980e [id=71df08438fab431cb91d9560374ce19c]) successfully deleted
I20260810 13:53:41.327610 13640 tablet_bootstrap.cc:654] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:41.397711 12749 master_service.cc:960] ReplaceTablet: received request to replace tablet e6bfb69a7ce74175b4f1f5f4db583aa9 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:41.400192 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_cb722d2f9cb34e7895f9e8c6b3ea2249" } new_table_name: "default.Table_2be31928f14c44f5a3916dbb4201225b" modify_external_catalogs: true
I20260810 13:53:41.409266 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2dda46b17a89419abdb1f6d9ff61fb1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:41.410079 12742 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
W20260810 13:53:41.410863 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dda46b17a89419abdb1f6d9ff61fb1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:41.411751 13049 raft_consensus.cc:3060] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:41.411922 12746 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_71038e51b4474c5e9e8643d25c35a001 [id=5b919872756647048ea2e4fecbe78537] alter complete (version 1)
W20260810 13:53:41.415347 12746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 48) took 756 ms (client timeout 1000 ms). Trace:
I20260810 13:53:41.417060 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_e96d10ab0bc341a3b9b5a18ef701ee95 [id=9a3a9159f7634bc999c5c10834eb41d3]). Expected version 2 got 0
I20260810 13:53:41.257882 14352 tablet.cc:1724] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 13:53:41.415673 12746 rpcz_store.cc:269] 0810 13:53:40.658589 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.658724 (+ 135us) service_pool.cc:224] Handling call
0810 13:53:41.415283 (+756559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:40.912903 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:40.913316 (+ 413us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:40.913341 (+ 25us) write_op.cc:435] Acquired schema lock
0810 13:53:40.913357 (+ 16us) tablet.cc:662] Decoding operations
0810 13:53:40.913626 (+ 269us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:40.913663 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:40.913686 (+ 23us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:40.913842 (+ 156us) tablet.cc:701] Row locks acquired
0810 13:53:40.913857 (+ 15us) write_op.cc:260] PREPARE: finished
0810 13:53:40.913965 (+ 108us) write_op.cc:270] Start()
0810 13:53:40.914046 (+ 81us) write_op.cc:276] Timestamp: P: 1786370020913892 usec, L: 0
0810 13:53:40.914063 (+ 17us) op_driver.cc:348] REPLICATION: starting
0810 13:53:40.923756 (+ 9693us) log.cc:844] Serialized 356 byte log entry
0810 13:53:40.985115 (+ 61359us) op_driver.cc:464] REPLICATION: finished
0810 13:53:40.985731 (+ 616us) write_op.cc:301] APPLY: starting
0810 13:53:40.985845 (+ 114us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:40.986031 (+ 186us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:40.986225 (+ 194us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:40.986645 (+ 420us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:40.987078 (+ 433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:40.987203 (+ 125us) write_op.cc:312] APPLY: finished
0810 13:53:40.987565 (+ 362us) log.cc:844] Serialized 23 byte log entry
0810 13:53:40.988586 (+ 1021us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:40.988807 (+ 221us) write_op.cc:454] Released schema lock
0810 13:53:40.988878 (+ 71us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:40.989538 (+ 660us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:40.989589 (+ 51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"spinlock_wait_cycles":1369984,"child_traces":[["op",{"apply.queue_time_us":322,"apply.run_cpu_time_us":2816,"apply.run_wall_time_us":3700,"num_ops":1,"prepare.queue_time_us":50583,"prepare.run_cpu_time_us":2003,"prepare.run_wall_time_us":15834,"replication_time_us":70885}]]}
I20260810 13:53:41.420218 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 6d2d209f801b4aa0aff3137a51fc7556 (DEFAULT_TABLE table=default.Table_997579d4e5fe4ddcb862569a19d7391f [id=8ad7f793f5494d0091f42aed3d345e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.441309 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2d209f801b4aa0aff3137a51fc7556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.419139 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:41.421042 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1108f64f1260448b8a68ea9fe30ea494" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:41.446045 13054 raft_consensus.cc:3060] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:41.453469 13003 tablet_service.cc:1511] Processing CreateTablet for tablet a4b1451bb8254fcb8c507a837d6b2fa4 (DEFAULT_TABLE table=default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.454790 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b1451bb8254fcb8c507a837d6b2fa4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:41.460623 13382 consensus_peers.cc:597] T cd3d4b038acb48ebaebef7a424f721c5 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:41.274570 14351 tablet.cc:1724] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260810 13:53:41.466557 13382 leader_election.cc:343] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:41.481590 13000 tablet_service.cc:1511] Processing CreateTablet for tablet 9453eab70fa04df8b0c89e6caf54c894 (DEFAULT_TABLE table=default.Table_fdebbaf3b87843e1b686fc556cfcda94 [id=6fb6917a0bb14fb18df1fb00134ad7c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.482710 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9453eab70fa04df8b0c89e6caf54c894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.488828 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet b7dded9a7c2c4652b41131f0bc14a6b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:40 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:41.489924 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 1108f64f1260448b8a68ea9fe30ea494 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:41.496333 13640 tablet_bootstrap.cc:492] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:41.496744 13640 ts_tablet_manager.cc:1403] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.551s user 0.010s sys 0.006s
I20260810 13:53:41.505656 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 6d2d209f801b4aa0aff3137a51fc7556 (DEFAULT_TABLE table=default.Table_997579d4e5fe4ddcb862569a19d7391f [id=8ad7f793f5494d0091f42aed3d345e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.506661 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2d209f801b4aa0aff3137a51fc7556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.518567 13054 raft_consensus.cc:2468] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:41.521852 12742 catalog_manager.cc:5719] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:41.523541 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_e96d10ab0bc341a3b9b5a18ef701ee95 [id=9a3a9159f7634bc999c5c10834eb41d3]). Expected version 2 got 0
W20260810 13:53:41.529654 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 73ad47d29d61456891478a9544594a94 consensus state has no leader
I20260810 13:53:41.529850 13434 tablet_service.cc:1511] Processing CreateTablet for tablet a4b1451bb8254fcb8c507a837d6b2fa4 (DEFAULT_TABLE table=default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.530889 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b1451bb8254fcb8c507a837d6b2fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.532939 13382 leader_election.cc:304] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:41.533300 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 9453eab70fa04df8b0c89e6caf54c894 (DEFAULT_TABLE table=default.Table_fdebbaf3b87843e1b686fc556cfcda94 [id=6fb6917a0bb14fb18df1fb00134ad7c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.534286 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9453eab70fa04df8b0c89e6caf54c894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.536926 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:41.552897 14172 raft_consensus.cc:2804] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:41.553383 14172 raft_consensus.cc:697] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:41.554122 14172 consensus_queue.cc:237] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.506731 13640 raft_consensus.cc:359] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:41.565441 13640 raft_consensus.cc:385] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:41.565717 13640 raft_consensus.cc:740] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:41.566416 13640 consensus_queue.cc:260] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:41.590220 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 44592.5us
I20260810 13:53:41.598781 13640 ts_tablet_manager.cc:1434] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.102s user 0.006s sys 0.000s
I20260810 13:53:41.602252 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 6d2d209f801b4aa0aff3137a51fc7556 (DEFAULT_TABLE table=default.Table_997579d4e5fe4ddcb862569a19d7391f [id=8ad7f793f5494d0091f42aed3d345e64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.603893 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d2d209f801b4aa0aff3137a51fc7556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.605557 13233 tablet_service.cc:1511] Processing CreateTablet for tablet a4b1451bb8254fcb8c507a837d6b2fa4 (DEFAULT_TABLE table=default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.606480 13639 tablet_bootstrap.cc:492] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:41.606775 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b1451bb8254fcb8c507a837d6b2fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.606884 13639 ts_tablet_manager.cc:1403] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.517s user 0.010s sys 0.010s
I20260810 13:53:41.613476 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (DEFAULT_TABLE table=default.Table_c7eb242f15844cdebd526a6dee37d0ba [id=285a3bf81f67425a9f37fb89d795a279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.614497 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.621500 13230 tablet_service.cc:1511] Processing CreateTablet for tablet 9453eab70fa04df8b0c89e6caf54c894 (DEFAULT_TABLE table=default.Table_fdebbaf3b87843e1b686fc556cfcda94 [id=6fb6917a0bb14fb18df1fb00134ad7c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.622889 13230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9453eab70fa04df8b0c89e6caf54c894. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.625824 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (DEFAULT_TABLE table=default.Table_c7eb242f15844cdebd526a6dee37d0ba [id=285a3bf81f67425a9f37fb89d795a279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.627076 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.635943 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_98ef324d70ca4bb0b9010207b64f109b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:41.637609 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98ef324d70ca4bb0b9010207b64f109b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:41.640378 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_abd953d9dc7945f78043250fc2ba2cde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:41.641477 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ef6e22114411476e94fe56014112b3f5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:41.641999 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abd953d9dc7945f78043250fc2ba2cde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:41.642891 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef6e22114411476e94fe56014112b3f5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:41.653190 13640 tablet_bootstrap.cc:492] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:41.654019 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 9453eab70fa04df8b0c89e6caf54c894
W20260810 13:53:41.658103 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0be536894b164edfb4310ff521e2fb42 consensus state has no leader
I20260810 13:53:41.665373 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet 9453eab70fa04df8b0c89e6caf54c894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:41.346720 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:41.670722 13269 raft_consensus.cc:2393] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:41.677026 14329 raft_consensus.cc:493] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:41.677575 14329 raft_consensus.cc:515] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:41.680229 14329 leader_election.cc:290] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:41.685453 12952 leader_election.cc:304] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:41.687305 14368 raft_consensus.cc:3060] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:41.636278 13639 raft_consensus.cc:359] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.690196 13639 raft_consensus.cc:385] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:41.690491 13639 raft_consensus.cc:740] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:41.667110 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:41.694015 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet e6bfb69a7ce74175b4f1f5f4db583aa9
I20260810 13:53:41.709590 13003 tablet_service.cc:1558] Processing DeleteTablet for tablet 9453eab70fa04df8b0c89e6caf54c894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:41.716523 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b427bfff3734fa08370bfbc480cb802" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:41.738772 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 47095.9us
I20260810 13:53:41.741158 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:41.741552 13640 tablet_bootstrap.cc:654] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:41.742624 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 (DEFAULT_TABLE table=default.Table_1cc7e2bca3cc43cda9ace3f7194fc23e [id=931fa31e6d214f76ae9e9a66d5a049a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.743633 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.747138 14377 tablet.cc:1724] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:41.752820 14296 raft_consensus.cc:493] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:41.752831 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6defacc9cc904ccf847ba25f0234e97c" } new_table_name: "default.Table_f461c45bd0ca44e099a85ccd6a12a206" modify_external_catalogs: true
I20260810 13:53:41.753439 14296 raft_consensus.cc:515] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.735867 13264 raft_consensus.cc:2468] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:41.757211 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:41.757678 14347 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:53:41.760967 13382 leader_election.cc:343] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:41.652427 14272 ts_tablet_manager.cc:1929] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:41.771023 14347 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.773337 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet 9453eab70fa04df8b0c89e6caf54c894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:41.793736 13638 tablet_bootstrap.cc:492] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:41.794257 13638 ts_tablet_manager.cc:1403] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.790s user 0.012s sys 0.011s
I20260810 13:53:41.764951 13639 consensus_queue.cc:260] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:41.767462 13000 tablet_service.cc:1558] Processing DeleteTablet for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:41.779368 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (DEFAULT_TABLE table=default.Table_c7eb242f15844cdebd526a6dee37d0ba [id=285a3bf81f67425a9f37fb89d795a279]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.781342 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 8b82b59b066c4240a387e7de48de9c70 (DEFAULT_TABLE table=default.Table_a8e82044d7a5494cb551eb7ca19322fe [id=d9e0f5f48e7e42afafe9a84c8e0249ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.832916 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b82b59b066c4240a387e7de48de9c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.834163 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.810226 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 (DEFAULT_TABLE table=default.Table_1cc7e2bca3cc43cda9ace3f7194fc23e [id=931fa31e6d214f76ae9e9a66d5a049a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.813344 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b427bfff3734fa08370bfbc480cb802" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:41.838614 14172 raft_consensus.cc:493] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:41.839150 14172 raft_consensus.cc:515] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:41.841490 14172 leader_election.cc:290] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:41.728629 14273 ts_tablet_manager.cc:1929] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:41.857028 14273 log.cc:1199] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/c549fde3bf9c44ccb18087a7bd64e435
I20260810 13:53:41.858199 14273 ts_tablet_manager.cc:1950] T c549fde3bf9c44ccb18087a7bd64e435 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:53:41.860764 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 587b591fb88a447b9bd5e071fa8c37e1 consensus state has no leader
W20260810 13:53:41.861817 13382 leader_election.cc:343] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 1108f64f1260448b8a68ea9fe30ea494
I20260810 13:53:41.864835 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_98ef324d70ca4bb0b9010207b64f109b" } new_table_name: "default.Table_0683f961d4714cc28fd3d3401e967335" modify_external_catalogs: true
I20260810 13:53:41.865100 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_40207e9a8f484b5d9f5da8790cb646b9" } modify_external_catalogs: true
I20260810 13:53:41.865550 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_40207e9a8f484b5d9f5da8790cb646b9" } modify_external_catalogs: true
I20260810 13:53:41.868763 13382 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:41.878358 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435f585d225b492cb2b2e83fdb3a2b3d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:41.881016 13000 tablet_service.cc:1511] Processing CreateTablet for tablet 1d78892783474b329e31bf2df7d2952c (DEFAULT_TABLE table=default.Table_270fa13ea58646819bcf21cf12afc107 [id=f873286e624d462b81e60663003a554d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.884087 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e (DEFAULT_TABLE table=default.Table_866916d7d8234bcb8dfc9bff54ada066 [id=69ab247d257c42e89ed2ebe36dde8c01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.885249 13004 tablet_service.cc:1511] Processing CreateTablet for tablet cab5c35fa6b440a7bc4ebe2709fbfc60 (DEFAULT_TABLE table=default.Table_57a088306e614a01aa3e18ad8ab5c91c [id=a0b9cd3087574b969ee026a3278d1404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.876258 13238 tablet_service.cc:1511] Processing CreateTablet for tablet 8b82b59b066c4240a387e7de48de9c70 (DEFAULT_TABLE table=default.Table_a8e82044d7a5494cb551eb7ca19322fe [id=d9e0f5f48e7e42afafe9a84c8e0249ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.801366 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 (DEFAULT_TABLE table=default.Table_1cc7e2bca3cc43cda9ace3f7194fc23e [id=931fa31e6d214f76ae9e9a66d5a049a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:41.896086 14272 log.cc:1199] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/d2cf90601bf4424aa6dc009415af8db6
I20260810 13:53:41.908802 14296 leader_election.cc:290] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:41.931071 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f461c45bd0ca44e099a85ccd6a12a206" } modify_external_catalogs: true
I20260810 13:53:41.931644 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f461c45bd0ca44e099a85ccd6a12a206" } modify_external_catalogs: true
I20260810 13:53:41.835457 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.872139 13639 ts_tablet_manager.cc:1434] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.265s user 0.009s sys 0.001s
W20260810 13:53:41.936654 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 68015.2us
I20260810 13:53:41.937642 13639 tablet_bootstrap.cc:492] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:41.939677 12742 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_e0bb4403efd84db5ac45ace77b9b1a90 [id=c9ebbfcd82964aa798abcf82aaf3e881] alter complete (version 3)
W20260810 13:53:41.947747 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 34b2314b771f41188bc8101c5ddffaf4 has no consensus state
I20260810 13:53:41.951069 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.816167 14368 raft_consensus.cc:2749] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:41.961014 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d78892783474b329e31bf2df7d2952c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.965319 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab5c35fa6b440a7bc4ebe2709fbfc60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:41.965780 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_83e1fdd041db4bb598abc50295d4d742"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:41.967437 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83e1fdd041db4bb598abc50295d4d742 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:41.972656 12746 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 220ad10af8174f5ebdd39e3cad863705
I20260810 13:53:41.974654 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435f585d225b492cb2b2e83fdb3a2b3d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:41.975301 13474 raft_consensus.cc:2468] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:41.977602 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffbabe58e034f26915504f2b1fa4679" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:41.985311 13167 leader_election.cc:343] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:41.987975 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 587b591fb88a447b9bd5e071fa8c37e1
I20260810 13:53:41.966495 14172 raft_consensus.cc:2804] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:41.994596 14172 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:41.997115 14172 raft_consensus.cc:3060] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:42.015101 13223 tablet_service.cc:1511] Processing CreateTablet for tablet cab5c35fa6b440a7bc4ebe2709fbfc60 (DEFAULT_TABLE table=default.Table_57a088306e614a01aa3e18ad8ab5c91c [id=a0b9cd3087574b969ee026a3278d1404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.021387 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e122aa8fcdc94f7a9740a6b01b2d1f34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:42.022832 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e122aa8fcdc94f7a9740a6b01b2d1f34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:42.022136 13227 tablet_service.cc:1511] Processing CreateTablet for tablet 1d78892783474b329e31bf2df7d2952c (DEFAULT_TABLE table=default.Table_270fa13ea58646819bcf21cf12afc107 [id=f873286e624d462b81e60663003a554d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.020326 13638 raft_consensus.cc:359] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:42.026037 13638 raft_consensus.cc:385] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:42.028977 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e (DEFAULT_TABLE table=default.Table_866916d7d8234bcb8dfc9bff54ada066 [id=69ab247d257c42e89ed2ebe36dde8c01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.032756 13222 tablet_service.cc:1511] Processing CreateTablet for tablet 1c6686175347496093cb22ce8a3d4176 (DEFAULT_TABLE table=default.Table_ac680b589bb24167b9765450ff434f90 [id=cb18564fa3e448818427fa7e8597605e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.028396 13638 raft_consensus.cc:740] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:42.045612 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_bd72a75b5a4f4711bd19684dac743ea3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:42.047065 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd72a75b5a4f4711bd19684dac743ea3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:42.050314 13639 tablet_bootstrap.cc:654] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:42.063088 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_612d612a32794a8998dd3a19129b79c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:42.064740 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_dc36c90216d846139fda4196de0bf1bc" } new_table_name: "default.Table_2d86969193af498baf3c431d50572095" modify_external_catalogs: true
I20260810 13:53:42.070219 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffbabe58e034f26915504f2b1fa4679" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:42.080396 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_612d612a32794a8998dd3a19129b79c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:42.084306 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a43def9358894b2aa001a7db56706589 consensus state has no leader
I20260810 13:53:42.086911 14272 ts_tablet_manager.cc:1950] T d2cf90601bf4424aa6dc009415af8db6 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:42.088093 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 175) took 1510 ms. Trace:
I20260810 13:53:42.088541 14272 rpcz_store.cc:276] 0810 13:53:40.578039 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.578148 (+ 109us) service_pool.cc:224] Handling call
0810 13:53:41.214769 (+636621us) ts_tablet_manager.cc:1151] Deleting tablet d2cf90601bf4424aa6dc009415af8db6
0810 13:53:41.214843 (+ 74us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:41.505426 (+290583us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:41.652280 (+146854us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:42.088011 (+435731us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":636033}
I20260810 13:53:42.090040 14272 tablet_replica.cc:333] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:42.091120 14272 raft_consensus.cc:2243] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:42.095330 13006 tablet_service.cc:1511] Processing CreateTablet for tablet 1c6686175347496093cb22ce8a3d4176 (DEFAULT_TABLE table=default.Table_ac680b589bb24167b9765450ff434f90 [id=cb18564fa3e448818427fa7e8597605e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:42.096513 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 54224.6us
I20260810 13:53:42.097712 13014 tablet_service.cc:1511] Processing CreateTablet for tablet d321f9c075554ffcb299d02792a0662d (DEFAULT_TABLE table=default.Table_38574d5b763c4a5197c7431ebb1bac4f [id=5270e00901e54049b16f185df852ad49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.099877 13010 tablet_service.cc:1511] Processing CreateTablet for tablet dfbb2036c800469f90ad4d5d211ac462 (DEFAULT_TABLE table=default.Table_2a27c95d054b44dd84ede3639a6395c5 [id=232f082ff5eb446bbb2e7869e83b2449]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.101509 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet 587b591fb88a447b9bd5e071fa8c37e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:42.103221 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 094a3448b54c409281c31813e60dcb7f (DEFAULT_TABLE table=default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.106886 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 121d7abf368a4cf99fd045b8c8ba4b69 (DEFAULT_TABLE table=default.Table_1efc108552b047538e81a19f9d985680 [id=b0c2c10c7abb49c0b0026662e9edba2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.110898 13008 tablet_service.cc:1511] Processing CreateTablet for tablet c4ecf9abd60848f993234e98284974e8 (DEFAULT_TABLE table=default.Table_b2ca1dc6dae5408e9a741e48f3afd33c [id=8bc6fe32d62e4a408e8e7cb974786822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.117375 13006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c6686175347496093cb22ce8a3d4176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.125047 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d321f9c075554ffcb299d02792a0662d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.127499 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet d2cf90601bf4424aa6dc009415af8db6 (table default.Table_61931e1060bf4fe3bb18256035837a88 [id=be32b50a9d45438b86b5ab8bca95243c]) successfully deleted
I20260810 13:53:42.151713 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e88a2434008d41cfbcd95faf0a6ebb94" } new_table_name: "default.Table_457f03cd1b7f460a927385ae6f5b25e6" modify_external_catalogs: true
I20260810 13:53:42.149396 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121d7abf368a4cf99fd045b8c8ba4b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.156046 14368 raft_consensus.cc:493] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:42.157131 14368 raft_consensus.cc:515] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:42.161339 14368 leader_election.cc:290] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:42.163143 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094a3448b54c409281c31813e60dcb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.166256 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfbb2036c800469f90ad4d5d211ac462. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:42.170256 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b54b73458a4c4201bc3b44259bc12436 consensus state has no leader
I20260810 13:53:42.172999 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ecf9abd60848f993234e98284974e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.176055 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_08582b65868149cca4ac724f7d18a869" } modify_external_catalogs: true
I20260810 13:53:42.176628 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_08582b65868149cca4ac724f7d18a869" } modify_external_catalogs: true
I20260810 13:53:42.091580 14272 raft_consensus.cc:2272] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:42.193575 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet e23454581a9a4b55b0756ef890dee7fb
I20260810 13:53:42.194556 14272 ts_tablet_manager.cc:1916] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:42.198729 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e122aa8fcdc94f7a9740a6b01b2d1f34" } modify_external_catalogs: true
I20260810 13:53:42.199237 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e122aa8fcdc94f7a9740a6b01b2d1f34" } modify_external_catalogs: true
I20260810 13:53:42.212960 13639 tablet_bootstrap.cc:492] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:42.213474 13639 ts_tablet_manager.cc:1403] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.276s user 0.013s sys 0.000s
I20260810 13:53:42.216632 12746 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 26938973c2f14d66bebb33ea9237556d
I20260810 13:53:42.220036 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 51813605283e43f2b4efe6fb2fab652c (DEFAULT_TABLE table=default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.223258 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e8940f9b8b5647b29566e6383b5c8fd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:42.224674 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8940f9b8b5647b29566e6383b5c8fd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:42.225747 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 171) took 2331 ms. Trace:
I20260810 13:53:42.226536 13640 tablet_bootstrap.cc:492] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:42.226100 14273 rpcz_store.cc:276] 0810 13:53:39.893852 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:39.932936 (+ 39084us) service_pool.cc:224] Handling call
0810 13:53:41.115864 (+1182928us) ts_tablet_manager.cc:1151] Deleting tablet c549fde3bf9c44ccb18087a7bd64e435
0810 13:53:41.115985 (+ 121us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:41.537285 (+421300us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:41.728473 (+191188us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:42.225662 (+497189us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1179199}
I20260810 13:53:42.226924 13640 ts_tablet_manager.cc:1403] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.582s user 0.008s sys 0.004s
I20260810 13:53:42.227412 14273 tablet_replica.cc:333] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:42.228276 14273 raft_consensus.cc:2243] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:42.229529 13640 raft_consensus.cc:359] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:42.231060 13640 raft_consensus.cc:385] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:42.231328 13640 raft_consensus.cc:740] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:42.232033 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:42.232005 13640 consensus_queue.cc:260] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:42.235373 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51813605283e43f2b4efe6fb2fab652c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.246166 14273 raft_consensus.cc:2272] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:42.250608 14273 ts_tablet_manager.cc:1916] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:42.253587 13640 ts_tablet_manager.cc:1434] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.026s user 0.005s sys 0.001s
I20260810 13:53:42.256999 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d07ce1fd7efa43e0b4b3d40511253f11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:42.258491 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d07ce1fd7efa43e0b4b3d40511253f11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:42.262504 13640 tablet_bootstrap.cc:492] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:42.287837 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_997579d4e5fe4ddcb862569a19d7391f" } new_table_name: "default.Table_98a42639f8ba4a309871c78bbf949d88" modify_external_catalogs: true
I20260810 13:53:42.290385 13012 tablet_service.cc:1511] Processing CreateTablet for tablet a17d73c65f544b7c8566fd874ee87a25 (DEFAULT_TABLE table=default.Table_9eaa998ba18d4f539d5f28362896f421 [id=957707ac45dd4ecfbf89c18a7dde1f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.291898 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17d73c65f544b7c8566fd874ee87a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.293655 13011 tablet_service.cc:1511] Processing CreateTablet for tablet f764e91bb2c94bc3be425b65323764cb (DEFAULT_TABLE table=default.Table_9b5c5b4c45b147b2bf013c380d097db7 [id=fe86ae518e3342539033ead65bdb93c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.295022 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f764e91bb2c94bc3be425b65323764cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.307304 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_bd734d41b4c04e8fae8551c8d2f341dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:42.309307 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd734d41b4c04e8fae8551c8d2f341dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:42.323882 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:42.325645 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:42.348130 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d2d209f801b4aa0aff3137a51fc7556 consensus state has no leader
W20260810 13:53:42.352195 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 387170us
W20260810 13:53:42.353327 13382 leader_election.cc:343] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:42.353749 13382 leader_election.cc:304] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:42.334347 13638 consensus_queue.cc:260] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:42.366273 13221 tablet_service.cc:1511] Processing CreateTablet for tablet dfbb2036c800469f90ad4d5d211ac462 (DEFAULT_TABLE table=default.Table_2a27c95d054b44dd84ede3639a6395c5 [id=232f082ff5eb446bbb2e7869e83b2449]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.371237 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:42.371922 13239 tablet_service.cc:1511] Processing CreateTablet for tablet d321f9c075554ffcb299d02792a0662d (DEFAULT_TABLE table=default.Table_38574d5b763c4a5197c7431ebb1bac4f [id=5270e00901e54049b16f185df852ad49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.318058 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet e23454581a9a4b55b0756ef890dee7fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:42.368093 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 587b591fb88a447b9bd5e071fa8c37e1 (DEFAULT_TABLE table=default.Table_f461c45bd0ca44e099a85ccd6a12a206 [id=b92ec76b26e2457bb68ab52a169a050f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.393639 14347 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:42.396576 14273 ts_tablet_manager.cc:1929] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260810 13:53:42.397150 14172 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:42.399575 13217 tablet_service.cc:1558] Processing DeleteTablet for tablet 587b591fb88a447b9bd5e071fa8c37e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:42.409071 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 094a3448b54c409281c31813e60dcb7f (DEFAULT_TABLE table=default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.414884 13638 ts_tablet_manager.cc:1434] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.620s user 0.011s sys 0.000s
W20260810 13:53:42.415153 13638 ts_tablet_manager.cc:1467] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: Tablet startup took 620ms
I20260810 13:53:42.419572 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 121d7abf368a4cf99fd045b8c8ba4b69 (DEFAULT_TABLE table=default.Table_1efc108552b047538e81a19f9d985680 [id=b0c2c10c7abb49c0b0026662e9edba2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.397840 14273 log.cc:1199] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/e4f7173588194000bb6ff0e9f72ced98
W20260810 13:53:42.410161 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 56858.4us
W20260810 13:53:42.422708 13382 leader_election.cc:343] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:42.425905 13238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b82b59b066c4240a387e7de48de9c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.411293 14329 raft_consensus.cc:2749] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:42.413632 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:53:42.430368 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.431797 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 515727ae51d94c009b4446c8b6e2c8f6 (DEFAULT_TABLE table=default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.435232 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 8b82b59b066c4240a387e7de48de9c70 (DEFAULT_TABLE table=default.Table_a8e82044d7a5494cb551eb7ca19322fe [id=d9e0f5f48e7e42afafe9a84c8e0249ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.436476 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b82b59b066c4240a387e7de48de9c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.441414 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 1d78892783474b329e31bf2df7d2952c (DEFAULT_TABLE table=default.Table_270fa13ea58646819bcf21cf12afc107 [id=f873286e624d462b81e60663003a554d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.442358 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d78892783474b329e31bf2df7d2952c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.442847 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab5c35fa6b440a7bc4ebe2709fbfc60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.393756 13215 tablet_service.cc:1511] Processing CreateTablet for tablet c4ecf9abd60848f993234e98284974e8 (DEFAULT_TABLE table=default.Table_b2ca1dc6dae5408e9a741e48f3afd33c [id=8bc6fe32d62e4a408e8e7cb974786822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.413609 13640 tablet_bootstrap.cc:654] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:42.445283 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e (DEFAULT_TABLE table=default.Table_866916d7d8234bcb8dfc9bff54ada066 [id=69ab247d257c42e89ed2ebe36dde8c01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.446484 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.447636 13436 tablet_service.cc:1511] Processing CreateTablet for tablet 1c6686175347496093cb22ce8a3d4176 (DEFAULT_TABLE table=default.Table_ac680b589bb24167b9765450ff434f90 [id=cb18564fa3e448818427fa7e8597605e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.448537 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c6686175347496093cb22ce8a3d4176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.449352 13434 tablet_service.cc:1511] Processing CreateTablet for tablet cab5c35fa6b440a7bc4ebe2709fbfc60 (DEFAULT_TABLE table=default.Table_57a088306e614a01aa3e18ad8ab5c91c [id=a0b9cd3087574b969ee026a3278d1404]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.450335 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cab5c35fa6b440a7bc4ebe2709fbfc60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.452050 13222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c6686175347496093cb22ce8a3d4176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.474581 13448 tablet_service.cc:1511] Processing CreateTablet for tablet d321f9c075554ffcb299d02792a0662d (DEFAULT_TABLE table=default.Table_38574d5b763c4a5197c7431ebb1bac4f [id=5270e00901e54049b16f185df852ad49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.475584 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d321f9c075554ffcb299d02792a0662d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.475623 13445 tablet_service.cc:1511] Processing CreateTablet for tablet dfbb2036c800469f90ad4d5d211ac462 (DEFAULT_TABLE table=default.Table_2a27c95d054b44dd84ede3639a6395c5 [id=232f082ff5eb446bbb2e7869e83b2449]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.476723 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfbb2036c800469f90ad4d5d211ac462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.490078 13210 tablet_service.cc:1511] Processing CreateTablet for tablet 51813605283e43f2b4efe6fb2fab652c (DEFAULT_TABLE table=default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:42.420508 13638 ts_tablet_manager.cc:1469] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: Trace:
0810 13:53:30.121249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:30.121542 (+ 293us) service_pool.cc:224] Handling call
0810 13:53:30.123195 (+ 1653us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:30.123280 (+ 85us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:30.221521 (+ 98241us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:30.332006 (+110485us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:30.332433 (+ 427us) inbound_call.cc:177] Queueing success response
0810 13:53:41.004412 (+10671979us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:53:41.794601 (+790189us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:53:41.801104 (+ 6503us) tablet_replica.cc:261] Starting instrumentation
0810 13:53:41.801657 (+ 553us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":27523,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":12179,"tablet-open.queue_time_us":10672018}
I20260810 13:53:42.493980 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfbb2036c800469f90ad4d5d211ac462. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.496901 13436 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b427bfff3734fa08370bfbc480cb802 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:42.345736 13639 raft_consensus.cc:359] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:42.498173 13639 raft_consensus.cc:385] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:42.435405 14273 ts_tablet_manager.cc:1950] T e4f7173588194000bb6ff0e9f72ced98 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:42.501554 13233 tablet_service.cc:1511] Processing CreateTablet for tablet a17d73c65f544b7c8566fd874ee87a25 (DEFAULT_TABLE table=default.Table_9eaa998ba18d4f539d5f28362896f421 [id=957707ac45dd4ecfbf89c18a7dde1f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.498633 13639 raft_consensus.cc:740] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:42.519948 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 3db559714d84493ebaf7d3b51719d81c (DEFAULT_TABLE table=default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.523862 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f7cdc66038804ad2b056118e3f6cf67e" } new_table_name: "default.Table_723061893666401a9728e4a49b584f5f" modify_external_catalogs: true
I20260810 13:53:42.525357 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_fbe0f651fe2e4328b7e2a126d989afab" } modify_external_catalogs: true
I20260810 13:53:42.508121 13639 consensus_queue.cc:260] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:42.526017 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_fbe0f651fe2e4328b7e2a126d989afab" } modify_external_catalogs: true
I20260810 13:53:42.529459 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_213c40da56b549d3bb97fccaa8f872cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:42.530983 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_213c40da56b549d3bb97fccaa8f872cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:42.531558 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a854e55f38e14aee8898f1cb29ba6b9b" } modify_external_catalogs: true
I20260810 13:53:42.527272 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 0be536894b164edfb4310ff521e2fb42 (DEFAULT_TABLE table=default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.532024 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a854e55f38e14aee8898f1cb29ba6b9b" } modify_external_catalogs: true
I20260810 13:53:42.535317 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587b591fb88a447b9bd5e071fa8c37e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.535542 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51813605283e43f2b4efe6fb2fab652c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.535337 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4f780597fcec4261acd040c8816826c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:42.537086 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 515727ae51d94c009b4446c8b6e2c8f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:42.537185 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f780597fcec4261acd040c8816826c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:42.540970 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet b54b73458a4c4201bc3b44259bc12436 consensus state has no leader
I20260810 13:53:42.542172 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094a3448b54c409281c31813e60dcb7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.555006 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8583fd0d8b1043d8845a330710570a5b" } new_table_name: "default.Table_0ccfac1ffac44e3b89c7a180d2477433" modify_external_catalogs: true
I20260810 13:53:42.560426 12740 catalog_manager.cc:5719] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:42.563807 12740 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:42.565546 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 587b591fb88a447b9bd5e071fa8c37e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:42.564649 12740 catalog_manager.cc:5719] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:42.567598 12740 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:42.568289 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 175) took 2633 ms. Trace:
I20260810 13:53:42.574404 13639 ts_tablet_manager.cc:1434] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.361s user 0.008s sys 0.002s
I20260810 13:53:42.581928 14172 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:42.590896 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be536894b164edfb4310ff521e2fb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.516780 13217 tablet_service.cc:1511] Processing CreateTablet for tablet f764e91bb2c94bc3be425b65323764cb (DEFAULT_TABLE table=default.Table_9b5c5b4c45b147b2bf013c380d097db7 [id=fe86ae518e3342539033ead65bdb93c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.604043 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.605763 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet e23454581a9a4b55b0756ef890dee7fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:42.568638 14273 rpcz_store.cc:276] 0810 13:53:39.934731 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:39.934839 (+ 108us) service_pool.cc:224] Handling call
0810 13:53:42.227229 (+2292390us) ts_tablet_manager.cc:1151] Deleting tablet e4f7173588194000bb6ff0e9f72ced98
0810 13:53:42.227285 (+ 56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:42.260675 (+ 33390us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:42.396420 (+135745us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:42.568224 (+171804us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2291816}
I20260810 13:53:42.616514 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 172) took 2683 ms. Trace:
W20260810 13:53:42.632393 12728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111) [suppressed 4 similar messages]
I20260810 13:53:42.633523 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffbabe58e034f26915504f2b1fa4679 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:42.636009 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 094a3448b54c409281c31813e60dcb7f (DEFAULT_TABLE table=default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.637221 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 094a3448b54c409281c31813e60dcb7f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:42.652930 12728 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 -> Peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Couldn't send request to peer 2928f7d4503145b182d99007d240334d. Status: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260810 13:53:42.653262 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121d7abf368a4cf99fd045b8c8ba4b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.654811 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 0be536894b164edfb4310ff521e2fb42 (DEFAULT_TABLE table=default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.656044 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be536894b164edfb4310ff521e2fb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.672766 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 587b591fb88a447b9bd5e071fa8c37e1 (DEFAULT_TABLE table=default.Table_f461c45bd0ca44e099a85ccd6a12a206 [id=b92ec76b26e2457bb68ab52a169a050f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.675973 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_3c8a09c1dfda4797918bd6715bdfebce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:42.676808 13638 tablet_bootstrap.cc:492] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:53:42.677878 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3c8a09c1dfda4797918bd6715bdfebce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:42.678956 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ecf9abd60848f993234e98284974e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.682753 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9c1a136459f6465d95a6d324db1dd0c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:42.685026 14172 raft_consensus.cc:493] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:53:42.684664 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c1a136459f6465d95a6d324db1dd0c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:42.686223 14172 raft_consensus.cc:515] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:42.690593 14172 leader_election.cc:290] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:42.693933 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bfb69a7ce74175b4f1f5f4db583aa9 already in progress: creating tablet
W20260810 13:53:42.695996 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 9453eab70fa04df8b0c89e6caf54c894 because the tablet was not found. No further retry: Not found: Tablet not found: 9453eab70fa04df8b0c89e6caf54c894
W20260810 13:53:42.696743 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 587b591fb88a447b9bd5e071fa8c37e1 because the tablet was not found. No further retry: Not found: Tablet not found: 587b591fb88a447b9bd5e071fa8c37e1
I20260810 13:53:42.722584 13639 tablet_bootstrap.cc:492] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:42.724063 13208 tablet_service.cc:1511] Processing CreateTablet for tablet 515727ae51d94c009b4446c8b6e2c8f6 (DEFAULT_TABLE table=default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.724812 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f764e91bb2c94bc3be425b65323764cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.739611 12999 tablet_service.cc:1511] Processing CreateTablet for tablet ff1229ebe9304f19ab84d5a172aba937 (DEFAULT_TABLE table=default.Table_5ac9d00cb7b3422e9810b51a4f20e029 [id=6f7b1b6d99b64d008a7c3c527f172e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.743403 13206 tablet_service.cc:1511] Processing CreateTablet for tablet ff1229ebe9304f19ab84d5a172aba937 (DEFAULT_TABLE table=default.Table_5ac9d00cb7b3422e9810b51a4f20e029 [id=6f7b1b6d99b64d008a7c3c527f172e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.365446 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 3db559714d84493ebaf7d3b51719d81c (DEFAULT_TABLE table=default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.774366 12995 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 11) took 1097 ms. Trace:
W20260810 13:53:42.786434 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe5796052fd94c1e8fce159a6a90830c consensus state has no leader
W20260810 13:53:42.789250 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c80bc85fe25433ab2559ea0ada61978 consensus state has no leader
I20260810 13:53:42.784425 12995 rpcz_store.cc:276] 0810 13:53:41.408366 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.408627 (+ 261us) service_pool.cc:224] Handling call
0810 13:53:41.784914 (+376287us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54000e10d4. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:53:42.133745 (+348831us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400101654. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:53:42.505232 (+371487us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358171904}
W20260810 13:53:42.787914 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 263941us
I20260810 13:53:42.798615 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1229ebe9304f19ab84d5a172aba937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.801220 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d78892783474b329e31bf2df7d2952c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.783551 13054 raft_consensus.cc:3060] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:42.839711 12746 master_service.cc:960] ReplaceTablet: received request to replace tablet 35c43f7f8b7e4e56b5edbabe242c9dde from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:42.618188 14273 rpcz_store.cc:276] 0810 13:53:39.933119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:39.937818 (+ 4699us) service_pool.cc:224] Handling call
0810 13:53:42.615129 (+2677311us) ts_tablet_manager.cc:1151] Deleting tablet 4dea61b84b614ead8830873568f9b7c4
0810 13:53:42.615278 (+ 149us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:42.616294 (+ 1016us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2676471}
I20260810 13:53:42.849502 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 3db559714d84493ebaf7d3b51719d81c (DEFAULT_TABLE table=default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.823508 13436 tablet_service.cc:1511] Processing CreateTablet for tablet c4ecf9abd60848f993234e98284974e8 (DEFAULT_TABLE table=default.Table_b2ca1dc6dae5408e9a741e48f3afd33c [id=8bc6fe32d62e4a408e8e7cb974786822]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.849741 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet e23454581a9a4b55b0756ef890dee7fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:42.841521 13438 tablet_service.cc:1511] Processing CreateTablet for tablet f764e91bb2c94bc3be425b65323764cb (DEFAULT_TABLE table=default.Table_9b5c5b4c45b147b2bf013c380d097db7 [id=fe86ae518e3342539033ead65bdb93c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.844887 13448 tablet_service.cc:1511] Processing CreateTablet for tablet a17d73c65f544b7c8566fd874ee87a25 (DEFAULT_TABLE table=default.Table_9eaa998ba18d4f539d5f28362896f421 [id=957707ac45dd4ecfbf89c18a7dde1f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.838428 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 51813605283e43f2b4efe6fb2fab652c (DEFAULT_TABLE table=default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.865628 13435 tablet_service.cc:1511] Processing CreateTablet for tablet 587b591fb88a447b9bd5e071fa8c37e1 (DEFAULT_TABLE table=default.Table_f461c45bd0ca44e099a85ccd6a12a206 [id=b92ec76b26e2457bb68ab52a169a050f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.867172 13432 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:42.867323 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 0be536894b164edfb4310ff521e2fb42 (DEFAULT_TABLE table=default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.868845 13432 tablet_service.cc:1511] Processing CreateTablet for tablet 515727ae51d94c009b4446c8b6e2c8f6 (DEFAULT_TABLE table=default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.870404 13428 tablet_service.cc:1511] Processing CreateTablet for tablet ff1229ebe9304f19ab84d5a172aba937 (DEFAULT_TABLE table=default.Table_5ac9d00cb7b3422e9810b51a4f20e029 [id=6f7b1b6d99b64d008a7c3c527f172e24]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:42.872725 13382 leader_election.cc:343] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:42.872871 13010 tablet_service.cc:1558] Processing DeleteTablet for tablet b857cf97c0244ef4be73f17e0a30fa3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:42.876343 13009 consensus_meta.cc:287] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.664s user 0.007s sys 0.010s
I20260810 13:53:42.892261 13639 tablet_bootstrap.cc:654] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:42.914268 13004 consensus_meta.cc:287] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.506s user 0.004s sys 0.007s
I20260810 13:53:42.915627 13004 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 194) took 1032 ms. Trace:
I20260810 13:53:42.916285 13004 rpcz_store.cc:276] 0810 13:53:41.883842 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.884066 (+ 224us) service_pool.cc:224] Handling call
0810 13:53:41.886166 (+ 2100us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:41.886295 (+ 129us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:42.407723 (+521428us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:42.914996 (+507273us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:42.915532 (+ 536us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:42.882190 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be536894b164edfb4310ff521e2fb42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.893554 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 185) took 2277 ms. Trace:
I20260810 13:53:42.932899 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db559714d84493ebaf7d3b51719d81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.937829 14368 raft_consensus.cc:493] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:42.825634 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 121d7abf368a4cf99fd045b8c8ba4b69 (DEFAULT_TABLE table=default.Table_1efc108552b047538e81a19f9d985680 [id=b0c2c10c7abb49c0b0026662e9edba2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:42.949867 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 121d7abf368a4cf99fd045b8c8ba4b69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.947145 14273 rpcz_store.cc:276] 0810 13:53:40.615694 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.615826 (+ 132us) service_pool.cc:224] Handling call
0810 13:53:42.858193 (+2242367us) ts_tablet_manager.cc:1151] Deleting tablet 4fc9bef2781f4046a30c5394fc5d5529
0810 13:53:42.873579 (+ 15386us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:42.893467 (+ 19888us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25472,"tablet-delete.queue_time_us":2241732}
I20260810 13:53:42.951407 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 190) took 2330 ms. Trace:
I20260810 13:53:42.951719 14273 rpcz_store.cc:276] 0810 13:53:40.620988 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.621085 (+ 97us) service_pool.cc:224] Handling call
0810 13:53:42.951089 (+2330004us) ts_tablet_manager.cc:1151] Deleting tablet b857cf97c0244ef4be73f17e0a30fa3c
0810 13:53:42.951133 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:42.951350 (+ 217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2319759}
I20260810 13:53:42.919328 14389 tablet_replica.cc:333] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:42.964063 14368 raft_consensus.cc:515] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:42.967567 14402 raft_consensus.cc:493] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:42.969547 14368 leader_election.cc:290] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:42.956480 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587b591fb88a447b9bd5e071fa8c37e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.968820 14402 raft_consensus.cc:515] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:42.955550 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:42.993047 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4ecf9abd60848f993234e98284974e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:42.997540 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f764e91bb2c94bc3be425b65323764cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.003033 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1229ebe9304f19ab84d5a172aba937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.005694 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17d73c65f544b7c8566fd874ee87a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.007423 13382 leader_election.cc:304] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:43.008205 14394 raft_consensus.cc:2749] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:43.008347 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 135667us
I20260810 13:53:43.010136 14329 consensus_queue.cc:1048] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:43.012121 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db559714d84493ebaf7d3b51719d81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.013329 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 587b591fb88a447b9bd5e071fa8c37e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.013691 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet c549fde3bf9c44ccb18087a7bd64e435 (table default.Table_1befb4abf1054ff0900cb2c6dfe3b126 [id=35cc992f73c943c3a468c8ef4e5c0283]) successfully deleted
W20260810 13:53:42.970829 13230 consensus_meta.cc:287] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb: Time spent flushing consensus metadata: real 0.515s user 0.009s sys 0.005s
I20260810 13:53:43.020991 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51813605283e43f2b4efe6fb2fab652c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.024299 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db559714d84493ebaf7d3b51719d81c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.012542 14272 ts_tablet_manager.cc:1929] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 13:53:43.024796 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 233534us
I20260810 13:53:43.025096 14272 log.cc:1199] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/956e50a9d2ff4af39a349bd93c48f7d9
I20260810 13:53:43.025863 14272 ts_tablet_manager.cc:1950] T 956e50a9d2ff4af39a349bd93c48f7d9 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:43.026755 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 176) took 2439 ms. Trace:
I20260810 13:53:43.027144 14272 rpcz_store.cc:276] 0810 13:53:40.587778 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.587892 (+ 114us) service_pool.cc:224] Handling call
0810 13:53:42.089803 (+1501911us) ts_tablet_manager.cc:1151] Deleting tablet 956e50a9d2ff4af39a349bd93c48f7d9
0810 13:53:42.089884 (+ 81us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:42.553451 (+463567us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.009397 (+455946us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.026701 (+ 17304us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1501331}
I20260810 13:53:43.028810 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 956e50a9d2ff4af39a349bd93c48f7d9 (table default.Table_3de1b4c6b1424eb0ab2183f39131ed74 [id=f800d0ffba7e47e6affc4f8527dfe445]) successfully deleted
I20260810 13:53:43.030580 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 179) took 2416 ms. Trace:
I20260810 13:53:43.031273 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d310fa96aa3e455590195ac9bf3b4825" } new_table_name: "default.Table_64421a271bfe4c4cbbab1afcd35955de" modify_external_catalogs: true
I20260810 13:53:43.039454 14272 rpcz_store.cc:276] 0810 13:53:40.614573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.617844 (+ 3271us) service_pool.cc:224] Handling call
0810 13:53:43.030168 (+2412324us) ts_tablet_manager.cc:1151] Deleting tablet 4fc9bef2781f4046a30c5394fc5d5529
0810 13:53:43.030222 (+ 54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:43.030505 (+ 283us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2411694}
I20260810 13:53:43.041448 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 515727ae51d94c009b4446c8b6e2c8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.043962 14272 tablet_replica.cc:333] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:42.996634 14402 leader_election.cc:290] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:43.062251 13639 tablet_bootstrap.cc:492] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:43.065299 13639 ts_tablet_manager.cc:1403] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.350s user 0.013s sys 0.009s
I20260810 13:53:43.065608 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 64e93928dcb94ae296590c4dedfd1781
I20260810 13:53:43.034060 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b0c0a349b4324ceeb021d00f05947b8d" } new_table_name: "default.Table_297f20c45c0045bc96a148c22d2753d3" modify_external_catalogs: true
I20260810 13:53:43.039001 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet c4db9d7e82414cab8a69618effe89b40
I20260810 13:53:43.078411 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e93928dcb94ae296590c4dedfd1781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:43.044116 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_dddc44815f0c48f2ab1b3afc7ce9a316"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:43.081233 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:43.085997 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet c4db9d7e82414cab8a69618effe89b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:43.090348 13164 leader_election.cc:304] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:43.091176 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 79661.7us
I20260810 13:53:43.097126 13639 raft_consensus.cc:359] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:43.097764 13639 raft_consensus.cc:385] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:43.098021 13639 raft_consensus.cc:740] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:53:43.102386 12952 leader_election.cc:343] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: b857cf97c0244ef4be73f17e0a30fa3c
I20260810 13:53:43.105965 13639 consensus_queue.cc:260] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:43.105764 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 515727ae51d94c009b4446c8b6e2c8f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.112317 13639 ts_tablet_manager.cc:1434] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.047s user 0.008s sys 0.002s
I20260810 13:53:43.107197 14389 raft_consensus.cc:2243] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:43.113837 14389 raft_consensus.cc:2272] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:43.117075 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff1229ebe9304f19ab84d5a172aba937. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.117432 13639 tablet_bootstrap.cc:492] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:43.132143 13238 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 193) took 1356 ms. Trace:
I20260810 13:53:43.132550 13238 rpcz_store.cc:276] 0810 13:53:41.775754 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.778073 (+ 2319us) service_pool.cc:224] Handling call
0810 13:53:42.425127 (+647054us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.425366 (+ 239us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:42.718907 (+293541us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.131647 (+412740us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.132046 (+ 399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:43.133723 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e93928dcb94ae296590c4dedfd1781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:43.134272 13238 tablet_service.cc:1558] Processing DeleteTablet for tablet c4db9d7e82414cab8a69618effe89b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:43.136559 13639 tablet_bootstrap.cc:654] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:43.136575 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17d73c65f544b7c8566fd874ee87a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.136943 14273 tablet_replica.cc:333] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:43.138311 14273 raft_consensus.cc:2243] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:43.139050 14273 raft_consensus.cc:2272] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:43.145895 13006 consensus_meta.cc:287] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.873s user 0.011s sys 0.009s
I20260810 13:53:43.148061 13230 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 187) took 1518 ms. Trace:
I20260810 13:53:43.148522 13230 rpcz_store.cc:276] 0810 13:53:41.617593 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.620417 (+ 2824us) service_pool.cc:224] Handling call
0810 13:53:41.622277 (+ 1860us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:41.622410 (+ 133us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:42.420373 (+797963us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.062169 (+641796us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.135437 (+ 73268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:43.135689 14389 ts_tablet_manager.cc:1916] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:43.068290 14402 consensus_queue.cc:1048] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260810 13:53:43.206046 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet e4f7173588194000bb6ff0e9f72ced98 (table default.Table_37e74959a9924be883b2b657294728be [id=5c116d56fd00422f80495064d32a7f4e]) successfully deleted
I20260810 13:53:43.211225 13230 tablet_service.cc:1558] Processing DeleteTablet for tablet 435f585d225b492cb2b2e83fdb3a2b3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:43.211813 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:43.212648 13257 raft_consensus.cc:3060] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:43.216563 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2ad1e3a90f47ac83ca262cad9964f0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:43.229736 14273 ts_tablet_manager.cc:1916] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:43.232219 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d321f9c075554ffcb299d02792a0662d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:43.273788 14420 raft_consensus.cc:2804] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:43.274556 14420 raft_consensus.cc:493] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:43.275171 14420 raft_consensus.cc:3060] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:43.279561 13223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 196) took 1302 ms. Trace:
W20260810 13:53:43.291195 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 4dea61b84b614ead8830873568f9b7c4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dea61b84b614ead8830873568f9b7c4 already in progress: creating tablet
W20260810 13:53:43.287734 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 337512us
W20260810 13:53:43.294409 13167 consensus_peers.cc:597] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:53:43.300233 13167 leader_election.cc:343] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:43.317446 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1a54e14ee22f49fd82e23264f470b8b7" } modify_external_catalogs: true
I20260810 13:53:43.318106 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1a54e14ee22f49fd82e23264f470b8b7" } modify_external_catalogs: true
I20260810 13:53:43.321276 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3afcf9952f64439db184876b30cf6bba" } modify_external_catalogs: true
I20260810 13:53:43.321772 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3afcf9952f64439db184876b30cf6bba" } modify_external_catalogs: true
W20260810 13:53:43.329260 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet b857cf97c0244ef4be73f17e0a30fa3c because the tablet was not found. No further retry: Not found: Tablet not found: b857cf97c0244ef4be73f17e0a30fa3c
I20260810 13:53:43.330593 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1b4d290e5bd445eaaff143b18dd41da9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:43.332156 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b4d290e5bd445eaaff143b18dd41da9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:43.333091 13222 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 197) took 1314 ms. Trace:
I20260810 13:53:43.333552 13222 rpcz_store.cc:276] 0810 13:53:42.018550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.029845 (+ 11295us) service_pool.cc:224] Handling call
0810 13:53:42.441031 (+411186us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.446469 (+ 5438us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:42.990557 (+544088us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.332511 (+341954us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.333029 (+ 518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:43.148785 13639 tablet_bootstrap.cc:492] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:43.205787 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:43.214359 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2ad1e3a90f47ac83ca262cad9964f0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:43.340904 13639 ts_tablet_manager.cc:1403] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.224s user 0.017s sys 0.004s
I20260810 13:53:43.305331 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0ffad7efc24519957f2fb3be945b7d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:43.340425 13006 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 195) took 1247 ms. Trace:
I20260810 13:53:43.342299 13006 rpcz_store.cc:276] 0810 13:53:42.092630 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.094283 (+ 1653us) service_pool.cc:224] Handling call
0810 13:53:42.096211 (+ 1928us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.096326 (+ 115us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:42.272188 (+175862us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.339931 (+1067743us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.340361 (+ 430us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:53:43.343055 13167 leader_election.cc:343] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:43.343672 13639 raft_consensus.cc:359] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:43.344327 13639 raft_consensus.cc:385] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:43.344554 13639 raft_consensus.cc:740] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:43.346647 13639 consensus_queue.cc:260] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:43.349215 13384 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.522s user 0.014s sys 0.014s
W20260810 13:53:43.349568 13384 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.522s user 0.014s sys 0.014s
W20260810 13:53:43.355321 13640 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.515s user 0.010s sys 0.018s
W20260810 13:53:43.355690 13640 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.515s user 0.010s sys 0.018s
I20260810 13:53:43.358531 13640 tablet_bootstrap.cc:492] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:43.358961 13640 ts_tablet_manager.cc:1403] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 1.097s user 0.016s sys 0.028s
I20260810 13:53:43.362123 13639 ts_tablet_manager.cc:1434] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260810 13:53:43.365489 13639 tablet_bootstrap.cc:492] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:43.381714 14272 raft_consensus.cc:2243] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:43.382599 14272 raft_consensus.cc:2272] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:43.387876 14272 ts_tablet_manager.cc:1916] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:43.399147 13638 tablet_bootstrap.cc:654] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:43.402238 13216 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 201) took 1016 ms. Trace:
I20260810 13:53:43.402401 13639 tablet_bootstrap.cc:654] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:43.402601 13216 rpcz_store.cc:276] 0810 13:53:42.386168 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.405436 (+ 19268us) service_pool.cc:224] Handling call
0810 13:53:42.514050 (+108614us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.532520 (+ 18470us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.001020 (+468500us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.401725 (+400705us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.402174 (+ 449us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:43.404969 13640 raft_consensus.cc:359] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:43.405684 13640 raft_consensus.cc:385] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:43.405947 13640 raft_consensus.cc:740] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:43.406579 13640 consensus_queue.cc:260] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:43.440491 13216 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b0ffad7efc24519957f2fb3be945b7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:43.450448 13640 ts_tablet_manager.cc:1434] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.091s user 0.007s sys 0.001s
I20260810 13:53:43.480170 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_91b7a336c30a4dcfafc6aa52bf1b1929"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:43.481571 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 918edf5d7b4f45009c5d476588399d0c has no consensus state
W20260810 13:53:43.481716 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91b7a336c30a4dcfafc6aa52bf1b1929 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:43.493561 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b449377349514576874b6c295ead5e9a consensus state has no leader
I20260810 13:53:43.496443 13011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 203) took 1277 ms. Trace:
I20260810 13:53:43.499087 13011 rpcz_store.cc:276] 0810 13:53:42.219148 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.292825 (+ 73677us) service_pool.cc:224] Handling call
0810 13:53:42.294367 (+ 1542us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.294480 (+ 113us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.022726 (+728246us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.365979 (+343253us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.495926 (+129947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:43.532274 13056 raft_consensus.cc:3060] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:43.547968 13382 leader_election.cc:343] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:43.549036 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b449377349514576874b6c295ead5e9a consensus state has no leader
I20260810 13:53:43.531038 13022 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 205) took 1254 ms. Trace:
I20260810 13:53:43.551971 13022 rpcz_store.cc:276] 0810 13:53:42.276420 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.276915 (+ 495us) service_pool.cc:224] Handling call
0810 13:53:42.930091 (+653176us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd23d2 00007f1929c16fb9 00007f1928e58640 00007f1928f3d641 00007f1928f1a8d3 00007f1928ec9210 00007f1927455bf4 00007f1927455b82 00007f1927455ab1
0810 13:53:42.930253 (+ 162us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.932326 (+ 2073us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.099309 (+166983us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.501039 (+401730us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.530973 (+ 29934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340096}
W20260810 13:53:43.552799 13382 consensus_peers.cc:597] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1108f64f1260448b8a68ea9fe30ea494. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:43.555850 13639 tablet_bootstrap.cc:492] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:43.556378 13639 ts_tablet_manager.cc:1403] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.191s user 0.023s sys 0.012s
I20260810 13:53:43.559120 13639 raft_consensus.cc:359] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:43.561093 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e93928dcb94ae296590c4dedfd1781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:43.562538 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet c4db9d7e82414cab8a69618effe89b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:43.575158 13640 tablet_bootstrap.cc:492] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:43.586730 13639 raft_consensus.cc:385] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:43.587229 13639 raft_consensus.cc:740] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:43.585793 12994 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 12) took 1476 ms. Trace:
I20260810 13:53:43.591189 12994 rpcz_store.cc:276] 0810 13:53:42.109146 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.109283 (+ 137us) service_pool.cc:224] Handling call
0810 13:53:43.585658 (+1476375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:43.598826 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:43.600189 13468 raft_consensus.cc:2393] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:43.588171 13639 consensus_queue.cc:260] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:43.614437 13639 ts_tablet_manager.cc:1434] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.058s user 0.005s sys 0.001s
I20260810 13:53:43.358449 13223 rpcz_store.cc:276] 0810 13:53:41.976843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.006408 (+ 29565us) service_pool.cc:224] Handling call
0810 13:53:42.429647 (+423239us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.440901 (+ 11254us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:42.973947 (+533046us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.278992 (+305045us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.279490 (+ 498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:43.615478 13639 tablet_bootstrap.cc:492] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:43.642135 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet a58df75cb91544ef863a09f4d6004da0
I20260810 13:53:43.658856 13640 tablet_bootstrap.cc:654] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:43.629673 14394 consensus_queue.cc:1048] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260810 13:53:43.673672 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_545faed375f94bd7ac5b07cf16c36f14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:43.675180 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_545faed375f94bd7ac5b07cf16c36f14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:43.675679 12740 master_service.cc:960] ReplaceTablet: received request to replace tablet f7afa380245248f5bac203b0905721c6 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:43.686647 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_40c739cc235b4e4a9d4fbbfb647dbd5e" } new_table_name: "default.Table_bbf02f15a5404f0d95042f20dac5c146" modify_external_catalogs: true
I20260810 13:53:43.698159 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d05254c620f14c3c862d5d77ab3a8a54" } new_table_name: "default.Table_f037ea1532b04d68bf8d49f557b2e258" modify_external_catalogs: true
I20260810 13:53:43.698568 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:43.699420 13476 raft_consensus.cc:2393] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:43.649581 14329 consensus_queue.cc:1048] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260810 13:53:43.705988 13257 raft_consensus.cc:2468] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:43.716781 13231 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 207) took 1197 ms. Trace:
W20260810 13:53:43.731429 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ab4cd2e5c73e467eb1bc4623e5d5e831 consensus state has no leader
W20260810 13:53:43.733709 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac2c102382734913bffb5436e06fe0a1 consensus state has no leader
I20260810 13:53:43.734089 14420 raft_consensus.cc:515] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:43.742556 13640 tablet_bootstrap.cc:492] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:43.743059 13640 ts_tablet_manager.cc:1403] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.168s user 0.011s sys 0.003s
I20260810 13:53:43.745702 13640 raft_consensus.cc:359] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:43.746330 13640 raft_consensus.cc:385] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:43.746579 13640 raft_consensus.cc:740] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:43.754619 14273 ts_tablet_manager.cc:1929] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:43.755007 14273 log.cc:1199] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/435f585d225b492cb2b2e83fdb3a2b3d
I20260810 13:53:43.717191 13231 rpcz_store.cc:276] 0810 13:53:42.519150 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.519278 (+ 128us) service_pool.cc:224] Handling call
0810 13:53:42.596244 (+ 76966us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a63d2 00007f91208eafb9 00007f911fb2c640 00007f911fc11641 00007f911fbee8d3 00007f911fb9d210 00007f911e129bf4 00007f911e129b82 00007f911e129ab1
0810 13:53:42.611920 (+ 15676us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.612023 (+ 103us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.360997 (+748974us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.520894 (+159897us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.716706 (+195812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195212,"spinlock_wait_cycles":30209792}
I20260810 13:53:43.758224 13640 consensus_queue.cc:260] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:43.776831 13640 ts_tablet_manager.cc:1434] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.033s user 0.007s sys 0.001s
I20260810 13:53:43.777745 13640 tablet_bootstrap.cc:492] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:43.778030 13239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 198) took 1732 ms. Trace:
I20260810 13:53:43.778399 13239 rpcz_store.cc:276] 0810 13:53:42.045660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.329832 (+284172us) service_pool.cc:224] Handling call
0810 13:53:42.602185 (+272353us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.603509 (+ 1324us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.398206 (+794697us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.521232 (+123026us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.777975 (+256743us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58732,"spinlock_wait_cycles":1280}
I20260810 13:53:43.789213 14273 ts_tablet_manager.cc:1950] T 435f585d225b492cb2b2e83fdb3a2b3d P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:43.776135 14444 tablet.cc:1724] T 15149232bd7645be840c1d223a829eb4 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:43.790527 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_63e74b1d9a4e48c3b9343a12f0b926e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:43.791211 13233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 206) took 1295 ms. Trace:
I20260810 13:53:43.791513 13233 rpcz_store.cc:276] 0810 13:53:42.496855 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.500810 (+ 3955us) service_pool.cc:224] Handling call
0810 13:53:42.595933 (+ 95123us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a63d2 00007f91208eafb9 00007f911fb2c640 00007f911fc11641 00007f911fbee8d3 00007f911fb9d210 00007f911e129bf4 00007f911e129b82 00007f911e129ab1
0810 13:53:42.612200 (+ 16267us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.612288 (+ 88us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.387141 (+774853us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.726360 (+339219us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.791157 (+ 64797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51190,"spinlock_wait_cycles":9668864}
I20260810 13:53:43.797013 13210 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 204) took 1399 ms. Trace:
I20260810 13:53:43.797851 14272 ts_tablet_manager.cc:1929] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:43.797390 13210 rpcz_store.cc:276] 0810 13:53:42.397741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.410595 (+ 12854us) service_pool.cc:224] Handling call
0810 13:53:42.513693 (+103098us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.514002 (+ 309us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.182155 (+668153us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.733637 (+551482us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.796656 (+ 63019us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a6cbe 00007f9120914219 00007f911fb2c5b1 00007f911fbf292b 00007f911fbee51f 00007f911fbeecdd 00007f911fb9d210 00007f911e129bf4 00007f911e129b82
0810 13:53:43.796951 (+ 295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192995,"spinlock_wait_cycles":5251840}
I20260810 13:53:43.798266 14272 log.cc:1199] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/9081f957f5824ed29603b1d84eff6906
I20260810 13:53:43.798863 13227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 194) took 1894 ms. Trace:
I20260810 13:53:43.799041 14272 ts_tablet_manager.cc:1950] T 9081f957f5824ed29603b1d84eff6906 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:43.799049 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 150354us
I20260810 13:53:43.799817 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 181) took 2995 ms. Trace:
I20260810 13:53:43.799213 13227 rpcz_store.cc:276] 0810 13:53:41.906141 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.915442 (+ 9301us) service_pool.cc:224] Handling call
0810 13:53:42.424090 (+508648us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a684c 00007f91179a640b 00007f91208eafb9 00007f911fb2c640 00007f911fc11641 00007f911fbee8d3 00007f911fb9d210 00007f911e129bf4 00007f911e129b82 00007f911e129ab1
0810 13:53:42.568875 (+144785us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.597753 (+ 28878us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.303572 (+705819us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.757175 (+453603us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.798801 (+ 41626us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62178,"spinlock_wait_cycles":649229568}
W20260810 13:53:43.800648 13382 leader_election.cc:343] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:43.800658 13221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 199) took 1466 ms. Trace:
I20260810 13:53:43.801012 13382 leader_election.cc:304] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:43.800992 13221 rpcz_store.cc:276] 0810 13:53:42.333947 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.358573 (+ 24626us) service_pool.cc:224] Handling call
0810 13:53:42.492026 (+133453us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.492216 (+ 190us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.178981 (+686765us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.760115 (+581134us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.800599 (+ 40484us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80941}
I20260810 13:53:43.801625 14394 raft_consensus.cc:2749] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:43.802700 13382 leader_election.cc:343] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:43.802827 13638 tablet_bootstrap.cc:492] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:43.804382 13213 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 203) took 1416 ms. Trace:
I20260810 13:53:43.804761 13213 rpcz_store.cc:276] 0810 13:53:42.387802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.395052 (+ 7250us) service_pool.cc:224] Handling call
0810 13:53:42.534137 (+139085us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.550248 (+ 16111us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.328835 (+778587us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.767619 (+438784us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.804309 (+ 36690us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92338}
I20260810 13:53:43.793574 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet a58df75cb91544ef863a09f4d6004da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:43.805699 13638 ts_tablet_manager.cc:1403] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 1.135s user 0.010s sys 0.025s
I20260810 13:53:43.806165 13229 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 192) took 2041 ms. Trace:
I20260810 13:53:43.806494 13229 rpcz_store.cc:276] 0810 13:53:41.764428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.777524 (+ 13096us) service_pool.cc:224] Handling call
0810 13:53:42.428779 (+651255us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.428878 (+ 99us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.147848 (+718970us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.770344 (+622496us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.806109 (+ 35765us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104496}
I20260810 13:53:43.808560 13217 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 205) took 1372 ms. Trace:
I20260810 13:53:43.808782 13224 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 195) took 1879 ms. Trace:
I20260810 13:53:43.809211 13224 rpcz_store.cc:276] 0810 13:53:41.929114 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.932366 (+ 3252us) service_pool.cc:224] Handling call
0810 13:53:42.424955 (+492589us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a684c 00007f91179a640b 00007f91208eafb9 00007f911fb2c640 00007f911fc11641 00007f911fbee8d3 00007f911fb9d210 00007f911e129bf4 00007f911e129b82 00007f911e129ab1
0810 13:53:42.598132 (+173177us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.598840 (+ 708us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.285961 (+687121us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.792400 (+506439us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.808679 (+ 16279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76334,"spinlock_wait_cycles":649015552}
I20260810 13:53:43.810509 13206 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 212) took 1123 ms. Trace:
I20260810 13:53:43.810938 13206 rpcz_store.cc:276] 0810 13:53:42.686841 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.691494 (+ 4653us) service_pool.cc:224] Handling call
0810 13:53:42.958663 (+267169us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.958774 (+ 111us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.588201 (+629427us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.790601 (+202400us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.810453 (+ 19852us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80057}
I20260810 13:53:43.808959 13217 rpcz_store.cc:276] 0810 13:53:42.435820 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.445871 (+ 10051us) service_pool.cc:224] Handling call
0810 13:53:42.619918 (+174047us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.627378 (+ 7460us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.298020 (+670642us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.771562 (+473542us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.808500 (+ 36938us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111559,"spinlock_wait_cycles":86784}
W20260810 13:53:43.813246 12952 consensus_peers.cc:597] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:43.814204 14406 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:43.814781 14406 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:43.774781 13223 tablet_service.cc:1558] Processing DeleteTablet for tablet a58df75cb91544ef863a09f4d6004da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:43.817343 13639 tablet_bootstrap.cc:654] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:43.819653 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63e74b1d9a4e48c3b9343a12f0b926e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:43.819249 13638 raft_consensus.cc:359] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:43.823685 13638 raft_consensus.cc:385] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:43.829890 13215 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 202) took 1443 ms. Trace:
I20260810 13:53:43.829013 13638 raft_consensus.cc:740] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:43.837508 12951 leader_election.cc:343] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: b857cf97c0244ef4be73f17e0a30fa3c
I20260810 13:53:43.837900 12951 leader_election.cc:304] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:43.834332 13638 consensus_queue.cc:260] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:43.839298 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:43.840322 13257 raft_consensus.cc:2393] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:43.825799 14406 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:43.843565 13164 leader_election.cc:343] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 4b0ffad7efc24519957f2fb3be945b7d
I20260810 13:53:43.843581 14402 consensus_queue.cc:1048] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:43.844002 13164 leader_election.cc:304] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:43.843876 14406 raft_consensus.cc:2749] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:43.846033 13164 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:43.800122 14272 rpcz_store.cc:276] 0810 13:53:40.804420 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.808203 (+ 3783us) service_pool.cc:224] Handling call
0810 13:53:43.043788 (+2235585us) ts_tablet_manager.cc:1151] Deleting tablet 9081f957f5824ed29603b1d84eff6906
0810 13:53:43.043837 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:43.609044 (+565207us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.797724 (+188680us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.799759 (+ 2035us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51891,"tablet-delete.queue_time_us":2234694}
I20260810 13:53:43.848981 14272 tablet_replica.cc:333] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:43.851089 14272 raft_consensus.cc:2243] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:43.851835 14272 raft_consensus.cc:2272] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:43.853538 13382 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:43.853849 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:43.855684 13472 raft_consensus.cc:2393] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:43.861590 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d3cce811ecf44ac8922775c36db30fba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:43.863533 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3cce811ecf44ac8922775c36db30fba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:43.876417 14430 raft_consensus.cc:2749] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:43.877774 14435 consensus_queue.cc:1048] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260810 13:53:43.885439 14439 raft_consensus.cc:2749] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:43.885906 13638 ts_tablet_manager.cc:1434] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.080s user 0.008s sys 0.001s
I20260810 13:53:43.830474 13215 rpcz_store.cc:276] 0810 13:53:42.386959 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.388146 (+ 1187us) service_pool.cc:224] Handling call
0810 13:53:42.513559 (+125413us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a684c 00007f91179a640b 00007f91208eafb9 00007f911fb2c640 00007f911fc11641 00007f911fbee8d3 00007f911fb9d210 00007f911e129bf4 00007f911e129b82 00007f911e129ab1
0810 13:53:42.604383 (+ 90824us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.611103 (+ 6720us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.332049 (+720946us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.828951 (+496902us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.829786 (+ 835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29661440}
I20260810 13:53:43.890084 13638 tablet_bootstrap.cc:492] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:43.893041 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 189) took 3276 ms. Trace:
I20260810 13:53:43.893414 14273 rpcz_store.cc:276] 0810 13:53:40.616987 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.617985 (+ 998us) service_pool.cc:224] Handling call
0810 13:53:42.952548 (+2334563us) ts_tablet_manager.cc:1151] Deleting tablet 435f585d225b492cb2b2e83fdb3a2b3d
0810 13:53:42.952586 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:43.476000 (+523414us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.754480 (+278480us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.892972 (+138492us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2320001}
I20260810 13:53:43.895224 14273 tablet_replica.cc:333] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:43.906325 13208 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 211) took 1222 ms. Trace:
I20260810 13:53:43.908584 13208 rpcz_store.cc:276] 0810 13:53:42.684088 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.687201 (+ 3113us) service_pool.cc:224] Handling call
0810 13:53:42.728328 (+ 41127us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.728559 (+ 231us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.705983 (+977424us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.905062 (+199079us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.906217 (+ 1155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:53:43.925196 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 87713.4us
I20260810 13:53:43.926697 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 9081f957f5824ed29603b1d84eff6906 (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]) successfully deleted
I20260810 13:53:43.931725 14420 leader_election.cc:290] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:43.927881 13209 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 209) took 1322 ms. Trace:
I20260810 13:53:43.933734 13209 rpcz_store.cc:276] 0810 13:53:42.605196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.610070 (+ 4874us) service_pool.cc:224] Handling call
0810 13:53:42.675913 (+ 65843us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.676081 (+ 168us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:43.691517 (+1015436us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.920030 (+228513us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:43.927481 (+ 7451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:43.937318 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b2ca1dc6dae5408e9a741e48f3afd33c" } new_table_name: "default.Table_26f372743d1f486d990e030f4f02dadd" modify_external_catalogs: true
I20260810 13:53:43.938470 14389 ts_tablet_manager.cc:1929] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:43.939352 14389 log.cc:1199] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/e23454581a9a4b55b0756ef890dee7fb
I20260810 13:53:43.949527 14406 raft_consensus.cc:493] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:43.949978 14406 raft_consensus.cc:515] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:43.937408 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3d1b1152401f41e39045b7afa5c9ac5d" } new_table_name: "default.Table_f101d8577cc1452ea2515229ebad2441" modify_external_catalogs: true
I20260810 13:53:43.951901 13638 tablet_bootstrap.cc:654] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:43.953804 14406 leader_election.cc:290] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:43.964418 14389 ts_tablet_manager.cc:1950] T e23454581a9a4b55b0756ef890dee7fb P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:43.966519 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_17e523ba6a3b40999d198d9649600be4" } modify_external_catalogs: true
I20260810 13:53:43.967255 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_17e523ba6a3b40999d198d9649600be4" } modify_external_catalogs: true
I20260810 13:53:43.969218 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 208) took 1402 ms. Trace:
I20260810 13:53:43.973483 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d89f1f488806492d8c05899538709320"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:43.975327 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d89f1f488806492d8c05899538709320 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:43.994418 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17df06cad1404d96bda5822be6a6e995 consensus state has no leader
W20260810 13:53:43.999477 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4ecf9abd60848f993234e98284974e8 consensus state has no leader
I20260810 13:53:44.009732 12951 leader_election.cc:304] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:44.012133 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_32e1324fe8ca42788d488f6d5ce8ca27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:44.014312 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32e1324fe8ca42788d488f6d5ce8ca27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:44.015585 14406 raft_consensus.cc:2749] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:43.985801 14389 rpcz_store.cc:276] 0810 13:53:42.593083 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.597100 (+ 4017us) service_pool.cc:224] Handling call
0810 13:53:42.646477 (+ 49377us) ts_tablet_manager.cc:1151] Deleting tablet e23454581a9a4b55b0756ef890dee7fb
0810 13:53:42.646541 (+ 64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:43.699008 (+1052467us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.938292 (+239284us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:43.969088 (+ 30796us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110595,"tablet-delete.queue_time_us":38012}
I20260810 13:53:44.024156 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet e23454581a9a4b55b0756ef890dee7fb (table default.Table_08582b65868149cca4ac724f7d18a869 [id=590b98307a364781a383eb9a072bb4d7]) successfully deleted
I20260810 13:53:44.032153 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435f585d225b492cb2b2e83fdb3a2b3d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:53:44.034483 13167 leader_election.cc:343] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:44.035609 14389 tablet_replica.cc:333] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
W20260810 13:53:44.038904 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 64e93928dcb94ae296590c4dedfd1781 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64e93928dcb94ae296590c4dedfd1781 already in progress: creating tablet
W20260810 13:53:44.039798 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet c4db9d7e82414cab8a69618effe89b40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4db9d7e82414cab8a69618effe89b40 already in progress: creating tablet
I20260810 13:53:44.042896 14389 raft_consensus.cc:2243] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:44.043784 14389 raft_consensus.cc:2272] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:43.917915 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 64397.6us
I20260810 13:53:44.051222 12951 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:44.052284 14406 raft_consensus.cc:3060] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:43.946941 14452 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:44.053157 14452 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:44.056254 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 435f585d225b492cb2b2e83fdb3a2b3d (table default.Table_9c735e2c23c24d01949057c6f5ab7055 [id=ca0d2f3d357749e8b2e23f6cfe8ea8ef]) successfully deleted
I20260810 13:53:44.060041 14389 ts_tablet_manager.cc:1916] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:43.896661 14273 raft_consensus.cc:2243] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:44.067088 14272 ts_tablet_manager.cc:1916] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:44.067605 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 214675us
I20260810 13:53:44.077227 13640 tablet_bootstrap.cc:654] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:44.082190 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_e96d10ab0bc341a3b9b5a18ef701ee95 [id=9a3a9159f7634bc999c5c10834eb41d3]). Expected version 2 got 0
I20260810 13:53:44.086925 14406 raft_consensus.cc:2749] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:44.096063 12749 master_service.cc:960] ReplaceTablet: received request to replace tablet e6bfb69a7ce74175b4f1f5f4db583aa9 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:44.098969 13639 tablet_bootstrap.cc:492] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:44.099051 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5b39c1bb4b614f97ab6eb4d521628013"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:44.099472 13639 ts_tablet_manager.cc:1403] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.484s user 0.012s sys 0.007s
I20260810 13:53:44.103931 13639 raft_consensus.cc:359] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:44.104521 13639 raft_consensus.cc:385] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:44.104787 13639 raft_consensus.cc:740] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:53:44.104947 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b39c1bb4b614f97ab6eb4d521628013 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:44.115972 13639 consensus_queue.cc:260] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:44.121346 13639 ts_tablet_manager.cc:1434] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.022s user 0.006s sys 0.001s
W20260810 13:53:44.122634 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 70571.5us
I20260810 13:53:44.129770 13639 tablet_bootstrap.cc:492] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:44.133584 14481 tablet.cc:1724] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:44.137537 13638 tablet_bootstrap.cc:492] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:44.137970 13638 ts_tablet_manager.cc:1403] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.248s user 0.017s sys 0.008s
I20260810 13:53:44.138113 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet a58df75cb91544ef863a09f4d6004da0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:44.141558 13638 raft_consensus.cc:359] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:44.142174 13638 raft_consensus.cc:385] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:44.142423 13638 raft_consensus.cc:740] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:44.143112 14444 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:42314 (request call id 188) took 2525 ms. Trace:
I20260810 13:53:43.914852 14394 raft_consensus.cc:2804] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:44.158821 14452 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:44.160182 12952 leader_election.cc:343] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: c549fde3bf9c44ccb18087a7bd64e435
I20260810 13:53:44.160310 14394 raft_consensus.cc:697] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:44.161337 14394 consensus_queue.cc:237] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:44.164429 14273 raft_consensus.cc:2272] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:44.167068 14273 ts_tablet_manager.cc:1916] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:44.143529 14444 rpcz_store.cc:276] 0810 13:53:41.617975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.618482 (+ 507us) service_pool.cc:224] Handling call
0810 13:53:44.143008 (+2524526us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:41.664270 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:41.664800 (+ 530us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:41.665073 (+ 273us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:41.665167 (+ 94us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:41.665414 (+ 247us) alter_schema_op.cc:128] START. Timestamp: 1786370021665218
0810 13:53:41.665439 (+ 25us) op_driver.cc:348] REPLICATION: starting
0810 13:53:41.746594 (+ 81155us) log.cc:844] Serialized 173 byte log entry
0810 13:53:42.383731 (+637137us) spinlock_profiling.cc:243] Waited 71.9 ms on lock 0x7b54000a3fa0. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f911eaad470 00007f911eabaa98 00007f911eaba6da 00007f911eb3ed45 00007f911eb3f1e9 00007f911efcef61 00007f911efce738 00007f911efd33d1 00007f911efd3389 00007f911efd3319 00007f911efd32e1
0810 13:53:43.546509 (+1162778us) op_driver.cc:464] REPLICATION: finished
0810 13:53:43.775995 (+229486us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:53:43.791603 (+ 15608us) log.cc:844] Serialized 5 byte log entry
0810 13:53:44.035663 (+244060us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.078003 (+ 42340us) log.cc:844] Serialized 14 byte log entry
0810 13:53:44.116895 (+ 38892us) alter_schema_op.cc:73] Released schema lock
0810 13:53:44.123659 (+ 6764us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":229290,"prepare.queue_time_us":44331,"prepare.run_cpu_time_us":15834,"prepare.run_wall_time_us":719635,"replication_time_us":1880874,"spinlock_wait_cycles":165321088,"thread_start_us":512361,"threads_started":4,"wal-append.queue_time_us":777539,"wal-append.run_cpu_time_us":1491,"wal-append.run_wall_time_us":1024740}]]}
I20260810 13:53:44.174777 13638 consensus_queue.cc:260] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:44.179769 13639 tablet_bootstrap.cc:654] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:44.198534 14452 raft_consensus.cc:493] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:44.199105 14452 raft_consensus.cc:515] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:44.201457 14452 leader_election.cc:290] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:44.212395 14272 ts_tablet_manager.cc:1929] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:44.212976 14272 log.cc:1199] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/1108f64f1260448b8a68ea9fe30ea494
I20260810 13:53:44.213936 14272 ts_tablet_manager.cc:1950] T 1108f64f1260448b8a68ea9fe30ea494 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:44.215060 13638 ts_tablet_manager.cc:1434] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.077s user 0.006s sys 0.004s
I20260810 13:53:44.218649 13638 tablet_bootstrap.cc:492] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:44.216620 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 182) took 3339 ms. Trace:
I20260810 13:53:44.232060 14272 rpcz_store.cc:276] 0810 13:53:40.877339 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.877448 (+ 109us) service_pool.cc:224] Handling call
0810 13:53:43.848627 (+2971179us) ts_tablet_manager.cc:1151] Deleting tablet 1108f64f1260448b8a68ea9fe30ea494
0810 13:53:43.848775 (+ 148us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.027966 (+179191us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b20000558b0. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1928e33211 00007f1928e63d43 00007f1928e6b7b2 00007f1928e6b731 00007f1928e6b6c1 00007f1928e6b681 00007f1928e6a3ed 00000000005bd8c4 00000000005bd6f9 00007f1920c5dfaf 00007f192820a446
0810 13:53:44.132040 (+104074us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.212227 (+ 80187us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.216556 (+ 4329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344855424,"tablet-delete.queue_time_us":2969930}
I20260810 13:53:44.235520 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 1108f64f1260448b8a68ea9fe30ea494 (table default.Table_339aa1d8438e452eb0447748597f32fb [id=444e5f8f6be54ddc8ec01e68ecb0e3c1]) successfully deleted
I20260810 13:53:44.235714 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 183) took 3222 ms. Trace:
I20260810 13:53:44.236085 14272 rpcz_store.cc:276] 0810 13:53:41.012991 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.013113 (+ 122us) service_pool.cc:224] Handling call
0810 13:53:44.235222 (+3222109us) ts_tablet_manager.cc:1151] Deleting tablet b7dded9a7c2c4652b41131f0bc14a6b5
0810 13:53:44.235295 (+ 73us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.235645 (+ 350us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3221378}
I20260810 13:53:44.238703 12746 master_service.cc:960] ReplaceTablet: received request to replace tablet ce9243eda3974532aff0425885f54166 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:44.249574 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e16662a9b5514b04b2d2fad48ad3d82f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:44.251195 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e16662a9b5514b04b2d2fad48ad3d82f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:44.254246 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6d2d5952d6e14e5f9d5b3cd2f0a29477" } new_table_name: "default.Table_ff3ff99b87ea436e913545b9e25fe5a6" modify_external_catalogs: true
I20260810 13:53:44.258848 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 188) took 2584 ms. Trace:
I20260810 13:53:44.260093 14272 rpcz_store.cc:276] 0810 13:53:41.674012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.709431 (+ 35419us) service_pool.cc:224] Handling call
0810 13:53:44.257724 (+2548293us) ts_tablet_manager.cc:1151] Deleting tablet 9453eab70fa04df8b0c89e6caf54c894
0810 13:53:44.257776 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.258780 (+ 1004us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2499403}
W20260810 13:53:44.261149 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet b7dded9a7c2c4652b41131f0bc14a6b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7dded9a7c2c4652b41131f0bc14a6b5 already in progress: creating tablet
W20260810 13:53:44.262668 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 9453eab70fa04df8b0c89e6caf54c894 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9453eab70fa04df8b0c89e6caf54c894 already in progress: creating tablet
I20260810 13:53:44.264050 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 190) took 2500 ms. Trace:
I20260810 13:53:44.269018 14272 rpcz_store.cc:276] 0810 13:53:41.763631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.767301 (+ 3670us) service_pool.cc:224] Handling call
0810 13:53:44.263308 (+2496007us) ts_tablet_manager.cc:1151] Deleting tablet e6bfb69a7ce74175b4f1f5f4db583aa9
0810 13:53:44.263367 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.263980 (+ 613us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2390404}
W20260810 13:53:44.271080 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bfb69a7ce74175b4f1f5f4db583aa9 already in progress: creating tablet
I20260810 13:53:44.271833 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 198) took 2178 ms. Trace:
I20260810 13:53:44.273437 14272 rpcz_store.cc:276] 0810 13:53:42.093705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.101153 (+ 7448us) service_pool.cc:224] Handling call
0810 13:53:44.271403 (+2170250us) ts_tablet_manager.cc:1151] Deleting tablet 587b591fb88a447b9bd5e071fa8c37e1
0810 13:53:44.271446 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.271768 (+ 322us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2169369}
W20260810 13:53:44.275678 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 587b591fb88a447b9bd5e071fa8c37e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 587b591fb88a447b9bd5e071fa8c37e1 already in progress: creating tablet
I20260810 13:53:44.276113 14272 tablet_replica.cc:333] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:44.277508 14272 raft_consensus.cc:2243] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:44.280521 14272 raft_consensus.cc:2272] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:44.293251 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_676bf4ad882d40c3b4ee02bcc60c973a" } new_table_name: "default.Table_0273e6188f99471782854cfcfc5ac382" modify_external_catalogs: true
I20260810 13:53:44.300822 14430 raft_consensus.cc:493] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:44.301589 14430 raft_consensus.cc:515] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:44.306316 14430 leader_election.cc:290] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:44.310988 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_04b11142c9fe418a8f08aaa2b71df931"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:44.312463 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04b11142c9fe418a8f08aaa2b71df931 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:44.313647 12743 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
W20260810 13:53:44.315924 12743 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 50) took 970 ms (client timeout 1000 ms). Trace:
W20260810 13:53:44.316321 12743 rpcz_store.cc:269] 0810 13:53:43.345668 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.369021 (+ 23353us) service_pool.cc:224] Handling call
0810 13:53:44.315850 (+946829us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260810 13:53:44.288604 13638 tablet_bootstrap.cc:654] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:44.329932 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
W20260810 13:53:44.332177 12742 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 55) took 913 ms (client timeout 1000 ms). Trace:
W20260810 13:53:44.332523 12742 rpcz_store.cc:269] 0810 13:53:43.419075 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.432073 (+ 12998us) service_pool.cc:224] Handling call
0810 13:53:43.462919 (+ 30846us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:44.332123 (+869204us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":66164096}
I20260810 13:53:44.335580 13208 tablet_service.cc:1511] Processing CreateTablet for tablet a42d57a7f6e2424998f5aebf0c8407d5 (DEFAULT_TABLE table=default.Table_d07ce1fd7efa43e0b4b3d40511253f11 [id=2d33e5d6a1544c008937912b78d2f970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.336758 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42d57a7f6e2424998f5aebf0c8407d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.340044 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 049416892e964159a06d5817932bbd7a (DEFAULT_TABLE table=default.Table_612d612a32794a8998dd3a19129b79c3 [id=840614d5bd744a82bf94fd2f23a31d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.341166 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049416892e964159a06d5817932bbd7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.343173 14272 ts_tablet_manager.cc:1916] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:44.347005 13022 tablet_service.cc:1511] Processing CreateTablet for tablet a42d57a7f6e2424998f5aebf0c8407d5 (DEFAULT_TABLE table=default.Table_d07ce1fd7efa43e0b4b3d40511253f11 [id=2d33e5d6a1544c008937912b78d2f970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.349427 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42d57a7f6e2424998f5aebf0c8407d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.349180 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffbabe58e034f26915504f2b1fa4679" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:44.353266 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:44.353021 13215 tablet_service.cc:1511] Processing CreateTablet for tablet bd127b3e02b54ba2a802877233c18247 (DEFAULT_TABLE table=default.Table_83e1fdd041db4bb598abc50295d4d742 [id=3015a76d1c2047ce9ef39782f8fe2734]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.353797 13223 tablet_service.cc:1511] Processing CreateTablet for tablet a27bf786a8274954afc2b2d8cfb34bf0 (DEFAULT_TABLE table=default.Table_ef6e22114411476e94fe56014112b3f5 [id=27b5aa40c6b548a7ba9e9fab15807055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.354792 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd127b3e02b54ba2a802877233c18247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.354807 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:44.355607 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:44.356487 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27bf786a8274954afc2b2d8cfb34bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.374697 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 049416892e964159a06d5817932bbd7a (DEFAULT_TABLE table=default.Table_612d612a32794a8998dd3a19129b79c3 [id=840614d5bd744a82bf94fd2f23a31d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.375430 12999 tablet_service.cc:1511] Processing CreateTablet for tablet a27bf786a8274954afc2b2d8cfb34bf0 (DEFAULT_TABLE table=default.Table_ef6e22114411476e94fe56014112b3f5 [id=27b5aa40c6b548a7ba9e9fab15807055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.377025 14486 tablet.cc:1724] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:44.377985 13006 tablet_service.cc:1511] Processing CreateTablet for tablet bd127b3e02b54ba2a802877233c18247 (DEFAULT_TABLE table=default.Table_83e1fdd041db4bb598abc50295d4d742 [id=3015a76d1c2047ce9ef39782f8fe2734]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.379429 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049416892e964159a06d5817932bbd7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.382447 13217 tablet_service.cc:1511] Processing CreateTablet for tablet aa0567b908974da5817ed62aafecee35 (DEFAULT_TABLE table=default.Table_c94325b8ad884fbf8fa662c283cbaf83 [id=8550046a1cf84e729bba99de4ff23879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.384702 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0567b908974da5817ed62aafecee35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.385625 13006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd127b3e02b54ba2a802877233c18247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.389626 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27bf786a8274954afc2b2d8cfb34bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.405526 13640 tablet_bootstrap.cc:492] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:44.406021 13640 ts_tablet_manager.cc:1403] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.628s user 0.004s sys 0.018s
W20260810 13:53:44.408803 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:53:44.410990 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:44.412034 12742 catalog_manager.cc:5719] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:44.413656 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
W20260810 13:53:44.413628 13167 leader_election.cc:343] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:44.423002 13012 tablet_service.cc:1511] Processing CreateTablet for tablet aa0567b908974da5817ed62aafecee35 (DEFAULT_TABLE table=default.Table_c94325b8ad884fbf8fa662c283cbaf83 [id=8550046a1cf84e729bba99de4ff23879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.426016 13638 tablet_bootstrap.cc:492] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:44.432149 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7cac512bcd48cfb6aaba4dc7e5681e (DEFAULT_TABLE table=default.Table_d460b63b63de413ebdeeb708b4be6b10 [id=3d7325460d7842658631298c2538a71c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.434578 13206 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7cac512bcd48cfb6aaba4dc7e5681e (DEFAULT_TABLE table=default.Table_d460b63b63de413ebdeeb708b4be6b10 [id=3d7325460d7842658631298c2538a71c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.436378 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7cac512bcd48cfb6aaba4dc7e5681e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.437693 13638 ts_tablet_manager.cc:1403] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.222s user 0.009s sys 0.003s
I20260810 13:53:44.444304 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0567b908974da5817ed62aafecee35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.449172 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7cac512bcd48cfb6aaba4dc7e5681e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.460007 14389 ts_tablet_manager.cc:1929] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:44.463261 14486 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 225) took 1592 ms. Trace:
I20260810 13:53:44.466958 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 2b67e5a2b5334147b9d25f2ddc73de31 (DEFAULT_TABLE table=default.Table_1d54dcbe3b494e9faf816d519e475447 [id=a49e38784fa14399a0eeddd34e651040]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.473901 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b67e5a2b5334147b9d25f2ddc73de31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.463884 14486 rpcz_store.cc:276] 0810 13:53:42.871287 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.871432 (+ 145us) service_pool.cc:224] Handling call
0810 13:53:44.463144 (+1591712us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:43.153234 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:43.153839 (+ 605us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:43.153882 (+ 43us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:43.153936 (+ 54us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:43.154091 (+ 155us) alter_schema_op.cc:128] START. Timestamp: 1786370023154009
0810 13:53:43.154120 (+ 29us) op_driver.cc:348] REPLICATION: starting
0810 13:53:43.154837 (+ 717us) log.cc:844] Serialized 173 byte log entry
0810 13:53:44.155065 (+1000228us) op_driver.cc:464] REPLICATION: finished
0810 13:53:44.376759 (+221694us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:53:44.391883 (+ 15124us) log.cc:844] Serialized 5 byte log entry
0810 13:53:44.437501 (+ 45618us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.454452 (+ 16951us) log.cc:844] Serialized 14 byte log entry
0810 13:53:44.462723 (+ 8271us) alter_schema_op.cc:73] Released schema lock
0810 13:53:44.462766 (+ 43us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":221356,"prepare.queue_time_us":278021,"prepare.run_cpu_time_us":2388,"prepare.run_wall_time_us":68281,"replication_time_us":1000820,"thread_start_us":574388,"threads_started":3,"wal-append.queue_time_us":11743}]]}
W20260810 13:53:44.484999 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 349894us
W20260810 13:53:44.486059 13382 consensus_peers.cc:597] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:44.469626 14389 log.cc:1199] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/435f585d225b492cb2b2e83fdb3a2b3d
I20260810 13:53:44.487353 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 2b67e5a2b5334147b9d25f2ddc73de31 (DEFAULT_TABLE table=default.Table_1d54dcbe3b494e9faf816d519e475447 [id=a49e38784fa14399a0eeddd34e651040]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.497582 14389 ts_tablet_manager.cc:1950] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:44.504846 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b67e5a2b5334147b9d25f2ddc73de31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.513273 13639 tablet_bootstrap.cc:492] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:44.513780 13639 ts_tablet_manager.cc:1403] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.384s user 0.023s sys 0.024s
I20260810 13:53:44.517164 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:44.516422 13639 raft_consensus.cc:359] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:44.521128 13639 raft_consensus.cc:385] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:44.521430 13639 raft_consensus.cc:740] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:44.521517 14272 ts_tablet_manager.cc:1929] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:44.521847 14272 log.cc:1199] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/e23454581a9a4b55b0756ef890dee7fb
I20260810 13:53:44.522048 13639 consensus_queue.cc:260] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:44.522568 14272 ts_tablet_manager.cc:1950] T e23454581a9a4b55b0756ef890dee7fb P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:44.522434 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:44.523335 13259 raft_consensus.cc:2468] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:44.541074 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 206) took 2264 ms. Trace:
I20260810 13:53:44.541411 14272 rpcz_store.cc:276] 0810 13:53:42.317794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.317918 (+ 124us) service_pool.cc:224] Handling call
0810 13:53:44.275959 (+1958041us) ts_tablet_manager.cc:1151] Deleting tablet e23454581a9a4b55b0756ef890dee7fb
0810 13:53:44.276006 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.415847 (+139841us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.521393 (+105546us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.541011 (+ 19618us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1886534}
I20260810 13:53:44.542197 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 215) took 1344 ms. Trace:
I20260810 13:53:44.543303 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet e23454581a9a4b55b0756ef890dee7fb (table default.Table_08582b65868149cca4ac724f7d18a869 [id=590b98307a364781a383eb9a072bb4d7]) successfully deleted
I20260810 13:53:44.542724 14389 rpcz_store.cc:276] 0810 13:53:43.197759 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.211053 (+ 13294us) service_pool.cc:224] Handling call
0810 13:53:44.035331 (+824278us) ts_tablet_manager.cc:1151] Deleting tablet 435f585d225b492cb2b2e83fdb3a2b3d
0810 13:53:44.035399 (+ 68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.236960 (+201561us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.459854 (+222894us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.542105 (+ 82251us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":823627}
I20260810 13:53:44.546211 14389 tablet_replica.cc:333] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:44.546381 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 435f585d225b492cb2b2e83fdb3a2b3d (table default.Table_9c735e2c23c24d01949057c6f5ab7055 [id=ca0d2f3d357749e8b2e23f6cfe8ea8ef]) successfully deleted
I20260810 13:53:44.487243 13638 raft_consensus.cc:359] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:44.555200 13638 raft_consensus.cc:385] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:44.555528 13638 raft_consensus.cc:740] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:44.557080 13639 ts_tablet_manager.cc:1434] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.043s user 0.007s sys 0.000s
I20260810 13:53:44.556680 13004 tablet_service.cc:1511] Processing CreateTablet for tablet 34b2314b771f41188bc8101c5ddffaf4 (DEFAULT_TABLE table=default.Table_0683f961d4714cc28fd3d3401e967335 [id=3d7bda70914045ae9251387d215b119b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.558020 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b2314b771f41188bc8101c5ddffaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.558079 13639 tablet_bootstrap.cc:492] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:44.560806 13640 raft_consensus.cc:359] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:44.561671 13640 raft_consensus.cc:385] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:44.562003 13640 raft_consensus.cc:740] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:44.575101 13638 consensus_queue.cc:260] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:44.578420 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 387ebbb8677c4fb082006585389c6582 (DEFAULT_TABLE table=default.Table_10638f441f654317829d436d2e7eb979 [id=4f21b5213a724ce5989d7684473d65e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.579599 13215 tablet_service.cc:1511] Processing CreateTablet for tablet 34b2314b771f41188bc8101c5ddffaf4 (DEFAULT_TABLE table=default.Table_0683f961d4714cc28fd3d3401e967335 [id=3d7bda70914045ae9251387d215b119b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.582003 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b2314b771f41188bc8101c5ddffaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.590060 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_344892871be4435d92b2bc22d49a4e6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:44.592499 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 17df06cad1404d96bda5822be6a6e995 (table default.Table_f101d8577cc1452ea2515229ebad2441 [id=eb2b695cdb5c4ee78dc155df3cc8e21f], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 17df06cad1404d96bda5822be6a6e995 consensus state has no leader
I20260810 13:53:44.591606 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_029a3ba2ee734a729e84a4482938ed5b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:44.593806 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_344892871be4435d92b2bc22d49a4e6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:44.594015 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_029a3ba2ee734a729e84a4482938ed5b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:44.594158 13217 tablet_service.cc:1511] Processing CreateTablet for tablet f668f6b35dc044a1a79f1d5852d39497 (DEFAULT_TABLE table=default.Table_bd72a75b5a4f4711bd19684dac743ea3 [id=c18879491d6c486f9efc439e3d239810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.596024 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f668f6b35dc044a1a79f1d5852d39497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.600841 13638 ts_tablet_manager.cc:1434] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.163s user 0.008s sys 0.001s
W20260810 13:53:44.606542 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5aa1374d37a4918af34a5e9b15c16b3 consensus state has no leader
I20260810 13:53:44.607134 13009 tablet_service.cc:1511] Processing CreateTablet for tablet f668f6b35dc044a1a79f1d5852d39497 (DEFAULT_TABLE table=default.Table_bd72a75b5a4f4711bd19684dac743ea3 [id=c18879491d6c486f9efc439e3d239810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.613374 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 0c4e37b80b7645c2a14f3ab0c5e919d2
I20260810 13:53:44.542651 14272 tablet_replica.cc:333] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:44.616011 14272 raft_consensus.cc:2243] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:44.616645 14272 raft_consensus.cc:2272] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:44.616825 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387ebbb8677c4fb082006585389c6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.618639 14272 ts_tablet_manager.cc:1916] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:44.619076 13229 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:44.621093 13010 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:44.621357 13638 tablet_bootstrap.cc:492] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:44.637910 13206 tablet_service.cc:1511] Processing CreateTablet for tablet 387ebbb8677c4fb082006585389c6582 (DEFAULT_TABLE table=default.Table_10638f441f654317829d436d2e7eb979 [id=4f21b5213a724ce5989d7684473d65e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.639115 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387ebbb8677c4fb082006585389c6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.633627 14389 raft_consensus.cc:2243] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:44.641216 14389 raft_consensus.cc:2272] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:44.643193 14389 ts_tablet_manager.cc:1916] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:44.645851 13229 tablet_service.cc:1511] Processing CreateTablet for tablet f922c9ca51044dcda08b245010ab06b0 (DEFAULT_TABLE table=default.Table_2dda46b17a89419abdb1f6d9ff61fb1d [id=4f643df81e154985a45b424943fa9379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.648149 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f922c9ca51044dcda08b245010ab06b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.661345 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f668f6b35dc044a1a79f1d5852d39497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.678193 14272 ts_tablet_manager.cc:1929] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:44.678581 14272 log.cc:1199] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/b857cf97c0244ef4be73f17e0a30fa3c
I20260810 13:53:44.679224 14272 ts_tablet_manager.cc:1950] T b857cf97c0244ef4be73f17e0a30fa3c P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:44.680084 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 211) took 1831 ms. Trace:
I20260810 13:53:44.680373 14272 rpcz_store.cc:276] 0810 13:53:42.849025 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.858010 (+ 8985us) service_pool.cc:224] Handling call
0810 13:53:44.542493 (+1684483us) ts_tablet_manager.cc:1151] Deleting tablet b857cf97c0244ef4be73f17e0a30fa3c
0810 13:53:44.542532 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.671450 (+128918us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.678031 (+ 6581us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:44.680029 (+ 1998us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1669196}
I20260810 13:53:44.690227 13007 tablet_service.cc:1511] Processing CreateTablet for tablet f922c9ca51044dcda08b245010ab06b0 (DEFAULT_TABLE table=default.Table_2dda46b17a89419abdb1f6d9ff61fb1d [id=4f643df81e154985a45b424943fa9379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.691427 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f922c9ca51044dcda08b245010ab06b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.692095 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet b857cf97c0244ef4be73f17e0a30fa3c (table default.Table_e63e2032b3d546d68f72a9add7b0ccaa [id=75a3bda0a82c4e94b96551672ea3550a]) successfully deleted
I20260810 13:53:44.693358 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 61fd4d043c354ad79d79c32498a469b4 (DEFAULT_TABLE table=default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.693979 13638 tablet_bootstrap.cc:654] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:44.694278 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61fd4d043c354ad79d79c32498a469b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.698060 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 212) took 1620 ms. Trace:
I20260810 13:53:44.698484 14272 rpcz_store.cc:276] 0810 13:53:43.077865 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.078070 (+ 205us) service_pool.cc:224] Handling call
0810 13:53:44.681366 (+1603296us) ts_tablet_manager.cc:1151] Deleting tablet 64e93928dcb94ae296590c4dedfd1781
0810 13:53:44.681425 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.697985 (+ 16560us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1602317}
I20260810 13:53:44.707854 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 918edf5d7b4f45009c5d476588399d0c (DEFAULT_TABLE table=default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.709240 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918edf5d7b4f45009c5d476588399d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.710556 13010 tablet_service.cc:1511] Processing CreateTablet for tablet db50d31d0d6c45faa1eb138357d532b3 (DEFAULT_TABLE table=default.Table_7b48ac1f84df4984b491045d0aa9b2c8 [id=3d5211b628f04d6489b589e6f03e6256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.711686 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db50d31d0d6c45faa1eb138357d532b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.715246 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 691aac16d50745d6965bebe94831b67b (DEFAULT_TABLE table=default.Table_8d67329481324de9a0e2b07b786da24e [id=205fbfef06484d8e854f6ef7f471944f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.716473 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691aac16d50745d6965bebe94831b67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.721764 13221 tablet_service.cc:1511] Processing CreateTablet for tablet db50d31d0d6c45faa1eb138357d532b3 (DEFAULT_TABLE table=default.Table_7b48ac1f84df4984b491045d0aa9b2c8 [id=3d5211b628f04d6489b589e6f03e6256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.722065 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 61169145c539464fa9cf62eaaf8168e5 (DEFAULT_TABLE table=default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.723115 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61169145c539464fa9cf62eaaf8168e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.723304 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db50d31d0d6c45faa1eb138357d532b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.724771 13018 tablet_service.cc:1511] Processing CreateTablet for tablet d6487d26c6524c38a313b54d5431b6f6 (DEFAULT_TABLE table=default.Table_e8940f9b8b5647b29566e6383b5c8fd7 [id=866777afb37d48b7bc025eba1377a8d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.725788 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6487d26c6524c38a313b54d5431b6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.725441 13210 tablet_service.cc:1511] Processing CreateTablet for tablet 918edf5d7b4f45009c5d476588399d0c (DEFAULT_TABLE table=default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.726828 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918edf5d7b4f45009c5d476588399d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.731981 13014 tablet_service.cc:1511] Processing CreateTablet for tablet ca4c0fea312c418f8ebd5c0619e7e220 (DEFAULT_TABLE table=default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.733289 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4c0fea312c418f8ebd5c0619e7e220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.745086 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 61169145c539464fa9cf62eaaf8168e5 (DEFAULT_TABLE table=default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.745086 13231 tablet_service.cc:1511] Processing CreateTablet for tablet ca4c0fea312c418f8ebd5c0619e7e220 (DEFAULT_TABLE table=default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.746348 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61169145c539464fa9cf62eaaf8168e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.746888 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4c0fea312c418f8ebd5c0619e7e220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.747695 13239 tablet_service.cc:1511] Processing CreateTablet for tablet d6487d26c6524c38a313b54d5431b6f6 (DEFAULT_TABLE table=default.Table_e8940f9b8b5647b29566e6383b5c8fd7 [id=866777afb37d48b7bc025eba1377a8d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.748652 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6487d26c6524c38a313b54d5431b6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.755798 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ce9243eda3974532aff0425885f54166
I20260810 13:53:44.763173 13227 tablet_service.cc:1511] Processing CreateTablet for tablet 691aac16d50745d6965bebe94831b67b (DEFAULT_TABLE table=default.Table_8d67329481324de9a0e2b07b786da24e [id=205fbfef06484d8e854f6ef7f471944f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.764379 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691aac16d50745d6965bebe94831b67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.767652 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2711040d5d0d4fc2aeae4dd363d789a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:44.769843 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2711040d5d0d4fc2aeae4dd363d789a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:44.773552 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 61fd4d043c354ad79d79c32498a469b4 (DEFAULT_TABLE table=default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.775190 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61fd4d043c354ad79d79c32498a469b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.775643 12746 catalog_manager.cc:6807] ReplaceTablet: tablet ce9243eda3974532aff0425885f54166 deleted and replaced by tablet f19e7aa805bd417eae45fb43ac18a66d
I20260810 13:53:44.783926 14430 raft_consensus.cc:493] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:44.784438 14430 raft_consensus.cc:515] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:44.802536 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 69ecda19e4f143c99654aff6058ad8bb (DEFAULT_TABLE table=default.Table_98e0a167c936447b8b277bc3c9ab07bc [id=51ed4f12e2584ca1b8240a919e8e8c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.803804 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ecda19e4f143c99654aff6058ad8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.817478 14430 leader_election.cc:290] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:44.838603 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1da7c92cdb10481480037763b0ec869b" } new_table_name: "default.Table_6794f1878ad14711ac8e25b0b4962ab8" modify_external_catalogs: true
I20260810 13:53:44.849711 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:53:44.850512 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 729ffbfd767f4aa0b95f6545011aae3d (DEFAULT_TABLE table=default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.851534 12750 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 332) took 1572 ms. Trace:
I20260810 13:53:44.857225 12739 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_a49a2f11e36d4162bc5847bacee456e7 [id=8aad892ad49f4c0aa7681d88843d3561] alter complete (version 2)
I20260810 13:53:44.860512 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729ffbfd767f4aa0b95f6545011aae3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.860517 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet ac9e3d3430044a5e85e2d812b7e221f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:44.851912 12750 rpcz_store.cc:276] 0810 13:53:43.278706 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.278949 (+ 243us) service_pool.cc:224] Handling call
0810 13:53:43.317312 (+ 38363us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c84d6 00007fec6df80b34 00007fec6df80ac2 00007fec6df809f1 00007fec6df8096c 00007fec6df7fc22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:43.318473 (+ 1161us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:43.318968 (+ 495us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:43.319085 (+ 117us) catalog_manager.cc:2850] Locking tablets
0810 13:53:44.333203 (+1014118us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:44.849248 (+516045us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:44.849493 (+ 245us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:44.849605 (+ 112us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:44.851463 (+ 1858us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:44.671550 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:44.672038 (+ 488us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:44.672084 (+ 46us) write_op.cc:435] Acquired schema lock
0810 13:53:44.672105 (+ 21us) tablet.cc:662] Decoding operations
0810 13:53:44.672506 (+ 401us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:44.672557 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:44.672592 (+ 35us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:44.672978 (+ 386us) tablet.cc:701] Row locks acquired
0810 13:53:44.672998 (+ 20us) write_op.cc:260] PREPARE: finished
0810 13:53:44.673120 (+ 122us) write_op.cc:270] Start()
0810 13:53:44.681755 (+ 8635us) write_op.cc:276] Timestamp: P: 1786370024673053 usec, L: 0
0810 13:53:44.681772 (+ 17us) op_driver.cc:348] REPLICATION: starting
0810 13:53:44.682270 (+ 498us) log.cc:844] Serialized 725 byte log entry
0810 13:53:44.841965 (+159695us) op_driver.cc:464] REPLICATION: finished
0810 13:53:44.845108 (+ 3143us) write_op.cc:301] APPLY: starting
0810 13:53:44.845187 (+ 79us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:44.845313 (+ 126us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:44.845427 (+ 114us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:44.845693 (+ 266us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:44.845884 (+ 191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:44.845953 (+ 69us) write_op.cc:312] APPLY: finished
0810 13:53:44.846145 (+ 192us) log.cc:844] Serialized 29 byte log entry
0810 13:53:44.846304 (+ 159us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:44.846381 (+ 77us) write_op.cc:454] Released schema lock
0810 13:53:44.846416 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:44.855065 (+ 8649us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:44.855102 (+ 37us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":85970304,"child_traces":[["op",{"apply.queue_time_us":3001,"apply.run_cpu_time_us":1586,"apply.run_wall_time_us":9897,"num_ops":2,"prepare.queue_time_us":336719,"prepare.run_cpu_time_us":2478,"prepare.run_wall_time_us":10962,"replication_time_us":160051}]]}
I20260810 13:53:44.917407 13048 raft_consensus.cc:3060] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:44.921334 13639 tablet_bootstrap.cc:654] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:44.923825 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 64e93928dcb94ae296590c4dedfd1781 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64e93928dcb94ae296590c4dedfd1781 already in progress: creating tablet
I20260810 13:53:44.925426 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 213) took 1839 ms. Trace:
I20260810 13:53:44.923384 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 69ecda19e4f143c99654aff6058ad8bb (DEFAULT_TABLE table=default.Table_98e0a167c936447b8b277bc3c9ab07bc [id=51ed4f12e2584ca1b8240a919e8e8c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.925740 14272 rpcz_store.cc:276] 0810 13:53:43.085594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.085759 (+ 165us) service_pool.cc:224] Handling call
0810 13:53:44.902251 (+1816492us) ts_tablet_manager.cc:1151] Deleting tablet c4db9d7e82414cab8a69618effe89b40
0810 13:53:44.902295 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.925368 (+ 23073us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1815751}
I20260810 13:53:44.926792 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ecda19e4f143c99654aff6058ad8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:44.937487 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d07ce1fd7efa43e0b4b3d40511253f11" } new_table_name: "default.Table_bb6d2c6934d94530af3f3a674b1f0f7f" modify_external_catalogs: true
I20260810 13:53:44.937850 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a8e82044d7a5494cb551eb7ca19322fe" } modify_external_catalogs: true
I20260810 13:53:44.938359 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a8e82044d7a5494cb551eb7ca19322fe" } modify_external_catalogs: true
I20260810 13:53:44.955617 13208 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffbabe58e034f26915504f2b1fa4679 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:44.928908 13000 tablet_service.cc:1558] Processing DeleteTablet for tablet ce9243eda3974532aff0425885f54166 with delete_type TABLET_DATA_DELETED (replaced by tablet f19e7aa805bd417eae45fb43ac18a66d) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:44.941762 12998 tablet_service.cc:1511] Processing CreateTablet for tablet 729ffbfd767f4aa0b95f6545011aae3d (DEFAULT_TABLE table=default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:44.942497 12997 tablet_service.cc:1558] Processing DeleteTablet for tablet ac9e3d3430044a5e85e2d812b7e221f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:44.948555 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2ad1e3a90f47ac83ca262cad9964f0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:44.960842 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet ce9243eda3974532aff0425885f54166 with delete_type TABLET_DATA_DELETED (replaced by tablet f19e7aa805bd417eae45fb43ac18a66d) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:44.971949 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet c4db9d7e82414cab8a69618effe89b40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4db9d7e82414cab8a69618effe89b40 already in progress: creating tablet
I20260810 13:53:44.982622 12743 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:44.983445 12743 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_e96d10ab0bc341a3b9b5a18ef701ee95 [id=9a3a9159f7634bc999c5c10834eb41d3]). Expected version 2 got 0
I20260810 13:53:44.985940 12743 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
I20260810 13:53:44.986795 12743 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:45.033061 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4afea2da7c54e508084be42dec35099" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:45.037947 12951 leader_election.cc:343] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: c549fde3bf9c44ccb18087a7bd64e435
I20260810 13:53:45.038398 12951 leader_election.cc:304] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:45.045959 13638 tablet_bootstrap.cc:492] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:45.046415 13638 ts_tablet_manager.cc:1403] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.425s user 0.021s sys 0.021s
I20260810 13:53:45.052856 13006 tablet_service.cc:1558] Processing DeleteTablet for tablet c549fde3bf9c44ccb18087a7bd64e435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:45.055712 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729ffbfd767f4aa0b95f6545011aae3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.055330 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4afea2da7c54e508084be42dec35099" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:45.058074 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:45.065068 14272 tablet_replica.cc:333] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:45.065902 14272 raft_consensus.cc:2243] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:45.078222 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f0e1196bb55b4d30ad90fd7b21cb48b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:45.049288 13638 raft_consensus.cc:359] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.101454 13638 raft_consensus.cc:385] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:45.101724 13638 raft_consensus.cc:740] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:45.102406 13638 consensus_queue.cc:260] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:45.119181 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 79743.8us
I20260810 13:53:45.133885 13640 consensus_queue.cc:260] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.172148 14429 raft_consensus.cc:493] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:45.173852 14429 raft_consensus.cc:515] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:45.176748 14272 raft_consensus.cc:2272] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:45.176985 14429 leader_election.cc:290] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:45.086310 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d447b3e1ee6a423dbe29ddad01c780b8" } modify_external_catalogs: true
I20260810 13:53:45.181777 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d447b3e1ee6a423dbe29ddad01c780b8" } modify_external_catalogs: true
W20260810 13:53:45.182947 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0e1196bb55b4d30ad90fd7b21cb48b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:45.099367 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 8b82b59b066c4240a387e7de48de9c70
W20260810 13:53:45.100714 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a42d57a7f6e2424998f5aebf0c8407d5 consensus state has no leader
W20260810 13:53:45.103017 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc5b9e218c1f4f4083acc59a651f0cb6 consensus state has no leader
I20260810 13:53:45.189270 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_60987375471143c6ad093952ccfeaeb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:45.190820 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60987375471143c6ad093952ccfeaeb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:45.194439 13229 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b82b59b066c4240a387e7de48de9c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:44 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:45.116948 14519 raft_consensus.cc:2749] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:45.168805 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 202801us
I20260810 13:53:45.205374 13640 ts_tablet_manager.cc:1434] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.799s user 0.019s sys 0.002s
W20260810 13:53:45.205844 13640 ts_tablet_manager.cc:1467] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: Tablet startup took 799ms
W20260810 13:53:45.206264 13640 ts_tablet_manager.cc:1469] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: Trace:
0810 13:53:31.374644 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:31.374772 (+ 128us) service_pool.cc:224] Handling call
0810 13:53:31.376244 (+ 1472us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:31.376340 (+ 96us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:31.467944 (+ 91604us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:31.656040 (+188096us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:31.656544 (+ 504us) inbound_call.cc:177] Queueing success response
0810 13:53:43.777426 (+12120882us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:53:44.406297 (+628871us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:53:44.407988 (+ 1691us) tablet_replica.cc:261] Starting instrumentation
0810 13:53:44.408579 (+ 591us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":38567,"raft.run_cpu_time_us":508,"raft.run_wall_time_us":507,"tablet-open.queue_time_us":12120985,"thread_start_us":67467,"threads_started":1}
I20260810 13:53:45.220590 13438 tablet_service.cc:1511] Processing CreateTablet for tablet a42d57a7f6e2424998f5aebf0c8407d5 (DEFAULT_TABLE table=default.Table_d07ce1fd7efa43e0b4b3d40511253f11 [id=2d33e5d6a1544c008937912b78d2f970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.222520 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a42d57a7f6e2424998f5aebf0c8407d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.226680 14273 ts_tablet_manager.cc:1929] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:45.227283 14273 log.cc:1199] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/9081f957f5824ed29603b1d84eff6906
I20260810 13:53:45.228312 14273 ts_tablet_manager.cc:1950] T 9081f957f5824ed29603b1d84eff6906 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:45.232616 13436 tablet_service.cc:1511] Processing CreateTablet for tablet a27bf786a8274954afc2b2d8cfb34bf0 (DEFAULT_TABLE table=default.Table_ef6e22114411476e94fe56014112b3f5 [id=27b5aa40c6b548a7ba9e9fab15807055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.233930 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27bf786a8274954afc2b2d8cfb34bf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.236756 13426 tablet_service.cc:1511] Processing CreateTablet for tablet f922c9ca51044dcda08b245010ab06b0 (DEFAULT_TABLE table=default.Table_2dda46b17a89419abdb1f6d9ff61fb1d [id=4f643df81e154985a45b424943fa9379]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.237911 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f922c9ca51044dcda08b245010ab06b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.241711 13428 tablet_service.cc:1511] Processing CreateTablet for tablet aa0567b908974da5817ed62aafecee35 (DEFAULT_TABLE table=default.Table_c94325b8ad884fbf8fa662c283cbaf83 [id=8550046a1cf84e729bba99de4ff23879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.242926 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0567b908974da5817ed62aafecee35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.243904 13638 ts_tablet_manager.cc:1434] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.197s user 0.005s sys 0.006s
I20260810 13:53:45.245536 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 5f7cac512bcd48cfb6aaba4dc7e5681e (DEFAULT_TABLE table=default.Table_d460b63b63de413ebdeeb708b4be6b10 [id=3d7325460d7842658631298c2538a71c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.246563 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f7cac512bcd48cfb6aaba4dc7e5681e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.249131 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 2b67e5a2b5334147b9d25f2ddc73de31 (DEFAULT_TABLE table=default.Table_1d54dcbe3b494e9faf816d519e475447 [id=a49e38784fa14399a0eeddd34e651040]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.250283 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b67e5a2b5334147b9d25f2ddc73de31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.253566 13435 tablet_service.cc:1511] Processing CreateTablet for tablet 34b2314b771f41188bc8101c5ddffaf4 (DEFAULT_TABLE table=default.Table_0683f961d4714cc28fd3d3401e967335 [id=3d7bda70914045ae9251387d215b119b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.254385 14272 ts_tablet_manager.cc:1916] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:45.254599 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34b2314b771f41188bc8101c5ddffaf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.256529 13382 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
W20260810 13:53:45.257498 13382 leader_election.cc:343] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:45.259106 14394 raft_consensus.cc:2804] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:45.259482 14394 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:45.259305 13427 tablet_service.cc:1511] Processing CreateTablet for tablet 387ebbb8677c4fb082006585389c6582 (DEFAULT_TABLE table=default.Table_10638f441f654317829d436d2e7eb979 [id=4f21b5213a724ce5989d7684473d65e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.259801 14394 raft_consensus.cc:3060] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:45.261660 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:45.263060 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet ce9243eda3974532aff0425885f54166 with delete_type TABLET_DATA_DELETED (replaced by tablet f19e7aa805bd417eae45fb43ac18a66d) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:45.266700 13442 tablet_service.cc:1511] Processing CreateTablet for tablet f668f6b35dc044a1a79f1d5852d39497 (DEFAULT_TABLE table=default.Table_bd72a75b5a4f4711bd19684dac743ea3 [id=c18879491d6c486f9efc439e3d239810]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.271195 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 61fd4d043c354ad79d79c32498a469b4 (DEFAULT_TABLE table=default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.230113 13432 tablet_service.cc:1511] Processing CreateTablet for tablet 049416892e964159a06d5817932bbd7a (DEFAULT_TABLE table=default.Table_612d612a32794a8998dd3a19129b79c3 [id=840614d5bd744a82bf94fd2f23a31d69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.231410 13434 tablet_service.cc:1511] Processing CreateTablet for tablet bd127b3e02b54ba2a802877233c18247 (DEFAULT_TABLE table=default.Table_83e1fdd041db4bb598abc50295d4d742 [id=3015a76d1c2047ce9ef39782f8fe2734]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:45.289920 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 170072us
I20260810 13:53:45.291836 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet cb8aea1057f445a9b060d138952324ca
W20260810 13:53:45.293833 13167 leader_election.cc:343] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:45.300722 13206 tablet_service.cc:1558] Processing DeleteTablet for tablet cb8aea1057f445a9b060d138952324ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:45.303248 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5d92bfb4e8eb4ad58e5aac4da446b255"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:45.305387 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d92bfb4e8eb4ad58e5aac4da446b255 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:45.308082 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c42d109e12a9416384e73d68761d43d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:45.309689 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c42d109e12a9416384e73d68761d43d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:45.314042 13638 tablet_bootstrap.cc:492] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:45.315840 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 691aac16d50745d6965bebe94831b67b (DEFAULT_TABLE table=default.Table_8d67329481324de9a0e2b07b786da24e [id=205fbfef06484d8e854f6ef7f471944f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.319883 13639 tablet_bootstrap.cc:492] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:45.320369 13639 ts_tablet_manager.cc:1403] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.762s user 0.011s sys 0.017s
I20260810 13:53:45.365199 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:45.367830 14272 ts_tablet_manager.cc:1929] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:45.368245 14272 log.cc:1199] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/a58df75cb91544ef863a09f4d6004da0
I20260810 13:53:45.377048 14272 ts_tablet_manager.cc:1950] T a58df75cb91544ef863a09f4d6004da0 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:45.377880 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 214) took 1585 ms. Trace:
I20260810 13:53:45.378199 14272 rpcz_store.cc:276] 0810 13:53:43.792784 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.793389 (+ 605us) service_pool.cc:224] Handling call
0810 13:53:44.971345 (+1177956us) ts_tablet_manager.cc:1151] Deleting tablet a58df75cb91544ef863a09f4d6004da0
0810 13:53:45.064887 (+ 93542us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:45.175830 (+110943us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b5800080fd0. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927dcb48a 00007f1927e4d827 00007f1927e77765 00007f19282b7d2c 00007f1928f1f41a 00007f1928f500e0 00007f1928f3664d 00007f1928f365f9 00007f1928f36589 00007f1928f36551
0810 13:53:45.331910 (+156080us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:45.367675 (+ 35765us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:45.377824 (+ 10149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177373440,"tablet-delete.queue_time_us":1165270}
I20260810 13:53:45.264343 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 69ecda19e4f143c99654aff6058ad8bb (DEFAULT_TABLE table=default.Table_98e0a167c936447b8b277bc3c9ab07bc [id=51ed4f12e2584ca1b8240a919e8e8c2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.276232 13424 tablet_service.cc:1511] Processing CreateTablet for tablet db50d31d0d6c45faa1eb138357d532b3 (DEFAULT_TABLE table=default.Table_7b48ac1f84df4984b491045d0aa9b2c8 [id=3d5211b628f04d6489b589e6f03e6256]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.385152 13427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 387ebbb8677c4fb082006585389c6582. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.398941 13014 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b82b59b066c4240a387e7de48de9c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:44 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:45.400969 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]) successfully deleted
W20260810 13:53:45.401317 14244 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 13:53:45.401821 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 already in progress: creating tablet
W20260810 13:53:45.402472 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ce9243eda3974532aff0425885f54166 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce9243eda3974532aff0425885f54166 already in progress: creating tablet
W20260810 13:53:45.402668 14244 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 13:53:45.403627 14244 flags.cc:432] Enabled unsafe flag: --never_fsync=true
I20260810 13:53:45.347741 14389 ts_tablet_manager.cc:1929] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:45.408715 14389 log.cc:1199] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/4b0ffad7efc24519957f2fb3be945b7d
I20260810 13:53:45.409785 14389 ts_tablet_manager.cc:1950] T 4b0ffad7efc24519957f2fb3be945b7d P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:45.423903 12745 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_e96d10ab0bc341a3b9b5a18ef701ee95 [id=9a3a9159f7634bc999c5c10834eb41d3] alter complete (version 2)
I20260810 13:53:45.427253 14430 raft_consensus.cc:493] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:45.427971 14430 raft_consensus.cc:515] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.431102 14430 leader_election.cc:290] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:45.439489 13638 tablet_bootstrap.cc:654] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:45.441046 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet cb8aea1057f445a9b060d138952324ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:45.443240 14272 tablet_replica.cc:333] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:45.443341 12749 master_service.cc:960] ReplaceTablet: received request to replace tablet ab4cd2e5c73e467eb1bc4623e5d5e831 from {username='slave'} at 127.0.0.1:48758
W20260810 13:53:45.443516 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ac9e3d3430044a5e85e2d812b7e221f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac9e3d3430044a5e85e2d812b7e221f5 already in progress: creating tablet
I20260810 13:53:45.443974 14272 raft_consensus.cc:2243] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:45.444406 14272 raft_consensus.cc:2272] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:45.446069 14272 ts_tablet_manager.cc:1916] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:45.449110 14529 raft_consensus.cc:493] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:45.449781 14529 raft_consensus.cc:515] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:45.453837 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b427bfff3734fa08370bfbc480cb802" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:45.441834 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b0ffad7efc24519957f2fb3be945b7d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:45.464620 12441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 59005.8us
I20260810 13:53:45.473311 13639 raft_consensus.cc:359] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:45.474138 13639 raft_consensus.cc:385] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:45.474599 13639 raft_consensus.cc:740] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:45.449416 13419 tablet_service.cc:1511] Processing CreateTablet for tablet d6487d26c6524c38a313b54d5431b6f6 (DEFAULT_TABLE table=default.Table_e8940f9b8b5647b29566e6383b5c8fd7 [id=866777afb37d48b7bc025eba1377a8d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.479348 13639 consensus_queue.cc:260] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:45.484349 13639 ts_tablet_manager.cc:1434] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.164s user 0.007s sys 0.000s
I20260810 13:53:45.491030 13639 tablet_bootstrap.cc:492] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:45.493759 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f668f6b35dc044a1a79f1d5852d39497. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.503821 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_98e0a167c936447b8b277bc3c9ab07bc" } new_table_name: "default.Table_3cf5094c58ae404aa2c68fa007294f77" modify_external_catalogs: true
I20260810 13:53:45.506912 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_85163b830b37444787dfe92a72503b29" } modify_external_catalogs: true
I20260810 13:53:45.507473 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_85163b830b37444787dfe92a72503b29" } modify_external_catalogs: true
I20260810 13:53:45.489641 14529 leader_election.cc:290] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:45.508862 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 918edf5d7b4f45009c5d476588399d0c (DEFAULT_TABLE table=default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.510217 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8d67329481324de9a0e2b07b786da24e" } new_table_name: "default.Table_e87df72c6b134d5cbfd146205ab6f1bb" modify_external_catalogs: true
I20260810 13:53:45.511234 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1d54dcbe3b494e9faf816d519e475447" } modify_external_catalogs: true
I20260810 13:53:45.511741 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1d54dcbe3b494e9faf816d519e475447" } modify_external_catalogs: true
W20260810 13:53:45.513865 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 142273us
I20260810 13:53:45.517267 13420 tablet_service.cc:1511] Processing CreateTablet for tablet 61169145c539464fa9cf62eaaf8168e5 (DEFAULT_TABLE table=default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.519498 12743 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:45.427042 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 216) took 2010 ms. Trace:
I20260810 13:53:45.521365 14389 rpcz_store.cc:276] 0810 13:53:43.416195 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.440053 (+ 23858us) service_pool.cc:224] Handling call
0810 13:53:44.545975 (+1105922us) ts_tablet_manager.cc:1151] Deleting tablet 4b0ffad7efc24519957f2fb3be945b7d
0810 13:53:44.546020 (+ 45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:45.042955 (+496935us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:45.347551 (+304596us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:45.426944 (+ 79393us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1104652}
I20260810 13:53:45.550318 14389 tablet_replica.cc:333] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:45.551930 14389 raft_consensus.cc:2243] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 13:53:45.554435 13167 leader_election.cc:343] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:45.556931 12952 leader_election.cc:343] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 4b0ffad7efc24519957f2fb3be945b7d
I20260810 13:53:45.557982 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 4b0ffad7efc24519957f2fb3be945b7d (table default.Table_3687705a4de844f59a3c7e3af511980e [id=71df08438fab431cb91d9560374ce19c]) successfully deleted
I20260810 13:53:45.509939 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b427bfff3734fa08370bfbc480cb802 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:45.566561 14389 raft_consensus.cc:2272] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:45.570699 14389 ts_tablet_manager.cc:1916] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:45.589370 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 691aac16d50745d6965bebe94831b67b consensus state has no leader
W20260810 13:53:45.592767 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 69ecda19e4f143c99654aff6058ad8bb consensus state has no leader
I20260810 13:53:45.601925 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307a6b609b674afbb684147005b66d87" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:45.627534 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffbabe58e034f26915504f2b1fa4679" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:45.628309 13468 raft_consensus.cc:2468] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:45.636518 14529 raft_consensus.cc:493] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:45.639441 14529 raft_consensus.cc:515] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:45.641347 14529 leader_election.cc:290] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:45.636791 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b427bfff3734fa08370bfbc480cb802" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:45.632577 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2ad1e3a90f47ac83ca262cad9964f0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:45.601409 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "307a6b609b674afbb684147005b66d87" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:45.644029 13465 raft_consensus.cc:2468] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:45.647472 13474 raft_consensus.cc:2468] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:45.648267 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet ac9e3d3430044a5e85e2d812b7e221f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:45.649390 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 729ffbfd767f4aa0b95f6545011aae3d (DEFAULT_TABLE table=default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.653561 14272 ts_tablet_manager.cc:1929] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:45.654232 14272 log.cc:1199] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/c549fde3bf9c44ccb18087a7bd64e435
I20260810 13:53:45.576632 13639 tablet_bootstrap.cc:654] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:45.663210 14272 ts_tablet_manager.cc:1950] T c549fde3bf9c44ccb18087a7bd64e435 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:45.651214 13417 tablet_service.cc:1511] Processing CreateTablet for tablet ca4c0fea312c418f8ebd5c0619e7e220 (DEFAULT_TABLE table=default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:45.677104 14560 tablet.cc:1724] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 13:53:45.690903 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 69ecda19e4f143c99654aff6058ad8bb (table default.Table_3cf5094c58ae404aa2c68fa007294f77 [id=51ed4f12e2584ca1b8240a919e8e8c2c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 69ecda19e4f143c99654aff6058ad8bb consensus state has no leader
I20260810 13:53:45.693126 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_88dee97116de4d0dac8a7af552b06f14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:45.695566 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88dee97116de4d0dac8a7af552b06f14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:45.707966 14389 ts_tablet_manager.cc:1929] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:45.708359 14389 log.cc:1199] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/a58df75cb91544ef863a09f4d6004da0
I20260810 13:53:45.708312 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet c549fde3bf9c44ccb18087a7bd64e435 (table default.Table_1befb4abf1054ff0900cb2c6dfe3b126 [id=35cc992f73c943c3a468c8ef4e5c0283]) successfully deleted
I20260810 13:53:45.709327 14389 ts_tablet_manager.cc:1950] T a58df75cb91544ef863a09f4d6004da0 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:45.665721 13640 tablet_bootstrap.cc:492] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:45.711972 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 217) took 1959 ms. Trace:
I20260810 13:53:45.712301 14389 rpcz_store.cc:276] 0810 13:53:43.752375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.757997 (+ 5622us) service_pool.cc:224] Handling call
0810 13:53:45.550033 (+1792036us) ts_tablet_manager.cc:1151] Deleting tablet a58df75cb91544ef863a09f4d6004da0
0810 13:53:45.550091 (+ 58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:45.700717 (+150626us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:45.707839 (+ 7122us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:45.711909 (+ 4070us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1732959}
I20260810 13:53:45.711558 14557 tablet.cc:1724] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:45.713795 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]) successfully deleted
I20260810 13:53:45.714403 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 228) took 1096 ms. Trace:
I20260810 13:53:45.713769 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:45.714751 14389 rpcz_store.cc:276] 0810 13:53:44.618544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:44.618775 (+ 231us) service_pool.cc:224] Handling call
0810 13:53:45.714028 (+1095253us) ts_tablet_manager.cc:1151] Deleting tablet 0c4e37b80b7645c2a14f3ab0c5e919d2
0810 13:53:45.714068 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:45.714346 (+ 278us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094237}
W20260810 13:53:45.717103 13382 leader_election.cc:343] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:45.715672 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4f7895e8b4164093b5fa194d7f828d2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:45.718740 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f7895e8b4164093b5fa194d7f828d2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:45.719081 14389 tablet_replica.cc:333] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:45.720010 14389 raft_consensus.cc:2243] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
W20260810 13:53:45.717257 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 already in progress: creating tablet
I20260810 13:53:45.717089 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_579f9018ca714115bc18b1407243895e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:45.723680 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db50d31d0d6c45faa1eb138357d532b3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:45.723618 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_579f9018ca714115bc18b1407243895e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:45.727458 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ac9e3d3430044a5e85e2d812b7e221f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac9e3d3430044a5e85e2d812b7e221f5 already in progress: creating tablet
I20260810 13:53:45.720525 14389 raft_consensus.cc:2272] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:45.733740 14389 ts_tablet_manager.cc:1916] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:45.734737 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet e4afea2da7c54e508084be42dec35099 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:45.735329 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b82b59b066c4240a387e7de48de9c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:44 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:45.736172 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049416892e964159a06d5817932bbd7a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:45.737816 13382 leader_election.cc:343] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:45.620743 14394 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.697152 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 435f585d225b492cb2b2e83fdb3a2b3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:29 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:45.703070 12952 leader_election.cc:343] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 435f585d225b492cb2b2e83fdb3a2b3d
W20260810 13:53:45.748518 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 45495.7us
I20260810 13:53:45.754310 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ecda19e4f143c99654aff6058ad8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.758026 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 191) took 4911 ms. Trace:
I20260810 13:53:45.758529 14273 rpcz_store.cc:276] 0810 13:53:40.846594 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.846719 (+ 125us) service_pool.cc:224] Handling call
0810 13:53:43.894916 (+3048197us) ts_tablet_manager.cc:1151] Deleting tablet 9081f957f5824ed29603b1d84eff6906
0810 13:53:43.895044 (+ 128us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:44.563211 (+668167us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:45.226416 (+663205us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:45.624590 (+398174us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4dc68 00007fb87ae4db8b 00007fb883dbb1d9 00007fb882fd34e8 00007fb88309a562 00007fb8830cb0e0 00007fb8830b164d 00007fb8830b15f9 00007fb8830b1589 00007fb8830b1551
0810 13:53:45.757933 (+133343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36786816,"tablet-delete.queue_time_us":3047577}
I20260810 13:53:45.759444 13639 tablet_bootstrap.cc:492] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:45.759878 13639 ts_tablet_manager.cc:1403] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.269s user 0.014s sys 0.000s
I20260810 13:53:45.738209 13382 leader_election.cc:304] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:45.760562 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 918edf5d7b4f45009c5d476588399d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.774397 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_e96d10ab0bc341a3b9b5a18ef701ee95 [id=9a3a9159f7634bc999c5c10834eb41d3]). Expected version 2 got 0
I20260810 13:53:45.775347 12739 master_service.cc:960] ReplaceTablet: received request to replace tablet 2327309017db4094907b3e405988f224 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:45.777634 14521 raft_consensus.cc:2749] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:45.779639 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_e96d10ab0bc341a3b9b5a18ef701ee95 [id=9a3a9159f7634bc999c5c10834eb41d3]). Expected version 2 got 0
I20260810 13:53:45.782232 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca4c0fea312c418f8ebd5c0619e7e220. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:45.783150 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 8b82b59b066c4240a387e7de48de9c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b82b59b066c4240a387e7de48de9c70 already in progress: creating tablet
I20260810 13:53:45.787799 14562 tablet.cc:1724] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:45.789880 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61fd4d043c354ad79d79c32498a469b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.790928 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_3ffb4babc30c4b76ae97168cb6dbdeee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:45.795877 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61169145c539464fa9cf62eaaf8168e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:45.798664 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet cb8aea1057f445a9b060d138952324ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb8aea1057f445a9b060d138952324ca already in progress: creating tablet
W20260810 13:53:45.799506 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3ffb4babc30c4b76ae97168cb6dbdeee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:45.800845 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 192) took 4333 ms. Trace:
I20260810 13:53:45.800930 13638 tablet_bootstrap.cc:492] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:45.801378 13638 ts_tablet_manager.cc:1403] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.488s user 0.014s sys 0.005s
I20260810 13:53:45.801174 14273 rpcz_store.cc:276] 0810 13:53:41.467456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.488671 (+ 21215us) service_pool.cc:224] Handling call
0810 13:53:45.759767 (+4271096us) ts_tablet_manager.cc:1151] Deleting tablet b7dded9a7c2c4652b41131f0bc14a6b5
0810 13:53:45.769047 (+ 9280us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:45.800788 (+ 31741us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4270502}
I20260810 13:53:45.803810 13638 raft_consensus.cc:359] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.804392 13638 raft_consensus.cc:385] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:45.799449 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:45.807001 13639 raft_consensus.cc:359] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.807633 13639 raft_consensus.cc:385] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:45.807890 13639 raft_consensus.cc:740] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:45.809068 14272 tablet_replica.cc:333] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:45.809872 14272 raft_consensus.cc:2243] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:45.810309 14272 raft_consensus.cc:2272] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:45.804628 13638 raft_consensus.cc:740] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:45.811034 14273 tablet_replica.cc:333] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:45.822520 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691aac16d50745d6965bebe94831b67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.823311 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_60987375471143c6ad093952ccfeaeb7" } new_table_name: "default.Table_9067fca42e9747aa95a4c21c97b3bb7f" modify_external_catalogs: true
I20260810 13:53:45.826869 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2d86969193af498baf3c431d50572095" } new_table_name: "default.Table_25022662dc9f47efbf32de19c684ea1b" modify_external_catalogs: true
I20260810 13:53:45.827418 14272 ts_tablet_manager.cc:1916] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:45.828027 13640 tablet_bootstrap.cc:654] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:45.832845 13639 consensus_queue.cc:260] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.833948 13638 consensus_queue.cc:260] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.857717 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6487d26c6524c38a313b54d5431b6f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.866204 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729ffbfd767f4aa0b95f6545011aae3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.874112 13639 ts_tablet_manager.cc:1434] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.114s user 0.007s sys 0.000s
W20260810 13:53:45.878468 14549 log.cc:927] Time spent T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260810 13:53:45.880870 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd127b3e02b54ba2a802877233c18247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:45.888295 13638 ts_tablet_manager.cc:1434] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.087s user 0.007s sys 0.000s
I20260810 13:53:45.903069 13639 tablet_bootstrap.cc:492] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:45.906908 13638 tablet_bootstrap.cc:492] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:45.908375 14273 raft_consensus.cc:2243] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:45.914762 14523 raft_consensus.cc:493] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:45.916016 14523 raft_consensus.cc:515] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.918191 14523 leader_election.cc:290] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:45.941092 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:53:45.941567 14273 pending_rounds.cc:70] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: Trying to abort 1 pending ops.
I20260810 13:53:45.941900 14273 pending_rounds.cc:77] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971608306802688 op_type: NO_OP noop_request { }
I20260810 13:53:45.942298 14273 raft_consensus.cc:2889] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:45.942628 14273 raft_consensus.cc:2272] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:45.943660 13638 tablet_bootstrap.cc:654] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:45.951740 14394 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:45.954809 13639 tablet_bootstrap.cc:654] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:45.965668 14272 ts_tablet_manager.cc:1929] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:45.966181 14272 log.cc:1199] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/4b0ffad7efc24519957f2fb3be945b7d
I20260810 13:53:45.967016 14272 ts_tablet_manager.cc:1950] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:45.979266 14272 tablet_replica.cc:333] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:45.980067 14272 raft_consensus.cc:2243] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:45.980530 14272 raft_consensus.cc:2272] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:45.982731 14272 ts_tablet_manager.cc:1916] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:45.965144 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 105954us
I20260810 13:53:45.984804 14523 consensus_queue.cc:1048] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:45.986941 13639 tablet_bootstrap.cc:492] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:45.987411 13639 ts_tablet_manager.cc:1403] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.087s user 0.008s sys 0.008s
I20260810 13:53:45.989717 13639 raft_consensus.cc:359] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:45.990437 13639 raft_consensus.cc:385] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:45.992148 13639 raft_consensus.cc:740] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:45.993168 13639 consensus_queue.cc:260] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.001516 14273 ts_tablet_manager.cc:1916] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:46.008366 13639 ts_tablet_manager.cc:1434] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
W20260810 13:53:45.991302 14244 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 13:53:46.012481 14244 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260810 13:53:46.015892 14244 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 13:53:46.016338 14244 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260810 13:53:46.018404 13639 tablet_bootstrap.cc:492] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:46.029548 13639 tablet_bootstrap.cc:654] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:46.023546 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 4b0ffad7efc24519957f2fb3be945b7d (table default.Table_3687705a4de844f59a3c7e3af511980e [id=71df08438fab431cb91d9560374ce19c]) successfully deleted
I20260810 13:53:46.094607 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet 9566586ecdd24e94bad62906c2166afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:46.095805 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b427bfff3734fa08370bfbc480cb802 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:46.110107 14495 raft_consensus.cc:493] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:53:46.110714 14495 raft_consensus.cc:515] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:46.111919 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_96d399d7e8e243f49475d1952c32e376"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:46.113457 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96d399d7e8e243f49475d1952c32e376 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:46.114997 14495 leader_election.cc:290] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:46.119824 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a43def9358894b2aa001a7db56706589 consensus state has no leader
W20260810 13:53:46.124873 14557 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.238s user 0.004s sys 0.004s
I20260810 13:53:46.127830 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_df8743b260984398bf1a3a7c1ee5c4a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:46.134958 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df8743b260984398bf1a3a7c1ee5c4a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:46.139022 14272 ts_tablet_manager.cc:1929] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:46.139420 14272 log.cc:1199] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/435f585d225b492cb2b2e83fdb3a2b3d
I20260810 13:53:46.131532 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:46.140043 14272 ts_tablet_manager.cc:1950] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:46.140102 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d891e763a1854b6a8bda1071448fd8e0 has no consensus state
I20260810 13:53:46.149644 14512 raft_consensus.cc:493] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:46.150159 14512 raft_consensus.cc:515] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.152077 14512 leader_election.cc:290] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:46.154681 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9566586ecdd24e94bad62906c2166afd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:46.156209 13167 leader_election.cc:343] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:46.158257 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 435f585d225b492cb2b2e83fdb3a2b3d (table default.Table_9c735e2c23c24d01949057c6f5ab7055 [id=ca0d2f3d357749e8b2e23f6cfe8ea8ef]) successfully deleted
I20260810 13:53:46.159368 14272 tablet_replica.cc:333] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:46.160673 14272 raft_consensus.cc:2243] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:46.165371 14272 raft_consensus.cc:2272] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:46.174156 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 187433us
I20260810 13:53:46.175066 14272 ts_tablet_manager.cc:1916] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:46.178753 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ffbabe58e034f26915504f2b1fa4679 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:30 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:46.180079 13639 tablet_bootstrap.cc:492] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:46.180497 13639 ts_tablet_manager.cc:1403] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.162s user 0.007s sys 0.003s
I20260810 13:53:46.184063 13639 raft_consensus.cc:359] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.184696 13639 raft_consensus.cc:385] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:46.184957 13639 raft_consensus.cc:740] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:46.187125 13640 tablet_bootstrap.cc:492] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:46.187615 13640 ts_tablet_manager.cc:1403] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.550s user 0.004s sys 0.013s
I20260810 13:53:46.190632 13640 raft_consensus.cc:359] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.191316 13640 raft_consensus.cc:385] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:46.191625 13640 raft_consensus.cc:740] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:46.192263 13640 consensus_queue.cc:260] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.198278 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
I20260810 13:53:46.207098 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:46.207873 13638 tablet_bootstrap.cc:492] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:46.209013 13638 ts_tablet_manager.cc:1403] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.302s user 0.023s sys 0.019s
I20260810 13:53:46.211885 14389 ts_tablet_manager.cc:1929] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:46.212291 14389 log.cc:1199] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/8ffbabe58e034f26915504f2b1fa4679
I20260810 13:53:46.212903 13435 tablet_service.cc:1558] Processing DeleteTablet for tablet 9566586ecdd24e94bad62906c2166afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:46.215536 12951 leader_election.cc:343] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 4b0ffad7efc24519957f2fb3be945b7d
I20260810 13:53:46.215961 12951 leader_election.cc:304] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:46.216485 12951 raft_consensus.cc:2686] T 4b0ffad7efc24519957f2fb3be945b7d P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:46.219806 14589 tablet.cc:1719] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Skipping requested alter to schema version 2, tablet already version 2
I20260810 13:53:46.220175 13640 ts_tablet_manager.cc:1434] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
I20260810 13:53:46.185598 13639 consensus_queue.cc:260] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.227373 14529 raft_consensus.cc:493] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:46.227818 14529 raft_consensus.cc:515] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.229708 13640 tablet_bootstrap.cc:492] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:46.238039 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 9081f957f5824ed29603b1d84eff6906 (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]) successfully deleted
I20260810 13:53:46.239503 13442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 241) took 1007 ms. Trace:
I20260810 13:53:46.239941 13442 rpcz_store.cc:276] 0810 13:53:45.232479 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.265124 (+ 32645us) service_pool.cc:224] Handling call
0810 13:53:45.267601 (+ 2477us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.267820 (+ 219us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:45.929908 (+662088us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.239038 (+309130us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.239449 (+ 411us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:53:46.240280 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet b7dded9a7c2c4652b41131f0bc14a6b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b7dded9a7c2c4652b41131f0bc14a6b5 already in progress: creating tablet
I20260810 13:53:46.257128 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:46.213941 13164 leader_election.cc:304] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:46.221333 13638 raft_consensus.cc:359] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.258355 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9566586ecdd24e94bad62906c2166afd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:46.258778 13638 raft_consensus.cc:385] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:53:46.258920 13164 raft_consensus.cc:2686] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:46.259069 13638 raft_consensus.cc:740] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:46.259454 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 45624.5us
I20260810 13:53:46.259678 13638 consensus_queue.cc:260] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.261652 13638 ts_tablet_manager.cc:1434] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.052s user 0.006s sys 0.000s
I20260810 13:53:46.261611 13164 leader_election.cc:304] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:46.262176 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:46.262490 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9566586ecdd24e94bad62906c2166afd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:46.263070 13255 raft_consensus.cc:2468] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:46.264091 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:46.264796 13264 raft_consensus.cc:3060] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:46.270219 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:46.272279 13638 tablet_bootstrap.cc:492] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:46.273312 14389 ts_tablet_manager.cc:1950] T 8ffbabe58e034f26915504f2b1fa4679 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:46.276943 14512 raft_consensus.cc:2804] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:46.277278 14512 raft_consensus.cc:493] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:46.277669 14512 raft_consensus.cc:3060] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:46.279760 13164 leader_election.cc:304] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:46.281252 13164 leader_election.cc:343] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 435f585d225b492cb2b2e83fdb3a2b3d
I20260810 13:53:46.281630 13164 leader_election.cc:304] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:46.282166 13164 raft_consensus.cc:2686] T 435f585d225b492cb2b2e83fdb3a2b3d P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:46.285674 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9566586ecdd24e94bad62906c2166afd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:46.286324 13476 raft_consensus.cc:2468] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:46.287075 13638 tablet_bootstrap.cc:654] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:46.293017 14596 raft_consensus.cc:493] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:46.293514 14596 raft_consensus.cc:515] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.297351 13429 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 251) took 1058 ms. Trace:
I20260810 13:53:46.297706 13429 rpcz_store.cc:276] 0810 13:53:45.239009 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.263560 (+ 24551us) service_pool.cc:224] Handling call
0810 13:53:45.741948 (+478388us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.742034 (+ 86us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:45.982165 (+240131us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.296860 (+314695us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.297291 (+ 431us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55081,"spinlock_wait_cycles":9984}
I20260810 13:53:46.298455 14597 raft_consensus.cc:2804] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:46.298848 14597 raft_consensus.cc:493] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:46.299183 14597 raft_consensus.cc:3060] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:46.300230 14560 tablet.cc:1719] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Skipping requested alter to schema version 2, tablet already version 2
I20260810 13:53:46.301574 13425 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 243) took 1065 ms. Trace:
I20260810 13:53:46.307168 14529 leader_election.cc:290] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:46.307722 12717 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 67449.8us
I20260810 13:53:46.308221 14596 leader_election.cc:290] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:46.305459 14495 consensus_queue.cc:1048] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:46.310672 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 3b7b408a9ad34ea39c912b33e26b49b6 (DEFAULT_TABLE table=default.Table_029a3ba2ee734a729e84a4482938ed5b [id=b437e76811d440ca817fca27a8dcbd45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.311681 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b7b408a9ad34ea39c912b33e26b49b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.313035 13424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 244) took 1076 ms. Trace:
I20260810 13:53:46.313401 13424 rpcz_store.cc:276] 0810 13:53:45.236550 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.273051 (+ 36501us) service_pool.cc:224] Handling call
0810 13:53:45.653190 (+380139us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.715689 (+ 62499us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.145853 (+430164us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.312533 (+166680us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.312977 (+ 444us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11520}
I20260810 13:53:46.316459 13432 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 231) took 1087 ms. Trace:
I20260810 13:53:46.316847 13432 rpcz_store.cc:276] 0810 13:53:45.229078 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.229267 (+ 189us) service_pool.cc:224] Handling call
0810 13:53:45.735639 (+506372us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.735753 (+ 114us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.162771 (+427018us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.315996 (+153225us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.316384 (+ 388us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:46.302753 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet cb8aea1057f445a9b060d138952324ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:46.317907 13434 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 232) took 1088 ms. Trace:
I20260810 13:53:46.301926 13425 rpcz_store.cc:276] 0810 13:53:45.236162 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.268389 (+ 32227us) service_pool.cc:224] Handling call
0810 13:53:45.753520 (+485131us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.753636 (+ 116us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.158457 (+404821us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.301099 (+142642us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.301517 (+ 418us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:46.343204 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a8f5484f0ff14287be783696e6d8525d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:46.344635 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a8f5484f0ff14287be783696e6d8525d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:46.343076 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_23f1932076424658b335360b8c388398"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:46.349376 12739 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 2327309017db4094907b3e405988f224
W20260810 13:53:46.349908 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23f1932076424658b335360b8c388398 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:46.351025 12739 catalog_manager.cc:6807] ReplaceTablet: tablet 2327309017db4094907b3e405988f224 deleted and replaced by tablet 75b8030450554de3b97266f348329ea6
I20260810 13:53:46.352855 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 2b67e5a2b5334147b9d25f2ddc73de31
I20260810 13:53:46.352995 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet 2327309017db4094907b3e405988f224 with delete_type TABLET_DATA_DELETED (replaced by tablet 75b8030450554de3b97266f348329ea6) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:46.355568 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b67e5a2b5334147b9d25f2ddc73de31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:46.361800 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_98a42639f8ba4a309871c78bbf949d88" } new_table_name: "default.Table_85f493dcd0f449778d7b96db1b7944df" modify_external_catalogs: true
I20260810 13:53:46.371186 13264 raft_consensus.cc:2468] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:46.371417 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet 2327309017db4094907b3e405988f224 with delete_type TABLET_DATA_DELETED (replaced by tablet 75b8030450554de3b97266f348329ea6) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:46.373261 13210 tablet_service.cc:1511] Processing CreateTablet for tablet 3b7b408a9ad34ea39c912b33e26b49b6 (DEFAULT_TABLE table=default.Table_029a3ba2ee734a729e84a4482938ed5b [id=b437e76811d440ca817fca27a8dcbd45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.374987 13223 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b67e5a2b5334147b9d25f2ddc73de31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:46.378458 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 7a745bc711004993830b40ca1c93c63b (DEFAULT_TABLE table=default.Table_d89f1f488806492d8c05899538709320 [id=a00844083e02450fadf3bed852ffa31b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.381614 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a745bc711004993830b40ca1c93c63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.318207 13434 rpcz_store.cc:276] 0810 13:53:45.229441 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.230709 (+ 1268us) service_pool.cc:224] Handling call
0810 13:53:45.621207 (+390498us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d521 00007fb87ae4d3d2 00007fb883d91fb9 00007fb882fd3640 00007fb8830b8641 00007fb8830958d3 00007fb883044210 00007fb8815d0bf4 00007fb8815d0b82 00007fb8815d0ab1
0810 13:53:45.647824 (+ 26617us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d84c 00007fb87ae4d40b 00007fb883d91fb9 00007fb882fd3640 00007fb8830b8641 00007fb8830958d3 00007fb883044210 00007fb8815d0bf4 00007fb8815d0b82 00007fb8815d0ab1
0810 13:53:45.753974 (+106150us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.756198 (+ 2224us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.150320 (+394122us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.284820 (+134500us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.317850 (+ 33030us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31997184}
I20260810 13:53:46.393024 14589 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 228) took 2829 ms. Trace:
W20260810 13:53:46.400235 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 96674.6us
I20260810 13:53:46.400588 12998 tablet_service.cc:1511] Processing CreateTablet for tablet 7529b349395a42ec96c7816f9e566079 (DEFAULT_TABLE table=default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 [id=7a54639f4e1a4f1a82278d5d64b347b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.403649 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7529b349395a42ec96c7816f9e566079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.406443 13382 leader_election.cc:304] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:46.413252 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 7a745bc711004993830b40ca1c93c63b (DEFAULT_TABLE table=default.Table_d89f1f488806492d8c05899538709320 [id=a00844083e02450fadf3bed852ffa31b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.413997 14273 ts_tablet_manager.cc:1929] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:46.414487 14273 log.cc:1199] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/1108f64f1260448b8a68ea9fe30ea494
I20260810 13:53:46.415447 14273 ts_tablet_manager.cc:1950] T 1108f64f1260448b8a68ea9fe30ea494 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:46.427500 14512 raft_consensus.cc:515] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.428440 13227 tablet_service.cc:1511] Processing CreateTablet for tablet 7529b349395a42ec96c7816f9e566079 (DEFAULT_TABLE table=default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 [id=7a54639f4e1a4f1a82278d5d64b347b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.318388 13423 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 245) took 1081 ms. Trace:
I20260810 13:53:46.458545 13448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 253) took 1218 ms. Trace:
I20260810 13:53:46.462427 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_96d399d7e8e243f49475d1952c32e376" } new_table_name: "default.Table_2cf24f2161a14bc7a86b4863247c740c" modify_external_catalogs: true
I20260810 13:53:46.467235 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 69a3a4d2724b42da83a523e208b5714b
I20260810 13:53:46.471463 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet 69a3a4d2724b42da83a523e208b5714b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:46.480010 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ab4cd2e5c73e467eb1bc4623e5d5e831
I20260810 13:53:46.481971 12749 catalog_manager.cc:6807] ReplaceTablet: tablet ab4cd2e5c73e467eb1bc4623e5d5e831 deleted and replaced by tablet 97015b4984c74a4682b6dedd47dc6650
I20260810 13:53:46.481866 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 with delete_type TABLET_DATA_DELETED (replaced by tablet 97015b4984c74a4682b6dedd47dc6650) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:46.482457 12749 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:48758 (request call id 368) took 1039 ms. Trace:
I20260810 13:53:46.487447 13639 ts_tablet_manager.cc:1434] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.307s user 0.009s sys 0.003s
I20260810 13:53:46.482899 12749 rpcz_store.cc:276] 0810 13:53:45.443022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.443207 (+ 185us) service_pool.cc:224] Handling call
0810 13:53:45.505578 (+ 62371us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703cad41 00007fec6df9cd37 00007fec6df9ccc2 00007fec6df9cbf1 00007fec6df9cb6c 00007fec6df9be22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:46.482400 (+976822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:46.451484 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:46.451853 (+ 369us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:46.451876 (+ 23us) write_op.cc:435] Acquired schema lock
0810 13:53:46.451887 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:46.452223 (+ 336us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:46.452274 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:46.452318 (+ 44us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:46.452534 (+ 216us) tablet.cc:701] Row locks acquired
0810 13:53:46.452548 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:46.452653 (+ 105us) write_op.cc:270] Start()
0810 13:53:46.452755 (+ 102us) write_op.cc:276] Timestamp: P: 1786370026452471 usec, L: 0
0810 13:53:46.452770 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:46.453251 (+ 481us) log.cc:844] Serialized 622 byte log entry
0810 13:53:46.477279 (+ 24028us) op_driver.cc:464] REPLICATION: finished
0810 13:53:46.477608 (+ 329us) write_op.cc:301] APPLY: starting
0810 13:53:46.477669 (+ 61us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:46.477771 (+ 102us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:46.477851 (+ 80us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:46.478269 (+ 418us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:46.478463 (+ 194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:46.478503 (+ 40us) write_op.cc:312] APPLY: finished
0810 13:53:46.478663 (+ 160us) log.cc:844] Serialized 29 byte log entry
0810 13:53:46.478808 (+ 145us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:46.478870 (+ 62us) write_op.cc:454] Released schema lock
0810 13:53:46.478900 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":134690048,"child_traces":[["op",{"apply.queue_time_us":152,"apply.run_cpu_time_us":1564,"apply.run_wall_time_us":14541,"num_ops":2,"prepare.queue_time_us":155005,"prepare.run_cpu_time_us":1991,"prepare.run_wall_time_us":5874,"replication_time_us":24370}]]}
I20260810 13:53:46.496070 13417 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 249) took 1257 ms. Trace:
I20260810 13:53:46.393810 13421 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 246) took 1156 ms. Trace:
I20260810 13:53:46.496873 13421 rpcz_store.cc:276] 0810 13:53:45.237266 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.391846 (+154580us) service_pool.cc:224] Handling call
0810 13:53:45.749154 (+357308us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.753297 (+ 4143us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.138038 (+384741us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.344513 (+206475us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.393704 (+ 49191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:46.456350 13423 rpcz_store.cc:276] 0810 13:53:45.236921 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.277059 (+ 40138us) service_pool.cc:224] Handling call
0810 13:53:45.625584 (+348525us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d521 00007fb87ae4d3d2 00007fb883d91fb9 00007fb882fd3640 00007fb8830b8641 00007fb8830958d3 00007fb883044210 00007fb8815d0bf4 00007fb8815d0b82 00007fb8815d0ab1
0810 13:53:45.650395 (+ 24811us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d84c 00007fb87ae4d40b 00007fb883d91fb9 00007fb882fd3640 00007fb8830b8641 00007fb8830958d3 00007fb883044210 00007fb8815d0bf4 00007fb8815d0b82 00007fb8815d0ab1
0810 13:53:45.764175 (+113780us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.765997 (+ 1822us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.134346 (+368349us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.257098 (+122752us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.312079 (+ 54981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184950528}
I20260810 13:53:46.460384 14495 raft_consensus.cc:2749] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:46.503695 13419 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 248) took 1265 ms. Trace:
I20260810 13:53:46.505950 13639 tablet_bootstrap.cc:492] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:46.508145 13221 tablet_service.cc:1558] Processing DeleteTablet for tablet 69a3a4d2724b42da83a523e208b5714b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:46.510046 13213 tablet_service.cc:1558] Processing DeleteTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 with delete_type TABLET_DATA_DELETED (replaced by tablet 97015b4984c74a4682b6dedd47dc6650) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:46.516402 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e9bf94db05cb46279abaeba00681ab82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:46.518391 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9bf94db05cb46279abaeba00681ab82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:46.532810 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a232694e27574131946f967d95a292f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:46.534816 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a232694e27574131946f967d95a292f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:46.459012 13448 rpcz_store.cc:276] 0810 13:53:45.249876 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.648751 (+398875us) service_pool.cc:224] Handling call
0810 13:53:45.763263 (+114512us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.764171 (+ 908us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.293320 (+529149us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.434905 (+141585us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.457721 (+ 22816us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:46.540297 13640 tablet_bootstrap.cc:700] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent opening tablet: real 0.215s user 0.004s sys 0.012s
I20260810 13:53:46.543439 13640 tablet_bootstrap.cc:654] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:46.547082 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 73a7e7c310e24d8caca5756fe67631ce (DEFAULT_TABLE table=default.Table_3c8a09c1dfda4797918bd6715bdfebce [id=9656e3a9a8f6431cb7b42ea64ae16159]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:46.545553 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 111052us
I20260810 13:53:46.396523 14589 rpcz_store.cc:276] 0810 13:53:43.563165 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.563395 (+ 230us) service_pool.cc:224] Handling call
0810 13:53:43.646339 (+ 82944us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d521 00007fb87ae4d3d2 00007fb883d91fb9 00007fb882fd3640 00007fb88309bebb 00007fb88309bf41 00007fb8830598f0 00007fb8830424b9 00007fb883041af4 00007fb8815d56f4
0810 13:53:46.392824 (+2746485us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:43.658178 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:43.658510 (+ 332us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:44.462827 (+804317us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:44.462903 (+ 76us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:44.463032 (+ 129us) alter_schema_op.cc:128] START. Timestamp: 1786370024445082
0810 13:53:44.463054 (+ 22us) op_driver.cc:348] REPLICATION: starting
0810 13:53:44.464027 (+ 973us) log.cc:844] Serialized 173 byte log entry
0810 13:53:46.175842 (+1711815us) op_driver.cc:464] REPLICATION: finished
0810 13:53:46.219464 (+ 43622us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:53:46.220883 (+ 1419us) log.cc:844] Serialized 94 byte log entry
0810 13:53:46.308865 (+ 87982us) alter_schema_op.cc:73] Released schema lock
0810 13:53:46.318229 (+ 9364us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"spinlock_wait_cycles":63849856,"child_traces":[["op",{"apply.queue_time_us":43384,"prepare.queue_time_us":11238,"prepare.run_cpu_time_us":66787,"prepare.run_wall_time_us":807834,"replication_time_us":1712642,"thread_start_us":208571,"threads_started":3,"wal-append.queue_time_us":88880}]]}
I20260810 13:53:46.552125 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a7e7c310e24d8caca5756fe67631ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.496515 13417 rpcz_store.cc:276] 0810 13:53:45.238342 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.317439 (+ 79097us) service_pool.cc:224] Handling call
0810 13:53:45.733876 (+416437us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d84c 00007fb87ae4d40b 00007fb883d91fb9 00007fb882fd3640 00007fb8830b8641 00007fb8830958d3 00007fb883044210 00007fb8815d0bf4 00007fb8815d0b82 00007fb8815d0ab1
0810 13:53:45.766936 (+ 33060us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.768937 (+ 2001us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.169233 (+400296us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.364973 (+195740us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.460206 (+ 95233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19493120}
I20260810 13:53:46.504220 13419 rpcz_store.cc:276] 0810 13:53:45.237974 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.391699 (+153725us) service_pool.cc:224] Handling call
0810 13:53:45.740972 (+349273us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:45.741932 (+ 960us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.315487 (+573555us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.502971 (+187484us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:46.503604 (+ 633us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:46.569815 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 193) took 5080 ms. Trace:
I20260810 13:53:46.570310 14273 rpcz_store.cc:276] 0810 13:53:41.488922 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.489787 (+ 865us) service_pool.cc:224] Handling call
0810 13:53:45.802326 (+4312539us) ts_tablet_manager.cc:1151] Deleting tablet 1108f64f1260448b8a68ea9fe30ea494
0810 13:53:45.810918 (+ 8592us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:46.251511 (+440593us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.413831 (+162320us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.569728 (+155897us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81352,"tablet-delete.queue_time_us":4311983}
I20260810 13:53:46.572644 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 199) took 4910 ms. Trace:
I20260810 13:53:46.573108 14273 rpcz_store.cc:276] 0810 13:53:41.662870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.665229 (+ 2359us) service_pool.cc:224] Handling call
0810 13:53:46.571633 (+4906404us) ts_tablet_manager.cc:1151] Deleting tablet 9453eab70fa04df8b0c89e6caf54c894
0810 13:53:46.572125 (+ 492us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:46.572585 (+ 460us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4905778}
I20260810 13:53:46.575425 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 200) took 4834 ms. Trace:
I20260810 13:53:46.575783 14273 rpcz_store.cc:276] 0810 13:53:41.740925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:41.741033 (+ 108us) service_pool.cc:224] Handling call
0810 13:53:46.574814 (+4833781us) ts_tablet_manager.cc:1151] Deleting tablet e6bfb69a7ce74175b4f1f5f4db583aa9
0810 13:53:46.574883 (+ 69us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:46.575360 (+ 477us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4833232}
I20260810 13:53:46.577013 14273 tablet_replica.cc:333] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:46.578473 14273 raft_consensus.cc:2243] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:46.579016 14273 raft_consensus.cc:2272] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:46.581611 14273 ts_tablet_manager.cc:1916] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:46.590051 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7529b349395a42ec96c7816f9e566079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.594233 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b7b408a9ad34ea39c912b33e26b49b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.597517 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a745bc711004993830b40ca1c93c63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.598325 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet 1c2ad1e3a90f47ac83ca262cad9964f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:46.621089 12951 leader_election.cc:343] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 435f585d225b492cb2b2e83fdb3a2b3d
I20260810 13:53:46.621585 12951 leader_election.cc:304] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:46.622197 12951 raft_consensus.cc:2686] T 435f585d225b492cb2b2e83fdb3a2b3d P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:46.626514 14512 leader_election.cc:290] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:46.627818 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2ad1e3a90f47ac83ca262cad9964f0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:46.628684 13054 raft_consensus.cc:3060] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:46.656224 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d89f1f488806492d8c05899538709320" } modify_external_catalogs: true
I20260810 13:53:46.656973 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d89f1f488806492d8c05899538709320" } modify_external_catalogs: true
I20260810 13:53:46.666585 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 1108f64f1260448b8a68ea9fe30ea494 (table default.Table_339aa1d8438e452eb0447748597f32fb [id=444e5f8f6be54ddc8ec01e68ecb0e3c1]) successfully deleted
W20260810 13:53:46.667544 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 9453eab70fa04df8b0c89e6caf54c894 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9453eab70fa04df8b0c89e6caf54c894 already in progress: creating tablet
W20260810 13:53:46.668221 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6bfb69a7ce74175b4f1f5f4db583aa9 already in progress: creating tablet
I20260810 13:53:46.668860 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 with delete_type TABLET_DATA_DELETED (replaced by tablet 97015b4984c74a4682b6dedd47dc6650) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:46.595026 14604 raft_consensus.cc:493] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:53:46.669726 14604 raft_consensus.cc:515] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:46.612108 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2ad1e3a90f47ac83ca262cad9964f0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:46.614694 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffbabe58e034f26915504f2b1fa4679" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:46.672926 13470 raft_consensus.cc:2468] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:46.672982 13476 raft_consensus.cc:2468] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:46.636071 13417 tablet_service.cc:1511] Processing CreateTablet for tablet 3b7b408a9ad34ea39c912b33e26b49b6 (DEFAULT_TABLE table=default.Table_029a3ba2ee734a729e84a4482938ed5b [id=b437e76811d440ca817fca27a8dcbd45]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.675079 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b7b408a9ad34ea39c912b33e26b49b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.642846 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet 2327309017db4094907b3e405988f224 with delete_type TABLET_DATA_DELETED (replaced by tablet 75b8030450554de3b97266f348329ea6) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:46.644510 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b67e5a2b5334147b9d25f2ddc73de31 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:46.646557 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 7a745bc711004993830b40ca1c93c63b (DEFAULT_TABLE table=default.Table_d89f1f488806492d8c05899538709320 [id=a00844083e02450fadf3bed852ffa31b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.681257 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a745bc711004993830b40ca1c93c63b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.658703 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet 69a3a4d2724b42da83a523e208b5714b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:46.661085 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 7529b349395a42ec96c7816f9e566079 (DEFAULT_TABLE table=default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 [id=7a54639f4e1a4f1a82278d5d64b347b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.686156 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7529b349395a42ec96c7816f9e566079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.694855 14604 leader_election.cc:290] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:46.695717 13640 tablet_bootstrap.cc:492] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:46.696128 13640 ts_tablet_manager.cc:1403] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.467s user 0.031s sys 0.030s
I20260810 13:53:46.699674 13640 raft_consensus.cc:359] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.700350 13640 raft_consensus.cc:385] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:46.700644 13640 raft_consensus.cc:740] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:53:46.700465 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet a43def9358894b2aa001a7db56706589 consensus state has no leader
I20260810 13:53:46.700809 14604 raft_consensus.cc:493] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:46.701503 13640 consensus_queue.cc:260] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.701339 14604 raft_consensus.cc:515] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.703939 13640 ts_tablet_manager.cc:1434] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260810 13:53:46.720333 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 29ace970eee349d6b669b5c531f91c8b (DEFAULT_TABLE table=default.Table_5b39c1bb4b614f97ab6eb4d521628013 [id=b69ad2b0c70949b98192ae056eb2cab0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.677795 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 393e23a9c03049a280f3ef89bdca5011 (DEFAULT_TABLE table=default.Table_4f780597fcec4261acd040c8816826c4 [id=3e00d0fc074747809ebc1f6b3696649d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.725404 14604 leader_election.cc:290] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:46.728081 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet c5f2e89d61854ee5bf6955b8244215eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:46.728790 13221 tablet_service.cc:1511] Processing CreateTablet for tablet 393e23a9c03049a280f3ef89bdca5011 (DEFAULT_TABLE table=default.Table_4f780597fcec4261acd040c8816826c4 [id=3e00d0fc074747809ebc1f6b3696649d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.730137 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393e23a9c03049a280f3ef89bdca5011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.730700 13640 tablet_bootstrap.cc:492] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:46.730269 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 73a7e7c310e24d8caca5756fe67631ce (DEFAULT_TABLE table=default.Table_3c8a09c1dfda4797918bd6715bdfebce [id=9656e3a9a8f6431cb7b42ea64ae16159]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:46.744956 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d2d209f801b4aa0aff3137a51fc7556 consensus state has no leader
I20260810 13:53:46.750976 13640 tablet_bootstrap.cc:654] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:46.751911 14272 ts_tablet_manager.cc:1929] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:46.752629 14272 log.cc:1199] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/0b427bfff3734fa08370bfbc480cb802
I20260810 13:53:46.753901 14272 ts_tablet_manager.cc:1950] T 0b427bfff3734fa08370bfbc480cb802 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:46.757992 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c4ff1185d2848808cbd92760e595830 has no consensus state
I20260810 13:53:46.757889 14597 raft_consensus.cc:515] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.760466 14597 leader_election.cc:290] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:46.761035 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 241) took 1805 ms. Trace:
I20260810 13:53:46.761814 14389 rpcz_store.cc:276] 0810 13:53:44.955260 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:44.955436 (+ 176us) service_pool.cc:224] Handling call
0810 13:53:45.718915 (+763479us) ts_tablet_manager.cc:1151] Deleting tablet 8ffbabe58e034f26915504f2b1fa4679
0810 13:53:45.718964 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:45.934625 (+215661us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.211753 (+277128us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.650334 (+438581us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a6b52 00007f91209141d9 00007f911fb2c4e8 00007f911fbf4a9e 00007f911fbf7a69 00007f911fc2088e 00007f911fc20859 00007f911fc20815 00007f911fc11a76
0810 13:53:46.760950 (+110616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14335360,"tablet-delete.queue_time_us":762755}
I20260810 13:53:46.764750 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 8ffbabe58e034f26915504f2b1fa4679 (table default.Table_d09e415cd1d84b0dbdf423af55ae1a20 [id=5aded17b3ed14b679b105714f33ff602]) successfully deleted
I20260810 13:53:46.767360 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 238) took 1980 ms. Trace:
W20260810 13:53:46.769326 13382 leader_election.cc:343] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:46.770422 13382 leader_election.cc:343] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:46.773006 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 488564us
I20260810 13:53:46.783607 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 6ad53d1da7b34194b4b7a78c52870c6b (DEFAULT_TABLE table=default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 [id=766aaf50fb2f4fbca53416a8e853f9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.787127 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a7e7c310e24d8caca5756fe67631ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.786897 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 29ace970eee349d6b669b5c531f91c8b (DEFAULT_TABLE table=default.Table_5b39c1bb4b614f97ab6eb4d521628013 [id=b69ad2b0c70949b98192ae056eb2cab0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.788174 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ace970eee349d6b669b5c531f91c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.794894 13638 tablet_bootstrap.cc:492] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:46.795377 13638 ts_tablet_manager.cc:1403] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.523s user 0.010s sys 0.065s
I20260810 13:53:46.807536 14495 raft_consensus.cc:493] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:46.808053 14495 raft_consensus.cc:515] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.809943 14589 tablet.cc:1724] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:46.810984 14495 leader_election.cc:290] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:46.816824 14557 tablet.cc:1724] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:46.842360 13054 raft_consensus.cc:2468] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:46.845263 13639 tablet_bootstrap.cc:654] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:46.846218 14589 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 238) took 1614 ms. Trace:
W20260810 13:53:46.850553 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 70355.7us
I20260810 13:53:46.851883 12739 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b48c394590b6458487d9402067fc9889" } modify_external_catalogs: true
I20260810 13:53:46.852447 12739 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b48c394590b6458487d9402067fc9889" } modify_external_catalogs: true
I20260810 13:53:46.853332 13164 leader_election.cc:304] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:46.859161 12951 leader_election.cc:304] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:46.860303 14593 raft_consensus.cc:2804] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:46.861029 14593 raft_consensus.cc:493] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:46.861548 14593 raft_consensus.cc:3060] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:46.846768 14589 rpcz_store.cc:276] 0810 13:53:45.231464 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.256881 (+ 25417us) service_pool.cc:224] Handling call
0810 13:53:46.846103 (+1589222us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:45.513158 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:45.518979 (+ 5821us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:45.519074 (+ 95us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:45.520843 (+ 1769us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:45.521030 (+ 187us) alter_schema_op.cc:128] START. Timestamp: 1786370025502982
0810 13:53:45.521093 (+ 63us) op_driver.cc:348] REPLICATION: starting
0810 13:53:45.521840 (+ 747us) log.cc:844] Serialized 173 byte log entry
0810 13:53:46.809296 (+1287456us) op_driver.cc:464] REPLICATION: finished
0810 13:53:46.809732 (+ 436us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:53:46.811604 (+ 1872us) log.cc:844] Serialized 5 byte log entry
0810 13:53:46.822045 (+ 10441us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.823246 (+ 1201us) log.cc:844] Serialized 14 byte log entry
0810 13:53:46.845888 (+ 22642us) alter_schema_op.cc:73] Released schema lock
0810 13:53:46.845961 (+ 73us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":219,"prepare.queue_time_us":254919,"prepare.run_cpu_time_us":3206,"prepare.run_wall_time_us":124216,"replication_time_us":1288024,"thread_start_us":318576,"threads_started":2,"wal-append.queue_time_us":243155}]]}
I20260810 13:53:46.874387 14593 raft_consensus.cc:515] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.865782 13217 tablet_service.cc:1511] Processing CreateTablet for tablet 6ad53d1da7b34194b4b7a78c52870c6b (DEFAULT_TABLE table=default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 [id=766aaf50fb2f4fbca53416a8e853f9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.767967 14389 rpcz_store.cc:276] 0810 13:53:44.786532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:44.960653 (+174121us) service_pool.cc:224] Handling call
0810 13:53:46.766726 (+1806073us) ts_tablet_manager.cc:1151] Deleting tablet ce9243eda3974532aff0425885f54166
0810 13:53:46.766826 (+ 100us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:46.767278 (+ 452us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1805367}
I20260810 13:53:46.876240 12951 leader_election.cc:304] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:46.881209 14596 raft_consensus.cc:2764] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:53:46.891122 14593 leader_election.cc:290] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:46.901691 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 2f934006c34a4b18ab157dad01a1b41d (DEFAULT_TABLE table=default.Table_1b4d290e5bd445eaaff143b18dd41da9 [id=79e3547a36c040aa91292a3dfe754b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.903918 14557 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 255) took 1653 ms. Trace:
I20260810 13:53:46.915357 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 73a7e7c310e24d8caca5756fe67631ce (DEFAULT_TABLE table=default.Table_3c8a09c1dfda4797918bd6715bdfebce [id=9656e3a9a8f6431cb7b42ea64ae16159]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.917618 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a7e7c310e24d8caca5756fe67631ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.932174 13640 tablet_bootstrap.cc:492] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:46.932632 13640 ts_tablet_manager.cc:1403] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.202s user 0.034s sys 0.035s
I20260810 13:53:46.936282 12739 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet b820c99b33264add8df5fd443981d0cc
I20260810 13:53:46.936455 13640 raft_consensus.cc:359] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.937283 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 7a745bc711004993830b40ca1c93c63b
I20260810 13:53:46.937938 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 393e23a9c03049a280f3ef89bdca5011 (DEFAULT_TABLE table=default.Table_4f780597fcec4261acd040c8816826c4 [id=3e00d0fc074747809ebc1f6b3696649d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.938441 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet b820c99b33264add8df5fd443981d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:46.939392 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 29ace970eee349d6b669b5c531f91c8b (DEFAULT_TABLE table=default.Table_5b39c1bb4b614f97ab6eb4d521628013 [id=b69ad2b0c70949b98192ae056eb2cab0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.939950 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet acaaa179b4fa4ca592674e24a4e54706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:31 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:46.937089 13640 raft_consensus.cc:385] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:46.940307 13640 raft_consensus.cc:740] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:46.940490 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a745bc711004993830b40ca1c93c63b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:46.940953 13640 consensus_queue.cc:260] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:46.942945 13640 ts_tablet_manager.cc:1434] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20260810 13:53:46.946056 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 6ad53d1da7b34194b4b7a78c52870c6b (DEFAULT_TABLE table=default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 [id=766aaf50fb2f4fbca53416a8e853f9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.947687 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ffbabe58e034f26915504f2b1fa4679" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:46.948427 13476 raft_consensus.cc:3060] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:46.959739 13476 raft_consensus.cc:2468] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
W20260810 13:53:46.962829 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ce9243eda3974532aff0425885f54166 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce9243eda3974532aff0425885f54166 already in progress: creating tablet
I20260810 13:53:46.907442 14557 rpcz_store.cc:276] 0810 13:53:45.251410 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.734643 (+483233us) service_pool.cc:224] Handling call
0810 13:53:46.903823 (+1169180us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:45.754110 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:45.761158 (+ 7048us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:45.761194 (+ 36us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:45.761257 (+ 63us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:45.761461 (+ 204us) alter_schema_op.cc:128] START. Timestamp: 1786370025761058
0810 13:53:45.761488 (+ 27us) op_driver.cc:348] REPLICATION: starting
0810 13:53:45.762043 (+ 555us) log.cc:844] Serialized 173 byte log entry
0810 13:53:46.816343 (+1054300us) op_driver.cc:464] REPLICATION: finished
0810 13:53:46.816674 (+ 331us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:53:46.818612 (+ 1938us) log.cc:844] Serialized 5 byte log entry
0810 13:53:46.838680 (+ 20068us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.901459 (+ 62779us) log.cc:844] Serialized 14 byte log entry
0810 13:53:46.903506 (+ 2047us) alter_schema_op.cc:73] Released schema lock
0810 13:53:46.903575 (+ 69us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":94,"prepare.queue_time_us":5366,"prepare.run_cpu_time_us":40072,"prepare.run_wall_time_us":269212,"raft.queue_time_us":444,"raft.run_cpu_time_us":936,"raft.run_wall_time_us":936,"replication_time_us":1054738,"thread_start_us":254455,"threads_started":1,"wal-append.queue_time_us":253973}]]}
I20260810 13:53:46.966717 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet b820c99b33264add8df5fd443981d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:46.970461 13215 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a745bc711004993830b40ca1c93c63b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:46.971901 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ad53d1da7b34194b4b7a78c52870c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.977491 14389 tablet_replica.cc:333] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:46.979213 14389 raft_consensus.cc:2243] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:46.980945 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_215968e7ab2540ab8a35960795941543"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:46.982120 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393e23a9c03049a280f3ef89bdca5011. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:46.983070 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_215968e7ab2540ab8a35960795941543 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:46.983150 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ace970eee349d6b669b5c531f91c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.985071 12951 leader_election.cc:304] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:46.985505 13640 tablet_bootstrap.cc:492] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:46.985733 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 2f934006c34a4b18ab157dad01a1b41d (DEFAULT_TABLE table=default.Table_1b4d290e5bd445eaaff143b18dd41da9 [id=79e3547a36c040aa91292a3dfe754b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:46.986853 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f934006c34a4b18ab157dad01a1b41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.986676 14593 raft_consensus.cc:2804] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:46.987411 14593 raft_consensus.cc:697] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:46.989270 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ad53d1da7b34194b4b7a78c52870c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:46.989008 14593 consensus_queue.cc:237] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.001227 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet b820c99b33264add8df5fd443981d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:47.002620 13417 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a745bc711004993830b40ca1c93c63b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:47.035548 13640 tablet_bootstrap.cc:654] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:47.077174 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 223945us
I20260810 13:53:47.078821 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b427bfff3734fa08370bfbc480cb802" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:47.081910 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2ad1e3a90f47ac83ca262cad9964f0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:47.082561 13382 leader_election.cc:304] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.082759 13476 raft_consensus.cc:3060] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:47.088332 14523 raft_consensus.cc:2804] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:47.088970 14523 raft_consensus.cc:493] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:47.089540 14523 raft_consensus.cc:3060] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:47.089639 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f2e89d61854ee5bf6955b8244215eb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:47.091192 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acaaa179b4fa4ca592674e24a4e54706" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:47.093183 13382 leader_election.cc:304] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.094633 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b427bfff3734fa08370bfbc480cb802" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:47.096312 13476 raft_consensus.cc:2468] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:47.099702 13382 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.101568 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 393e23a9c03049a280f3ef89bdca5011. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.102409 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c2ad1e3a90f47ac83ca262cad9964f0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:47.109258 14633 tablet.cc:1724] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:47.123410 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 243) took 1027 ms. Trace:
I20260810 13:53:47.125166 14272 rpcz_store.cc:276] 0810 13:53:46.095520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.095660 (+ 140us) service_pool.cc:224] Handling call
0810 13:53:46.159182 (+ 63522us) ts_tablet_manager.cc:1151] Deleting tablet 0b427bfff3734fa08370bfbc480cb802
0810 13:53:46.159234 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:46.474377 (+315143us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:46.751670 (+277293us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.123329 (+371659us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":62951}
I20260810 13:53:47.127043 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 0b427bfff3734fa08370bfbc480cb802 (table default.Table_dac7ad3575c0493f80f31c5bc76e595f [id=be02ad64399140469aa0fdfb872b3c22]) successfully deleted
I20260810 13:53:47.135037 14272 tablet_replica.cc:333] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:47.140201 14613 raft_consensus.cc:2804] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:47.140970 14613 raft_consensus.cc:493] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:47.098918 14495 raft_consensus.cc:2749] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:53:47.149175 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 49564.8us
I20260810 13:53:47.149441 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_69d9d4a2261c401ca6f16490def91c0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:47.149935 14604 raft_consensus.cc:2804] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:47.151005 14604 raft_consensus.cc:697] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
W20260810 13:53:47.151479 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69d9d4a2261c401ca6f16490def91c0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:47.155141 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_0644d20557a146a193d56d2b30b4c726"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:47.156677 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0644d20557a146a193d56d2b30b4c726 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:47.157986 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ff3ff99b87ea436e913545b9e25fe5a6" } new_table_name: "default.Table_ebcd04452c3c454e93961b5a321e40d1" modify_external_catalogs: true
I20260810 13:53:47.160501 14604 consensus_queue.cc:237] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.161480 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2dda46b17a89419abdb1f6d9ff61fb1d" } new_table_name: "default.Table_61ea331d19cb4393a84ea7b467d1d733" modify_external_catalogs: true
I20260810 13:53:47.167112 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
I20260810 13:53:47.172350 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a6f746f49e7c466b8008dc01f2f390ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:47.173775 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ace970eee349d6b669b5c531f91c8b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:47.174208 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6f746f49e7c466b8008dc01f2f390ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:47.177163 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ad53d1da7b34194b4b7a78c52870c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.181138 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f934006c34a4b18ab157dad01a1b41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.189851 13639 tablet_bootstrap.cc:492] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:47.190275 13639 ts_tablet_manager.cc:1403] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.685s user 0.013s sys 0.002s
I20260810 13:53:47.197643 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f2e89d61854ee5bf6955b8244215eb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:47.198796 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acaaa179b4fa4ca592674e24a4e54706" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:47.203375 12952 leader_election.cc:343] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:47.179646 13382 leader_election.cc:343] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: e23454581a9a4b55b0756ef890dee7fb
W20260810 13:53:47.204934 12952 leader_election.cc:343] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 8ffbabe58e034f26915504f2b1fa4679
W20260810 13:53:47.207825 12952 leader_election.cc:343] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 8ffbabe58e034f26915504f2b1fa4679
I20260810 13:53:47.229221 13223 tablet_service.cc:1558] Processing DeleteTablet for tablet e4afea2da7c54e508084be42dec35099 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:47.232467 14631 tablet.cc:1724] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:47.235757 13167 leader_election.cc:304] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:47.236509 13638 raft_consensus.cc:359] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.237385 13638 raft_consensus.cc:385] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:47.237329 14605 raft_consensus.cc:2706] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Received election callback for term 1 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260810 13:53:47.237780 13638 raft_consensus.cc:740] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:47.238564 13638 consensus_queue.cc:260] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.241077 14389 raft_consensus.cc:2272] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:47.244621 13638 ts_tablet_manager.cc:1434] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.449s user 0.010s sys 0.001s
W20260810 13:53:47.234319 13382 leader_election.cc:343] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:47.250011 13382 leader_election.cc:343] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:47.272248 14523 raft_consensus.cc:515] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.274359 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 1122dcf7bcea4654bf29ff01fc4a350d (DEFAULT_TABLE table=default.Table_32e1324fe8ca42788d488f6d5ce8ca27 [id=fbcec0863c7a488f8298fb2b486bfefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.277215 14273 ts_tablet_manager.cc:1929] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:47.277851 14273 log.cc:1199] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/0b427bfff3734fa08370bfbc480cb802
I20260810 13:53:47.278733 14273 ts_tablet_manager.cc:1950] T 0b427bfff3734fa08370bfbc480cb802 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:47.141605 14613 raft_consensus.cc:3060] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:47.204423 13164 leader_election.cc:343] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: Tablet not RUNNING: STOPPED
W20260810 13:53:47.307210 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 102824us
I20260810 13:53:47.292778 13638 tablet_bootstrap.cc:492] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:47.309162 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 207) took 4836 ms. Trace:
I20260810 13:53:47.309500 14273 rpcz_store.cc:276] 0810 13:53:42.473183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.496763 (+ 23580us) service_pool.cc:224] Handling call
0810 13:53:46.576864 (+4080101us) ts_tablet_manager.cc:1151] Deleting tablet 0b427bfff3734fa08370bfbc480cb802
0810 13:53:46.576909 (+ 45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:46.767161 (+190252us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.277043 (+509882us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.309096 (+ 32053us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4079424}
I20260810 13:53:47.153306 14614 raft_consensus.cc:493] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:47.310487 14523 leader_election.cc:290] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:47.314770 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 210) took 4749 ms. Trace:
I20260810 13:53:47.315100 14273 rpcz_store.cc:276] 0810 13:53:42.565252 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.565390 (+ 138us) service_pool.cc:224] Handling call
0810 13:53:47.314278 (+4748888us) ts_tablet_manager.cc:1151] Deleting tablet 587b591fb88a447b9bd5e071fa8c37e1
0810 13:53:47.314346 (+ 68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:47.314704 (+ 358us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4748275}
I20260810 13:53:47.316210 14273 tablet_replica.cc:333] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:47.290275 14272 raft_consensus.cc:2243] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:47.323661 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_27966be3dfde47f48e04540a47399a69" } modify_external_catalogs: true
I20260810 13:53:47.324283 14273 raft_consensus.cc:2243] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:47.328295 14272 pending_rounds.cc:70] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:53:47.329079 14272 pending_rounds.cc:77] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971630561689600 op_type: NO_OP noop_request { }
I20260810 13:53:47.329950 14272 raft_consensus.cc:2889] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:47.330543 14272 raft_consensus.cc:2272] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:47.337620 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_27966be3dfde47f48e04540a47399a69" } modify_external_catalogs: true
W20260810 13:53:47.340054 14626 consensus_queue.cc:1175] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "88ed04d733ec447583fc897e233dd4b3" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260810 13:53:47.344811 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e383a6bbbf2247478200482d22a378e3" } modify_external_catalogs: true
I20260810 13:53:47.345347 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e383a6bbbf2247478200482d22a378e3" } modify_external_catalogs: true
W20260810 13:53:47.356639 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 82599.9us
I20260810 13:53:47.362771 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 3066b475871c45fdbe585947fd6800c9 (table default.Table_ebcd04452c3c454e93961b5a321e40d1 [id=9c99ad2364cc45fba0746cbae06deeeb]). Expected version 2 got 1
I20260810 13:53:47.368919 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9566586ecdd24e94bad62906c2166afd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:47.370153 14273 raft_consensus.cc:2272] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:47.370805 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 2f934006c34a4b18ab157dad01a1b41d (DEFAULT_TABLE table=default.Table_1b4d290e5bd445eaaff143b18dd41da9 [id=79e3547a36c040aa91292a3dfe754b03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.372012 13640 tablet_bootstrap.cc:492] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:47.372268 14273 ts_tablet_manager.cc:1916] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:47.372442 13640 ts_tablet_manager.cc:1403] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.387s user 0.043s sys 0.046s
I20260810 13:53:47.374393 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 0b427bfff3734fa08370bfbc480cb802 (table default.Table_dac7ad3575c0493f80f31c5bc76e595f [id=be02ad64399140469aa0fdfb872b3c22]) successfully deleted
I20260810 13:53:47.366386 14272 ts_tablet_manager.cc:1916] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:47.375674 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 587b591fb88a447b9bd5e071fa8c37e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 587b591fb88a447b9bd5e071fa8c37e1 already in progress: creating tablet
I20260810 13:53:47.375805 13640 raft_consensus.cc:359] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.376420 13640 raft_consensus.cc:385] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:47.376659 13640 raft_consensus.cc:740] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:47.378052 13640 consensus_queue.cc:260] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.379612 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f934006c34a4b18ab157dad01a1b41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.385854 13640 ts_tablet_manager.cc:1434] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260810 13:53:47.386955 13640 tablet_bootstrap.cc:492] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:47.395330 13014 tablet_service.cc:1511] Processing CreateTablet for tablet f19e7aa805bd417eae45fb43ac18a66d (DEFAULT_TABLE table=default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.301062 13639 raft_consensus.cc:359] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.404855 13639 raft_consensus.cc:385] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:47.405157 13639 raft_consensus.cc:740] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:47.406119 13639 consensus_queue.cc:260] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.407955 13639 ts_tablet_manager.cc:1434] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.217s user 0.007s sys 0.000s
I20260810 13:53:47.423872 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1122dcf7bcea4654bf29ff01fc4a350d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.423828 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 3066b475871c45fdbe585947fd6800c9 (table default.Table_ebcd04452c3c454e93961b5a321e40d1 [id=9c99ad2364cc45fba0746cbae06deeeb]). Expected version 2 got 1
I20260810 13:53:47.424108 14273 ts_tablet_manager.cc:1929] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:47.424419 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
I20260810 13:53:47.292604 14389 ts_tablet_manager.cc:1916] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:47.427579 14273 log.cc:1199] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/8ffbabe58e034f26915504f2b1fa4679
I20260810 13:53:47.428351 14273 ts_tablet_manager.cc:1950] T 8ffbabe58e034f26915504f2b1fa4679 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:53:47.293111 13210 consensus_meta.cc:287] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb: Time spent flushing consensus metadata: real 0.542s user 0.005s sys 0.007s
I20260810 13:53:47.431665 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
I20260810 13:53:47.432835 12740 catalog_manager.cc:5719] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:47.434880 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:47.435822 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:47.438880 14643 tablet.cc:1719] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Skipping requested alter to schema version 2, tablet already version 2
I20260810 13:53:47.440956 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19e7aa805bd417eae45fb43ac18a66d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:47.312359 13167 leader_election.cc:343] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: Tablet not RUNNING: SHUTDOWN
I20260810 13:53:47.429538 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9566586ecdd24e94bad62906c2166afd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:47.471717 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d4a38708152b4705af7eaf9af6ddc436"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:47.472275 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f922c9ca51044dcda08b245010ab06b0 consensus state has no leader
W20260810 13:53:47.473796 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4a38708152b4705af7eaf9af6ddc436 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:47.476980 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 211) took 4843 ms. Trace:
I20260810 13:53:47.477370 14273 rpcz_store.cc:276] 0810 13:53:42.633217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.633353 (+ 136us) service_pool.cc:224] Handling call
0810 13:53:47.315980 (+4682627us) ts_tablet_manager.cc:1151] Deleting tablet 8ffbabe58e034f26915504f2b1fa4679
0810 13:53:47.316091 (+ 111us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:47.404824 (+ 88733us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.423987 (+ 19163us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.476907 (+ 52920us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8198,"tablet-delete.queue_time_us":4681961}
I20260810 13:53:47.478446 14273 tablet_replica.cc:333] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:47.479094 14273 raft_consensus.cc:2243] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:47.482704 13231 tablet_service.cc:1511] Processing CreateTablet for tablet f19e7aa805bd417eae45fb43ac18a66d (DEFAULT_TABLE table=default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:47.482009 13382 leader_election.cc:343] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: e23454581a9a4b55b0756ef890dee7fb
I20260810 13:53:47.494620 14273 raft_consensus.cc:2272] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:47.496908 14273 ts_tablet_manager.cc:1916] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:47.505218 14272 ts_tablet_manager.cc:1929] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:47.505611 14272 log.cc:1199] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/8ffbabe58e034f26915504f2b1fa4679
I20260810 13:53:47.506364 14272 ts_tablet_manager.cc:1950] T 8ffbabe58e034f26915504f2b1fa4679 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:47.507501 14650 raft_consensus.cc:493] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:53:47.507982 14650 raft_consensus.cc:515] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.509539 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 244) took 1331 ms. Trace:
I20260810 13:53:47.509825 14272 rpcz_store.cc:276] 0810 13:53:46.178428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.178572 (+ 144us) service_pool.cc:224] Handling call
0810 13:53:47.134842 (+956270us) ts_tablet_manager.cc:1151] Deleting tablet 8ffbabe58e034f26915504f2b1fa4679
0810 13:53:47.134895 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:47.327867 (+192972us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400102054. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e77742 00007f19282b7d2c 00007f1928f1f41a 00007f1928f500e0 00007f1928f3664d 00007f1928f365f9 00007f1928f36589 00007f1928f36551 00007f1928f3577d 00000000005bd8c4
0810 13:53:47.488921 (+161054us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.505101 (+ 16180us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.509483 (+ 4382us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354807552,"tablet-delete.queue_time_us":955676}
I20260810 13:53:47.513684 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 246) took 1161 ms. Trace:
I20260810 13:53:47.513988 14272 rpcz_store.cc:276] 0810 13:53:46.352621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.352801 (+ 180us) service_pool.cc:224] Handling call
0810 13:53:47.513343 (+1160542us) ts_tablet_manager.cc:1151] Deleting tablet 2327309017db4094907b3e405988f224
0810 13:53:47.513386 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:47.513633 (+ 247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159791}
I20260810 13:53:47.515610 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 247) took 1160 ms. Trace:
I20260810 13:53:47.515902 14272 rpcz_store.cc:276] 0810 13:53:46.355144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.355290 (+ 146us) service_pool.cc:224] Handling call
0810 13:53:47.515168 (+1159878us) ts_tablet_manager.cc:1151] Deleting tablet 2b67e5a2b5334147b9d25f2ddc73de31
0810 13:53:47.515206 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:47.515562 (+ 356us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1159002}
I20260810 13:53:47.518873 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 250) took 1047 ms. Trace:
I20260810 13:53:47.519163 14272 rpcz_store.cc:276] 0810 13:53:46.471134 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.471277 (+ 143us) service_pool.cc:224] Handling call
0810 13:53:47.518514 (+1047237us) ts_tablet_manager.cc:1151] Deleting tablet 69a3a4d2724b42da83a523e208b5714b
0810 13:53:47.518549 (+ 35us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:47.518826 (+ 277us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1046554}
I20260810 13:53:47.521677 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 251) took 1040 ms. Trace:
I20260810 13:53:47.522240 14650 leader_election.cc:290] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:47.521960 14272 rpcz_store.cc:276] 0810 13:53:46.481505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.481643 (+ 138us) service_pool.cc:224] Handling call
0810 13:53:47.521374 (+1039731us) ts_tablet_manager.cc:1151] Deleting tablet ab4cd2e5c73e467eb1bc4623e5d5e831
0810 13:53:47.521414 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:47.521627 (+ 213us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1039089}
I20260810 13:53:47.525579 14272 tablet_replica.cc:333] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:47.526392 14272 raft_consensus.cc:2243] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:47.526852 14272 raft_consensus.cc:2272] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:47.528668 14272 ts_tablet_manager.cc:1916] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:47.533586 12745 master_service.cc:960] ReplaceTablet: received request to replace tablet 918edf5d7b4f45009c5d476588399d0c from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:47.539029 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 8ffbabe58e034f26915504f2b1fa4679 (table default.Table_d09e415cd1d84b0dbdf423af55ae1a20 [id=5aded17b3ed14b679b105714f33ff602]) successfully deleted
I20260810 13:53:47.514724 13167 leader_election.cc:304] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.539860 14597 raft_consensus.cc:2749] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:53:47.430487 14614 raft_consensus.cc:515] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:47.528121 14644 log.cc:927] Time spent T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.097s user 0.000s sys 0.000s
I20260810 13:53:47.483450 13382 leader_election.cc:304] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:47.542963 13382 raft_consensus.cc:2686] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:53:47.543911 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 2327309017db4094907b3e405988f224 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2327309017db4094907b3e405988f224 already in progress: creating tablet
W20260810 13:53:47.545042 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 62562.4us
I20260810 13:53:47.544106 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_840fe1ccac954217b7715893c2713712" } new_table_name: "default.Table_d51002366e9948b1a840425abef8cef8" modify_external_catalogs: true
I20260810 13:53:47.547173 14272 ts_tablet_manager.cc:1929] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:47.547498 14272 log.cc:1199] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/1c2ad1e3a90f47ac83ca262cad9964f0
I20260810 13:53:47.548168 14272 ts_tablet_manager.cc:1950] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:47.549058 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 2b67e5a2b5334147b9d25f2ddc73de31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b67e5a2b5334147b9d25f2ddc73de31 already in progress: creating tablet
W20260810 13:53:47.537885 14638 log.cc:927] Time spent T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.054s user 0.000s sys 0.000s
W20260810 13:53:47.549793 13382 leader_election.cc:343] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:47.550143 13382 leader_election.cc:304] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.549212 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 1122dcf7bcea4654bf29ff01fc4a350d (DEFAULT_TABLE table=default.Table_32e1324fe8ca42788d488f6d5ce8ca27 [id=fbcec0863c7a488f8298fb2b486bfefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.551668 14650 raft_consensus.cc:2749] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:47.552167 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 69a3a4d2724b42da83a523e208b5714b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69a3a4d2724b42da83a523e208b5714b already in progress: creating tablet
W20260810 13:53:47.552966 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab4cd2e5c73e467eb1bc4623e5d5e831 already in progress: creating tablet
I20260810 13:53:47.549579 13210 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 247) took 1170 ms. Trace:
I20260810 13:53:47.553524 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 1c2ad1e3a90f47ac83ca262cad9964f0 (table default.Table_a456e8d8c2b046e7a2877075ce1b3741 [id=2e4a328ff76e41a1bd0718c74494f4d6]) successfully deleted
W20260810 13:53:47.554307 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet b820c99b33264add8df5fd443981d0cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b820c99b33264add8df5fd443981d0cc already in progress: creating tablet
W20260810 13:53:47.554387 13227 consensus_meta.cc:287] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb: Time spent flushing consensus metadata: real 0.824s user 0.008s sys 0.004s
I20260810 13:53:47.553917 13210 rpcz_store.cc:276] 0810 13:53:46.370451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.371553 (+ 1102us) service_pool.cc:224] Handling call
0810 13:53:46.592772 (+221219us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:46.592915 (+ 143us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.750397 (+157482us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.474420 (+724023us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:47.540881 (+ 66461us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:53:47.555042 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 7a745bc711004993830b40ca1c93c63b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a745bc711004993830b40ca1c93c63b already in progress: creating tablet
I20260810 13:53:47.555783 13227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 251) took 1129 ms. Trace:
W20260810 13:53:47.556810 13382 leader_election.cc:343] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:47.557301 13382 leader_election.cc:304] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.558264 14650 raft_consensus.cc:2749] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:47.561920 13213 consensus_meta.cc:287] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb: Time spent flushing consensus metadata: real 0.531s user 0.001s sys 0.010s
I20260810 13:53:47.566151 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 8ffbabe58e034f26915504f2b1fa4679 (table default.Table_d09e415cd1d84b0dbdf423af55ae1a20 [id=5aded17b3ed14b679b105714f33ff602]) successfully deleted
W20260810 13:53:47.578502 13382 leader_election.cc:343] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:47.544591 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 307377us
W20260810 13:53:47.569721 13221 consensus_meta.cc:287] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb: Time spent flushing consensus metadata: real 0.601s user 0.002s sys 0.009s
W20260810 13:53:47.589460 13382 leader_election.cc:343] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: a58df75cb91544ef863a09f4d6004da0
I20260810 13:53:47.556252 13227 rpcz_store.cc:276] 0810 13:53:46.426671 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.426902 (+ 231us) service_pool.cc:224] Handling call
0810 13:53:46.589320 (+162418us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:46.589468 (+ 148us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:46.730177 (+140709us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.554970 (+824793us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:47.555716 (+ 746us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:47.593513 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4afea2da7c54e508084be42dec35099" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:47.571352 14614 leader_election.cc:290] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:47.594296 13638 tablet_bootstrap.cc:654] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:47.583384 14643 tablet.cc:1724] T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:47.541714 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19e7aa805bd417eae45fb43ac18a66d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.633000 13020 tablet_service.cc:1511] Processing CreateTablet for tablet d36f17094e504d80a2443dc12855c744 (DEFAULT_TABLE table=default.Table_d3cce811ecf44ac8922775c36db30fba [id=dbd65a5203064e10a464df6a3208ae67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.634168 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36f17094e504d80a2443dc12855c744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.635946 13639 tablet_bootstrap.cc:492] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:47.649959 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4afea2da7c54e508084be42dec35099" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:47.651017 13480 raft_consensus.cc:2468] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:53:47.666683 13167 leader_election.cc:343] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:47.659474 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1122dcf7bcea4654bf29ff01fc4a350d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.667712 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2c6e1c408acb44358898a1a4ff356bdd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:47.669495 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c6e1c408acb44358898a1a4ff356bdd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:47.673135 13221 tablet_service.cc:1511] Processing CreateTablet for tablet d36f17094e504d80a2443dc12855c744 (DEFAULT_TABLE table=default.Table_d3cce811ecf44ac8922775c36db30fba [id=dbd65a5203064e10a464df6a3208ae67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.677191 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36f17094e504d80a2443dc12855c744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.678589 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 1122dcf7bcea4654bf29ff01fc4a350d (DEFAULT_TABLE table=default.Table_32e1324fe8ca42788d488f6d5ce8ca27 [id=fbcec0863c7a488f8298fb2b486bfefb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.679375 13425 tablet_service.cc:1511] Processing CreateTablet for tablet f19e7aa805bd417eae45fb43ac18a66d (DEFAULT_TABLE table=default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.679898 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1122dcf7bcea4654bf29ff01fc4a350d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.681680 14649 raft_consensus.cc:493] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:47.682438 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ba05f4940220459f951adf3491f60b93
I20260810 13:53:47.682339 14649 raft_consensus.cc:515] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.685020 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f19e7aa805bd417eae45fb43ac18a66d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.686167 14649 leader_election.cc:290] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:47.687357 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9b5c5b4c45b147b2bf013c380d097db7" } new_table_name: "default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202" modify_external_catalogs: true
I20260810 13:53:47.705041 14631 tablet.cc:1724] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:47.709019 13448 tablet_service.cc:1511] Processing CreateTablet for tablet d36f17094e504d80a2443dc12855c744 (DEFAULT_TABLE table=default.Table_d3cce811ecf44ac8922775c36db30fba [id=dbd65a5203064e10a464df6a3208ae67]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.710291 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36f17094e504d80a2443dc12855c744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.713124 13640 tablet_bootstrap.cc:700] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent opening tablet: real 0.109s user 0.004s sys 0.000s
I20260810 13:53:47.714046 13640 tablet_bootstrap.cc:654] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:47.716869 13164 leader_election.cc:304] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.716715 14613 raft_consensus.cc:515] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.717939 13265 raft_consensus.cc:2393] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:47.718253 13421 tablet_service.cc:1558] Processing DeleteTablet for tablet ba05f4940220459f951adf3491f60b93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:47.718624 14633 tablet.cc:1724] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:47.721047 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:47.721570 14512 raft_consensus.cc:2804] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:47.721930 14512 raft_consensus.cc:493] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:47.725035 14512 raft_consensus.cc:3060] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:47.733248 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:47.736477 13014 tablet_service.cc:1511] Processing CreateTablet for tablet d1ec72a86a08452fb8b390b62f8c6dec (DEFAULT_TABLE table=default.Table_63e74b1d9a4e48c3b9343a12f0b926e6 [id=a17784f2e3a940e59b5603273436c417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.737520 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ec72a86a08452fb8b390b62f8c6dec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:47.739048 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f922c9ca51044dcda08b245010ab06b0 (table default.Table_61ea331d19cb4393a84ea7b467d1d733 [id=4f643df81e154985a45b424943fa9379], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f922c9ca51044dcda08b245010ab06b0 consensus state has no leader
I20260810 13:53:47.740903 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet ba05f4940220459f951adf3491f60b93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:47.751883 13382 leader_election.cc:343] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: a58df75cb91544ef863a09f4d6004da0
I20260810 13:53:47.752279 13382 leader_election.cc:304] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.755944 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet ba05f4940220459f951adf3491f60b93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:47.765058 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 8fa729726a7f4603b0f5085a56cf89f6
I20260810 13:53:47.771936 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:47.771936 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:47.771324 14512 raft_consensus.cc:515] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:47.772717 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ba05f4940220459f951adf3491f60b93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba05f4940220459f951adf3491f60b93 already in progress: creating tablet
W20260810 13:53:47.774936 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 8fa729726a7f4603b0f5085a56cf89f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fa729726a7f4603b0f5085a56cf89f6 already in progress: creating tablet
I20260810 13:53:47.783299 14650 raft_consensus.cc:2749] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:53:47.784881 13382 leader_election.cc:343] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:47.785854 13382 leader_election.cc:304] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.788800 14613 leader_election.cc:290] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:47.789819 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9566586ecdd24e94bad62906c2166afd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:47.799172 14495 raft_consensus.cc:2749] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260810 13:53:47.815618 13382 leader_election.cc:343] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:47.815514 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9566586ecdd24e94bad62906c2166afd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:47.817039 13470 raft_consensus.cc:2393] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:47.817194 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4afea2da7c54e508084be42dec35099" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:47.818001 13476 raft_consensus.cc:3060] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:47.816262 13382 leader_election.cc:304] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.819941 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:47.820010 14394 raft_consensus.cc:2749] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:47.792006 13167 leader_election.cc:343] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:47.818550 14658 tablet.cc:1724] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:47.831776 13227 tablet_service.cc:1511] Processing CreateTablet for tablet d1ec72a86a08452fb8b390b62f8c6dec (DEFAULT_TABLE table=default.Table_63e74b1d9a4e48c3b9343a12f0b926e6 [id=a17784f2e3a940e59b5603273436c417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.833158 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4afea2da7c54e508084be42dec35099" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:47.833901 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ec72a86a08452fb8b390b62f8c6dec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:47.837579 13167 leader_election.cc:343] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:47.843146 13638 tablet_bootstrap.cc:492] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:47.843668 13638 ts_tablet_manager.cc:1403] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.551s user 0.018s sys 0.000s
I20260810 13:53:47.843550 14668 raft_consensus.cc:493] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:47.848305 13638 raft_consensus.cc:359] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.849375 13638 raft_consensus.cc:385] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:47.849695 13638 raft_consensus.cc:740] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:47.863309 14661 tablet.cc:1724] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:47.867841 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
I20260810 13:53:47.868534 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]). Expected version 2 got 0
I20260810 13:53:47.868985 14597 raft_consensus.cc:493] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:47.869634 14597 raft_consensus.cc:515] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.821408 14512 leader_election.cc:290] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:47.874908 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:47.878648 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]). Expected version 1 got 0
I20260810 13:53:47.879761 14273 ts_tablet_manager.cc:1929] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:47.880188 14273 log.cc:1199] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/e23454581a9a4b55b0756ef890dee7fb
I20260810 13:53:47.881021 14273 ts_tablet_manager.cc:1950] T e23454581a9a4b55b0756ef890dee7fb P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:47.896499 12994 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 17) took 1319 ms. Trace:
I20260810 13:53:47.897642 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_53663ab7daeb49e2b2066611c8ad73d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:47.900048 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53663ab7daeb49e2b2066611c8ad73d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:47.902544 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b06142d593144274beace392faa4ec79" } modify_external_catalogs: true
W20260810 13:53:47.901335 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 81600.9us
I20260810 13:53:47.903798 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 452978fbf3b74e3c9b16756b9f394be7 (DEFAULT_TABLE table=default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.910599 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452978fbf3b74e3c9b16756b9f394be7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:47.911481 12728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111) [suppressed 3 similar messages]
I20260810 13:53:47.915158 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b06142d593144274beace392faa4ec79" } modify_external_catalogs: true
I20260810 13:53:47.925350 13639 tablet_bootstrap.cc:654] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:47.928824 12994 rpcz_store.cc:276] 0810 13:53:46.577512 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.577625 (+ 113us) service_pool.cc:224] Handling call
0810 13:53:46.944900 (+367275us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400111554. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:53:47.896401 (+951501us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255623040}
I20260810 13:53:47.932960 14244 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.36.20:41503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.12.36.62:33317,127.12.36.61:35861,127.12.36.60:38017
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.36.61:35861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.36.61
--webserver_port=36613
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
Master server version:
kudu 1.19.0-SNAPSHOT
revision 4bcd631c449d3c6649730ca6e07660c8168f0d44
build type FASTDEBUG
built by None at 10 Aug 2026 13:43:20 UTC on e7f111948823
build id 13275
TSAN enabled
I20260810 13:53:47.935315 14244 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 13:53:47.940433 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 0d147e624d4243b9b330c874e0f27f6c (DEFAULT_TABLE table=default.Table_213c40da56b549d3bb97fccaa8f872cd [id=8bb576bce14b4fc3b1848496c6081841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.941579 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d147e624d4243b9b330c874e0f27f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.943773 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 219) took 5097 ms. Trace:
I20260810 13:53:47.944133 14273 rpcz_store.cc:276] 0810 13:53:42.846401 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.849625 (+ 3224us) service_pool.cc:224] Handling call
0810 13:53:47.478282 (+4628657us) ts_tablet_manager.cc:1151] Deleting tablet e23454581a9a4b55b0756ef890dee7fb
0810 13:53:47.478346 (+ 64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:47.504622 (+ 26276us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.879632 (+375010us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:47.943666 (+ 64034us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4619211}
I20260810 13:53:47.956025 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 918edf5d7b4f45009c5d476588399d0c
I20260810 13:53:47.957358 13022 tablet_service.cc:1511] Processing CreateTablet for tablet e9840da46a92439f8c96bc3714650f17 (DEFAULT_TABLE table=default.Table_545faed375f94bd7ac5b07cf16c36f14 [id=ae8450e076e6464a8a3ddd88c6a04de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:47.957835 14273 tablet_replica.cc:333] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:47.958369 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9840da46a92439f8c96bc3714650f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.958753 14273 raft_consensus.cc:2243] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:47.959177 14273 raft_consensus.cc:2272] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:47.961187 14596 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:47.961506 14273 ts_tablet_manager.cc:1916] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:47.961884 12745 catalog_manager.cc:6807] ReplaceTablet: tablet 918edf5d7b4f45009c5d476588399d0c deleted and replaced by tablet 9dc6395b50b2458fa2d3877eb7ec2ade
I20260810 13:53:47.961761 14596 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:47.963680 13476 raft_consensus.cc:2468] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:47.969599 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet 918edf5d7b4f45009c5d476588399d0c with delete_type TABLET_DATA_DELETED (replaced by tablet 9dc6395b50b2458fa2d3877eb7ec2ade) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:47.970857 14596 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:47.971105 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f101d8577cc1452ea2515229ebad2441" } modify_external_catalogs: true
I20260810 13:53:47.971738 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f101d8577cc1452ea2515229ebad2441" } modify_external_catalogs: true
I20260810 13:53:47.796334 14656 tablet.cc:1724] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 13:53:47.976701 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 73141.3us
I20260810 13:53:47.980463 13164 leader_election.cc:304] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:47.982704 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet e23454581a9a4b55b0756ef890dee7fb (table default.Table_08582b65868149cca4ac724f7d18a869 [id=590b98307a364781a383eb9a072bb4d7]) successfully deleted
I20260810 13:53:47.984609 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_86dcc5d091024407b7e167806ec593a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:47.986778 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86dcc5d091024407b7e167806ec593a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:48.002974 14244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260810 13:53:48.005826 14614 raft_consensus.cc:2749] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:53:48.007100 14597 leader_election.cc:290] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:48.009972 13213 tablet_service.cc:1558] Processing DeleteTablet for tablet c5f2e89d61854ee5bf6955b8244215eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:48.013403 14643 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:42314 (request call id 257) took 1179 ms. Trace:
I20260810 13:53:47.857049 13638 consensus_queue.cc:260] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.016906 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 674599456f9a49dc98d8d089c166ca89 (DEFAULT_TABLE table=default.Table_91b7a336c30a4dcfafc6aa52bf1b1929 [id=9eb780278810411cab5fa9af8e70e2d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.020534 14389 ts_tablet_manager.cc:1929] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:48.021056 14389 log.cc:1199] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/1c2ad1e3a90f47ac83ca262cad9964f0
I20260810 13:53:48.021863 14389 ts_tablet_manager.cc:1950] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:48.022701 13638 ts_tablet_manager.cc:1434] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.179s user 0.006s sys 0.005s
I20260810 13:53:48.024108 13164 leader_election.cc:304] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:48.008306 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:48.034207 14633 tablet.cc:1724] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:48.037237 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674599456f9a49dc98d8d089c166ca89. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:48.041915 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 953f83dab3ca406f8638e446911614b0 consensus state has no leader
I20260810 13:53:48.050482 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec1f506c6cd4222b4bd6176ccd54e56 (DEFAULT_TABLE table=default.Table_e16662a9b5514b04b2d2fad48ad3d82f [id=51cc3d6cb6d248fc94d93654adfc72c0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:48.051924 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f764e91bb2c94bc3be425b65323764cb consensus state has no leader
I20260810 13:53:48.054522 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec1f506c6cd4222b4bd6176ccd54e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:47.954042 14668 raft_consensus.cc:515] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:48.074266 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 918edf5d7b4f45009c5d476588399d0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 918edf5d7b4f45009c5d476588399d0c already in progress: creating tablet
I20260810 13:53:48.012418 13217 tablet_service.cc:1511] Processing CreateTablet for tablet 452978fbf3b74e3c9b16756b9f394be7 (DEFAULT_TABLE table=default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.089430 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f2e89d61854ee5bf6955b8244215eb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:48.094292 13638 tablet_bootstrap.cc:492] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:48.096953 12740 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d] alter complete (version 1)
I20260810 13:53:48.097111 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 674599456f9a49dc98d8d089c166ca89 (DEFAULT_TABLE table=default.Table_91b7a336c30a4dcfafc6aa52bf1b1929 [id=9eb780278810411cab5fa9af8e70e2d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.098259 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674599456f9a49dc98d8d089c166ca89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.101308 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec1f506c6cd4222b4bd6176ccd54e56 (DEFAULT_TABLE table=default.Table_e16662a9b5514b04b2d2fad48ad3d82f [id=51cc3d6cb6d248fc94d93654adfc72c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.102411 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec1f506c6cd4222b4bd6176ccd54e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.081498 14597 raft_consensus.cc:2804] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:48.113758 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet d2f8801796064c39ba1c81c64d622d68
I20260810 13:53:48.114676 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 242) took 2966 ms. Trace:
I20260810 13:53:48.115012 14389 rpcz_store.cc:276] 0810 13:53:45.057767 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.057908 (+ 141us) service_pool.cc:224] Handling call
0810 13:53:46.977217 (+1919309us) ts_tablet_manager.cc:1151] Deleting tablet 1c2ad1e3a90f47ac83ca262cad9964f0
0810 13:53:46.977287 (+ 70us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:47.775964 (+798677us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:48.020416 (+244452us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:48.023899 (+ 3483us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261125,"tablet-delete.queue_time_us":1918579}
I20260810 13:53:48.116242 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 17df06cad1404d96bda5822be6a6e995
I20260810 13:53:48.118299 13210 tablet_service.cc:1511] Processing CreateTablet for tablet 0d147e624d4243b9b330c874e0f27f6c (DEFAULT_TABLE table=default.Table_213c40da56b549d3bb97fccaa8f872cd [id=8bb576bce14b4fc3b1848496c6081841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.013943 14643 rpcz_store.cc:276] 0810 13:53:46.833764 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.834281 (+ 517us) service_pool.cc:224] Handling call
0810 13:53:48.013270 (+1178989us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:47.055532 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:47.056468 (+ 936us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:47.056533 (+ 65us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:47.056634 (+ 101us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:47.056824 (+ 190us) alter_schema_op.cc:128] START. Timestamp: 1786370027056376
0810 13:53:47.056856 (+ 32us) op_driver.cc:348] REPLICATION: starting
0810 13:53:47.057707 (+ 851us) log.cc:844] Serialized 173 byte log entry
0810 13:53:47.581088 (+523381us) op_driver.cc:464] REPLICATION: finished
0810 13:53:47.583250 (+ 2162us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:53:47.659973 (+ 76723us) log.cc:844] Serialized 5 byte log entry
0810 13:53:47.855313 (+195340us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:48.012877 (+157564us) log.cc:844] Serialized 14 byte log entry
0810 13:53:48.013028 (+ 151us) alter_schema_op.cc:73] Released schema lock
0810 13:53:48.013088 (+ 60us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1903,"prepare.queue_time_us":189609,"prepare.run_cpu_time_us":4367,"prepare.run_wall_time_us":238637,"raft.queue_time_us":917,"raft.run_cpu_time_us":15,"raft.run_wall_time_us":16,"replication_time_us":524057,"thread_start_us":158049,"threads_started":3,"wal-append.queue_time_us":177422}]]}
I20260810 13:53:48.119455 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d147e624d4243b9b330c874e0f27f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.124871 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 1c2ad1e3a90f47ac83ca262cad9964f0 (table default.Table_a456e8d8c2b046e7a2877075ce1b3741 [id=2e4a328ff76e41a1bd0718c74494f4d6]) successfully deleted
I20260810 13:53:48.124502 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 243) took 2936 ms. Trace:
I20260810 13:53:48.126278 14389 rpcz_store.cc:276] 0810 13:53:45.187765 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.194279 (+ 6514us) service_pool.cc:224] Handling call
0810 13:53:48.124157 (+2929878us) ts_tablet_manager.cc:1151] Deleting tablet 8b82b59b066c4240a387e7de48de9c70
0810 13:53:48.124207 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.124448 (+ 241us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2929178}
I20260810 13:53:48.129197 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 244) took 2833 ms. Trace:
I20260810 13:53:48.132272 14389 rpcz_store.cc:276] 0810 13:53:45.295922 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.300236 (+ 4314us) service_pool.cc:224] Handling call
0810 13:53:48.128763 (+2828527us) ts_tablet_manager.cc:1151] Deleting tablet cb8aea1057f445a9b060d138952324ca
0810 13:53:48.128822 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.129134 (+ 312us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2827297}
I20260810 13:53:48.142624 13640 tablet_bootstrap.cc:492] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
W20260810 13:53:48.142839 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 8b82b59b066c4240a387e7de48de9c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b82b59b066c4240a387e7de48de9c70 already in progress: creating tablet
I20260810 13:53:48.144129 13640 ts_tablet_manager.cc:1403] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.757s user 0.014s sys 0.006s
I20260810 13:53:48.144270 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet d2f8801796064c39ba1c81c64d622d68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:48.144904 13003 tablet_service.cc:1558] Processing DeleteTablet for tablet 17df06cad1404d96bda5822be6a6e995 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:48.145514 14272 tablet_replica.cc:333] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:48.146183 14272 raft_consensus.cc:2243] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:48.146663 14272 raft_consensus.cc:2272] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:48.148355 14272 ts_tablet_manager.cc:1916] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:48.156924 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet d2f8801796064c39ba1c81c64d622d68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:48.158541 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet 17df06cad1404d96bda5822be6a6e995 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:48.161825 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452978fbf3b74e3c9b16756b9f394be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.163184 13215 tablet_service.cc:1511] Processing CreateTablet for tablet e9840da46a92439f8c96bc3714650f17 (DEFAULT_TABLE table=default.Table_545faed375f94bd7ac5b07cf16c36f14 [id=ae8450e076e6464a8a3ddd88c6a04de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.179041 14272 ts_tablet_manager.cc:1929] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:48.179553 14272 log.cc:1199] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/d2f8801796064c39ba1c81c64d622d68
I20260810 13:53:48.120728 13265 raft_consensus.cc:2393] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:48.180497 14272 ts_tablet_manager.cc:1950] T d2f8801796064c39ba1c81c64d622d68 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:48.166334 13167 leader_election.cc:343] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:48.166879 14597 raft_consensus.cc:697] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
W20260810 13:53:48.093393 14644 log.cc:927] Time spent T 5836c2923aaf4c698e20b9652fcddc20 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.066s user 0.000s sys 0.000s
I20260810 13:53:48.088544 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 918edf5d7b4f45009c5d476588399d0c with delete_type TABLET_DATA_DELETED (replaced by tablet 9dc6395b50b2458fa2d3877eb7ec2ade) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:48.187328 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet cb8aea1057f445a9b060d138952324ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb8aea1057f445a9b060d138952324ca already in progress: creating tablet
I20260810 13:53:48.111241 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4fe8abad5649f2a42686c00148d957 (DEFAULT_TABLE table=default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.196214 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4fe8abad5649f2a42686c00148d957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.205756 14597 consensus_queue.cc:237] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.209141 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9840da46a92439f8c96bc3714650f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.216544 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4fe8abad5649f2a42686c00148d957 (DEFAULT_TABLE table=default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.218130 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4fe8abad5649f2a42686c00148d957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.225376 14673 tablet.cc:1724] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:48.230636 14389 tablet_replica.cc:333] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:48.236562 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]) successfully deleted
W20260810 13:53:48.237551 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 17df06cad1404d96bda5822be6a6e995 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17df06cad1404d96bda5822be6a6e995 already in progress: creating tablet
I20260810 13:53:48.251466 13639 tablet_bootstrap.cc:492] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:48.256803 13639 ts_tablet_manager.cc:1403] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.848s user 0.015s sys 0.006s
I20260810 13:53:48.257920 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f0e1196bb55b4d30ad90fd7b21cb48b2" } new_table_name: "default.Table_c8b2a7d2d3d346898424ac950b04204b" modify_external_catalogs: true
I20260810 13:53:48.258764 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_312808fed3bf45e8923e2b1be7f4d9fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:48.260000 12750 master_service.cc:960] ReplaceTablet: received request to replace tablet f4946f79b54c46b1a59edf169109ab47 from {username='slave'} at 127.0.0.1:48758
W20260810 13:53:48.260435 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_312808fed3bf45e8923e2b1be7f4d9fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:48.261986 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_53663ab7daeb49e2b2066611c8ad73d2" } new_table_name: "default.Table_7417382a79834243946b1020f4399428" modify_external_catalogs: true
I20260810 13:53:48.264853 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_36d488faa81542ca8b55867672ca281a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:48.266311 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_36d488faa81542ca8b55867672ca281a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:48.270278 14389 raft_consensus.cc:2243] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:48.270845 14389 raft_consensus.cc:2272] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:48.273025 14389 ts_tablet_manager.cc:1916] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:48.277179 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
I20260810 13:53:48.278620 13639 raft_consensus.cc:359] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.279305 13639 raft_consensus.cc:385] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:48.279580 13639 raft_consensus.cc:740] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:48.067870 14669 tablet.cc:1724] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260810 13:53:48.307540 12728 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 -> Peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Couldn't send request to peer 2928f7d4503145b182d99007d240334d. Status: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260810 13:53:48.309309 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet f4946f79b54c46b1a59edf169109ab47
I20260810 13:53:48.312428 12750 catalog_manager.cc:6807] ReplaceTablet: tablet f4946f79b54c46b1a59edf169109ab47 deleted and replaced by tablet dd58cc128ce64f9abe1418b6093a1c2c
I20260810 13:53:48.313769 13223 tablet_service.cc:1558] Processing DeleteTablet for tablet f4946f79b54c46b1a59edf169109ab47 with delete_type TABLET_DATA_DELETED (replaced by tablet dd58cc128ce64f9abe1418b6093a1c2c) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:48.313568 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a80ad2cc0680447898f832a3da957607"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:48.315456 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a80ad2cc0680447898f832a3da957607 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:48.321784 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ebb1392a98aa4af199236e4b4b4ab3c5 has no consensus state
I20260810 13:53:48.322788 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet f4946f79b54c46b1a59edf169109ab47 with delete_type TABLET_DATA_DELETED (replaced by tablet dd58cc128ce64f9abe1418b6093a1c2c) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:48.325811 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet f4946f79b54c46b1a59edf169109ab47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4946f79b54c46b1a59edf169109ab47 already in progress: creating tablet
I20260810 13:53:48.331182 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_3fb4e7e2f617464f930b338a8ece6e38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:48.333215 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fb4e7e2f617464f930b338a8ece6e38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:48.337095 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_545faed375f94bd7ac5b07cf16c36f14" } modify_external_catalogs: true
I20260810 13:53:48.337683 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_545faed375f94bd7ac5b07cf16c36f14" } modify_external_catalogs: true
I20260810 13:53:48.328302 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:48.383093 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 4687f8fd44034ce28727c3b7e58e7fe9 (DEFAULT_TABLE table=default.Table_bd734d41b4c04e8fae8551c8d2f341dc [id=5b4eac88920044a7ba18bf40b8783a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.336045 13640 raft_consensus.cc:359] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.389254 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4687f8fd44034ce28727c3b7e58e7fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.389504 13640 raft_consensus.cc:385] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:48.389814 13640 raft_consensus.cc:740] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:48.390527 13640 consensus_queue.cc:260] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.382627 14668 leader_election.cc:290] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:48.408018 12750 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_7b48ac1f84df4984b491045d0aa9b2c8" } modify_external_catalogs: true
I20260810 13:53:48.408540 12750 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_7b48ac1f84df4984b491045d0aa9b2c8" } modify_external_catalogs: true
I20260810 13:53:48.280179 13639 consensus_queue.cc:260] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.416790 13639 ts_tablet_manager.cc:1434] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.155s user 0.005s sys 0.003s
I20260810 13:53:48.419111 13639 tablet_bootstrap.cc:492] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:48.447834 13638 tablet_bootstrap.cc:654] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:48.456565 14273 ts_tablet_manager.cc:1929] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:48.457083 14273 log.cc:1199] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/1c2ad1e3a90f47ac83ca262cad9964f0
I20260810 13:53:48.457837 14273 ts_tablet_manager.cc:1950] T 1c2ad1e3a90f47ac83ca262cad9964f0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:48.465642 14643 tablet.cc:1724] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:48.477005 14658 tablet.cc:1724] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:48.524125 13640 ts_tablet_manager.cc:1434] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.378s user 0.007s sys 0.001s
I20260810 13:53:48.518309 12745 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f] alter complete (version 2)
I20260810 13:53:48.529536 13640 tablet_bootstrap.cc:492] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:48.530354 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e7fae8b89720488f8787d4413e238fa4" } new_table_name: "default.Table_71513d2e5b514e3689dd3832681e181c" modify_external_catalogs: true
I20260810 13:53:48.442579 14596 raft_consensus.cc:493] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:48.552753 14596 raft_consensus.cc:515] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.559470 14596 leader_election.cc:290] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:48.561645 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 222) took 5694 ms. Trace:
I20260810 13:53:48.562089 14273 rpcz_store.cc:276] 0810 13:53:42.866943 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.867044 (+ 101us) service_pool.cc:224] Handling call
0810 13:53:47.957667 (+5090623us) ts_tablet_manager.cc:1151] Deleting tablet 1c2ad1e3a90f47ac83ca262cad9964f0
0810 13:53:47.957724 (+ 57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.149642 (+191918us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:48.456439 (+306797us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:48.561573 (+105134us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5090056}
I20260810 13:53:48.565861 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 4687f8fd44034ce28727c3b7e58e7fe9 (DEFAULT_TABLE table=default.Table_bd734d41b4c04e8fae8551c8d2f341dc [id=5b4eac88920044a7ba18bf40b8783a9d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:48.569978 14683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:48.572345 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4687f8fd44034ce28727c3b7e58e7fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.572640 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4afea2da7c54e508084be42dec35099" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:48.579027 14633 tablet.cc:1724] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:48.616622 12745 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_ebcd04452c3c454e93961b5a321e40d1 [id=9c99ad2364cc45fba0746cbae06deeeb] alter complete (version 2)
W20260810 13:53:48.637450 14696 log.cc:927] Time spent T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.135s user 0.001s sys 0.000s
W20260810 13:53:48.658485 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 514910us
I20260810 13:53:48.672324 13640 tablet_bootstrap.cc:654] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:48.685537 13638 tablet_bootstrap.cc:492] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:48.686149 13638 ts_tablet_manager.cc:1403] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.592s user 0.016s sys 0.006s
I20260810 13:53:48.688271 13639 tablet_bootstrap.cc:654] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:48.694159 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 452978fbf3b74e3c9b16756b9f394be7 (DEFAULT_TABLE table=default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.694751 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f2e89d61854ee5bf6955b8244215eb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:48.695417 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet 918edf5d7b4f45009c5d476588399d0c with delete_type TABLET_DATA_DELETED (replaced by tablet 9dc6395b50b2458fa2d3877eb7ec2ade) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:48.695652 13480 raft_consensus.cc:2468] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:48.697778 13417 tablet_service.cc:1511] Processing CreateTablet for tablet e9840da46a92439f8c96bc3714650f17 (DEFAULT_TABLE table=default.Table_545faed375f94bd7ac5b07cf16c36f14 [id=ae8450e076e6464a8a3ddd88c6a04de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.698173 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 0d147e624d4243b9b330c874e0f27f6c (DEFAULT_TABLE table=default.Table_213c40da56b549d3bb97fccaa8f872cd [id=8bb576bce14b4fc3b1848496c6081841]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.700762 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet d2f8801796064c39ba1c81c64d622d68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:48.702848 13424 tablet_service.cc:1511] Processing CreateTablet for tablet 1a4fe8abad5649f2a42686c00148d957 (DEFAULT_TABLE table=default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.703873 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet f4946f79b54c46b1a59edf169109ab47 with delete_type TABLET_DATA_DELETED (replaced by tablet dd58cc128ce64f9abe1418b6093a1c2c) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:48.705626 13420 tablet_service.cc:1511] Processing CreateTablet for tablet 4687f8fd44034ce28727c3b7e58e7fe9 (DEFAULT_TABLE table=default.Table_bd734d41b4c04e8fae8551c8d2f341dc [id=5b4eac88920044a7ba18bf40b8783a9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.706063 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec1f506c6cd4222b4bd6176ccd54e56 (DEFAULT_TABLE table=default.Table_e16662a9b5514b04b2d2fad48ad3d82f [id=51cc3d6cb6d248fc94d93654adfc72c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.707296 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6cfbfc47b2484396fcb517d791aae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:48.708050 13432 tablet_service.cc:1558] Processing DeleteTablet for tablet 17df06cad1404d96bda5822be6a6e995 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:48.709537 13425 tablet_service.cc:1511] Processing CreateTablet for tablet d1ec72a86a08452fb8b390b62f8c6dec (DEFAULT_TABLE table=default.Table_63e74b1d9a4e48c3b9343a12f0b926e6 [id=a17784f2e3a940e59b5603273436c417]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.715633 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 674599456f9a49dc98d8d089c166ca89 (DEFAULT_TABLE table=default.Table_91b7a336c30a4dcfafc6aa52bf1b1929 [id=9eb780278810411cab5fa9af8e70e2d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:48.718941 14614 raft_consensus.cc:493] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:48.722503 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 2 got 0
I20260810 13:53:48.727097 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet e9840da46a92439f8c96bc3714650f17
W20260810 13:53:48.726506 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c has no consensus state
I20260810 13:53:48.738359 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452978fbf3b74e3c9b16756b9f394be7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.743649 13640 tablet_bootstrap.cc:492] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:48.744174 13640 ts_tablet_manager.cc:1403] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.215s user 0.022s sys 0.004s
I20260810 13:53:48.746500 14389 ts_tablet_manager.cc:1929] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:48.746863 14389 log.cc:1199] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/0b427bfff3734fa08370bfbc480cb802
W20260810 13:53:48.746974 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f764e91bb2c94bc3be425b65323764cb consensus state has no leader
I20260810 13:53:48.747509 14389 ts_tablet_manager.cc:1950] T 0b427bfff3734fa08370bfbc480cb802 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:48.750255 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9840da46a92439f8c96bc3714650f17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.751400 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d147e624d4243b9b330c874e0f27f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.754594 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a4fe8abad5649f2a42686c00148d957. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.757055 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4687f8fd44034ce28727c3b7e58e7fe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.762976 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ec72a86a08452fb8b390b62f8c6dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.765864 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet db50d31d0d6c45faa1eb138357d532b3
I20260810 13:53:48.766652 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec1f506c6cd4222b4bd6176ccd54e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.769784 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet db50d31d0d6c45faa1eb138357d532b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:48 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:48.773945 12951 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:48.776265 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 1c2ad1e3a90f47ac83ca262cad9964f0 (table default.Table_a456e8d8c2b046e7a2877075ce1b3741 [id=2e4a328ff76e41a1bd0718c74494f4d6]) successfully deleted
I20260810 13:53:48.777335 14710 raft_consensus.cc:3060] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:48.785513 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaa924290594d319b02526550416571" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:48.793577 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet db50d31d0d6c45faa1eb138357d532b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db50d31d0d6c45faa1eb138357d532b3 already in progress: creating tablet
I20260810 13:53:48.794214 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 674599456f9a49dc98d8d089c166ca89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:48.825176 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 226) took 5271 ms. Trace:
I20260810 13:53:48.825548 14273 rpcz_store.cc:276] 0810 13:53:43.560398 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.560916 (+ 518us) service_pool.cc:224] Handling call
0810 13:53:48.563846 (+5002930us) ts_tablet_manager.cc:1151] Deleting tablet 64e93928dcb94ae296590c4dedfd1781
0810 13:53:48.690842 (+126996us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.825109 (+134267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5002212}
I20260810 13:53:48.826817 14710 raft_consensus.cc:2749] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:48.826906 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 227) took 5265 ms. Trace:
I20260810 13:53:48.827203 14273 rpcz_store.cc:276] 0810 13:53:43.561969 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:43.562267 (+ 298us) service_pool.cc:224] Handling call
0810 13:53:48.826508 (+5264241us) ts_tablet_manager.cc:1151] Deleting tablet c4db9d7e82414cab8a69618effe89b40
0810 13:53:48.826571 (+ 63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.826855 (+ 284us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5263576}
I20260810 13:53:48.828154 14273 tablet_replica.cc:333] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:48.719933 14614 raft_consensus.cc:515] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.829232 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 245) took 3486 ms. Trace:
I20260810 13:53:48.830848 14614 leader_election.cc:290] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:48.751019 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet e9840da46a92439f8c96bc3714650f17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:48 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:48.775231 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaaa924290594d319b02526550416571" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:48.798389 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet db50d31d0d6c45faa1eb138357d532b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:48 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:48.833312 13640 raft_consensus.cc:359] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.834017 13640 raft_consensus.cc:385] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:48.833927 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet e9840da46a92439f8c96bc3714650f17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:48 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:48.834265 13640 raft_consensus.cc:740] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:48.813572 13638 raft_consensus.cc:359] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.834733 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba87c833e5459884173b65fb5645b6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:48.835151 13638 raft_consensus.cc:385] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:48.834919 13640 consensus_queue.cc:260] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.835434 13638 raft_consensus.cc:740] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:48.836079 13167 leader_election.cc:343] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:48.836916 13640 ts_tablet_manager.cc:1434] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.092s user 0.002s sys 0.005s
I20260810 13:53:48.837405 13638 consensus_queue.cc:260] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.842163 13638 ts_tablet_manager.cc:1434] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.156s user 0.006s sys 0.001s
I20260810 13:53:48.829536 14389 rpcz_store.cc:276] 0810 13:53:45.342848 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.348819 (+ 5971us) service_pool.cc:224] Handling call
0810 13:53:48.188830 (+2840011us) ts_tablet_manager.cc:1151] Deleting tablet 0b427bfff3734fa08370bfbc480cb802
0810 13:53:48.230460 (+ 41630us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a6b52 00007f91209141d9 00007f911fb2c4e8 00007f911fbf2aa9 00007f911fbf30a3 00007f911fc240e0 00007f911fc0a64d 00007f911fc0a5f9 00007f911fc0a589
0810 13:53:48.230507 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.540244 (+309737us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:48.746372 (+206128us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:48.829159 (+ 82787us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35593,"spinlock_wait_cycles":52743040,"tablet-delete.queue_time_us":2628782}
I20260810 13:53:48.845021 14389 tablet_replica.cc:333] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:48.845247 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 0b427bfff3734fa08370bfbc480cb802 (table default.Table_dac7ad3575c0493f80f31c5bc76e595f [id=be02ad64399140469aa0fdfb872b3c22]) successfully deleted
I20260810 13:53:48.845727 14389 raft_consensus.cc:2243] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:48.847755 13638 tablet_bootstrap.cc:492] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:48.849771 14389 raft_consensus.cc:2272] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:48.851971 14389 ts_tablet_manager.cc:1916] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:48.854580 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet e9840da46a92439f8c96bc3714650f17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9840da46a92439f8c96bc3714650f17 already in progress: creating tablet
I20260810 13:53:48.854614 13164 leader_election.cc:304] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:48.857424 14597 raft_consensus.cc:2804] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:48.857944 14597 raft_consensus.cc:493] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:48.858441 14597 raft_consensus.cc:3060] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:48.865722 13638 tablet_bootstrap.cc:654] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:48.868570 13382 leader_election.cc:343] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:48.884164 13640 tablet_bootstrap.cc:492] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:48.888855 14389 ts_tablet_manager.cc:1929] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:48.889230 14389 log.cc:1199] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/9566586ecdd24e94bad62906c2166afd
I20260810 13:53:48.889896 14389 ts_tablet_manager.cc:1950] T 9566586ecdd24e94bad62906c2166afd P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:48.896431 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 246) took 2802 ms. Trace:
I20260810 13:53:48.896751 14389 rpcz_store.cc:276] 0810 13:53:46.094124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.094424 (+ 300us) service_pool.cc:224] Handling call
0810 13:53:48.844870 (+2750446us) ts_tablet_manager.cc:1151] Deleting tablet 9566586ecdd24e94bad62906c2166afd
0810 13:53:48.844911 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.882412 (+ 37501us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:48.888738 (+ 6326us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:48.896372 (+ 7634us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2749808}
I20260810 13:53:48.898000 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 248) took 2527 ms. Trace:
I20260810 13:53:48.898097 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 9566586ecdd24e94bad62906c2166afd (table default.Table_e9ba4f3b33c04d40b8eec3b0ff44485f [id=cccb8bdc8e41456d8c9614c8ca334a29]) successfully deleted
I20260810 13:53:48.898280 14389 rpcz_store.cc:276] 0810 13:53:46.370946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.371118 (+ 172us) service_pool.cc:224] Handling call
0810 13:53:48.897687 (+2526569us) ts_tablet_manager.cc:1151] Deleting tablet 2327309017db4094907b3e405988f224
0810 13:53:48.897727 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.897951 (+ 224us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2525646}
I20260810 13:53:48.899399 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 249) took 2528 ms. Trace:
W20260810 13:53:48.899515 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 2327309017db4094907b3e405988f224 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2327309017db4094907b3e405988f224 already in progress: creating tablet
I20260810 13:53:48.899680 14389 rpcz_store.cc:276] 0810 13:53:46.371358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.374739 (+ 3381us) service_pool.cc:224] Handling call
0810 13:53:48.899091 (+2524352us) ts_tablet_manager.cc:1151] Deleting tablet 2b67e5a2b5334147b9d25f2ddc73de31
0810 13:53:48.899128 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.899354 (+ 226us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2523477}
W20260810 13:53:48.900978 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 2b67e5a2b5334147b9d25f2ddc73de31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b67e5a2b5334147b9d25f2ddc73de31 already in progress: creating tablet
I20260810 13:53:48.895112 14273 raft_consensus.cc:2243] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:48.905295 14273 raft_consensus.cc:2272] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:48.905766 13638 tablet_bootstrap.cc:492] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:48.906180 13638 ts_tablet_manager.cc:1403] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.059s user 0.017s sys 0.000s
W20260810 13:53:48.891157 13382 consensus_peers.cc:597] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2f8801796064c39ba1c81c64d622d68. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:48.910269 13638 raft_consensus.cc:359] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.911108 13638 raft_consensus.cc:385] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:48.911443 13638 raft_consensus.cc:740] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:48.912438 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 252) took 2405 ms. Trace:
I20260810 13:53:48.912886 14389 rpcz_store.cc:276] 0810 13:53:46.506869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.507766 (+ 897us) service_pool.cc:224] Handling call
0810 13:53:48.900472 (+2392706us) ts_tablet_manager.cc:1151] Deleting tablet 69a3a4d2724b42da83a523e208b5714b
0810 13:53:48.900513 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.912363 (+ 11850us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2391694}
W20260810 13:53:48.914546 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 69a3a4d2724b42da83a523e208b5714b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69a3a4d2724b42da83a523e208b5714b already in progress: creating tablet
I20260810 13:53:48.915486 13638 consensus_queue.cc:260] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.919257 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 253) took 2411 ms. Trace:
I20260810 13:53:48.919565 14389 rpcz_store.cc:276] 0810 13:53:46.507611 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.509696 (+ 2085us) service_pool.cc:224] Handling call
0810 13:53:48.918908 (+2409212us) ts_tablet_manager.cc:1151] Deleting tablet ab4cd2e5c73e467eb1bc4623e5d5e831
0810 13:53:48.918969 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.919203 (+ 234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840,"tablet-delete.queue_time_us":2345899}
W20260810 13:53:48.920794 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab4cd2e5c73e467eb1bc4623e5d5e831 already in progress: creating tablet
I20260810 13:53:48.921804 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 260) took 1957 ms. Trace:
I20260810 13:53:48.922129 14389 rpcz_store.cc:276] 0810 13:53:46.964518 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.964740 (+ 222us) service_pool.cc:224] Handling call
0810 13:53:48.921499 (+1956759us) ts_tablet_manager.cc:1151] Deleting tablet b820c99b33264add8df5fd443981d0cc
0810 13:53:48.921542 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.921752 (+ 210us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1954361}
W20260810 13:53:48.923674 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet b820c99b33264add8df5fd443981d0cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b820c99b33264add8df5fd443981d0cc already in progress: creating tablet
I20260810 13:53:48.918056 13638 ts_tablet_manager.cc:1434] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.012s user 0.009s sys 0.000s
I20260810 13:53:48.926489 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 259) took 1965 ms. Trace:
I20260810 13:53:48.926390 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_eaf27dfbda4345929e86fdb05561b3e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:48.926755 14389 rpcz_store.cc:276] 0810 13:53:46.961504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.964002 (+ 2498us) service_pool.cc:224] Handling call
0810 13:53:48.926181 (+1962179us) ts_tablet_manager.cc:1151] Deleting tablet 7a745bc711004993830b40ca1c93c63b
0810 13:53:48.926218 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.926440 (+ 222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16465,"tablet-delete.queue_time_us":1955086}
W20260810 13:53:48.928529 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eaf27dfbda4345929e86fdb05561b3e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:48.933810 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_948d3130a68a44d2aed5a39238172b01" } modify_external_catalogs: true
I20260810 13:53:48.933883 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c39a51586fe847b990c6d2c59e2280ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:48.934408 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_948d3130a68a44d2aed5a39238172b01" } modify_external_catalogs: true
W20260810 13:53:48.935328 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c39a51586fe847b990c6d2c59e2280ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:48.936390 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_270fa13ea58646819bcf21cf12afc107" } new_table_name: "default.Table_d245ed8e62804322bd2ec1f6572bc55b" modify_external_catalogs: true
W20260810 13:53:48.939330 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 7a745bc711004993830b40ca1c93c63b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a745bc711004993830b40ca1c93c63b already in progress: creating tablet
I20260810 13:53:48.935931 14597 raft_consensus.cc:515] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.945253 13638 tablet_bootstrap.cc:492] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:53:48.945312 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 39ff3a48af494009bb53ee8d4e2a08cd consensus state has no leader
I20260810 13:53:48.946519 13639 tablet_bootstrap.cc:492] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:48.946940 13639 ts_tablet_manager.cc:1403] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.528s user 0.014s sys 0.005s
I20260810 13:53:48.950991 13639 raft_consensus.cc:359] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.951674 13639 raft_consensus.cc:385] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:48.951910 13639 raft_consensus.cc:740] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:48.955123 14597 leader_election.cc:290] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:48.957090 14389 tablet_replica.cc:333] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:48.958046 14389 raft_consensus.cc:2243] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:48.958797 14389 pending_rounds.cc:70] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:48.959017 14389 pending_rounds.cc:77] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971635808755712 op_type: NO_OP noop_request { }
I20260810 13:53:48.959568 14389 raft_consensus.cc:2889] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:48.962381 14597 raft_consensus.cc:493] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:48.963111 14597 raft_consensus.cc:515] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:48.960011 14389 raft_consensus.cc:2272] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:48.965035 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 75322.4us
I20260810 13:53:48.966122 14389 ts_tablet_manager.cc:1916] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:48.971521 14273 ts_tablet_manager.cc:1916] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:48.964605 13638 tablet_bootstrap.cc:654] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:48.980122 14597 leader_election.cc:290] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:49.000945 13638 tablet_bootstrap.cc:492] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:49.001497 13638 ts_tablet_manager.cc:1403] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.077s user 0.005s sys 0.011s
I20260810 13:53:49.004248 13638 raft_consensus.cc:359] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.007205 13638 raft_consensus.cc:385] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.007586 13638 raft_consensus.cc:740] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:49.007488 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 52178.6us
I20260810 13:53:49.009545 13638 consensus_queue.cc:260] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.011600 14389 ts_tablet_manager.cc:1929] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:49.011982 14389 log.cc:1199] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/e4afea2da7c54e508084be42dec35099
I20260810 13:53:49.021485 12744 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_5b59b711a1d0406b978d28c419f8e4a5 [id=667ccf7ba20c49b2be82e167aa212ecd] alter complete (version 2)
I20260810 13:53:49.024621 13638 ts_tablet_manager.cc:1434] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260810 13:53:49.028807 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f2e89d61854ee5bf6955b8244215eb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:49.029233 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_229c64c5f5804f6c8a3047ec7858322b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:49.028808 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:49.031008 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_229c64c5f5804f6c8a3047ec7858322b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:49.031550 13167 leader_election.cc:343] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:49.033293 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_640c451fefef49f3a4960de11632ca5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:49.034849 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_640c451fefef49f3a4960de11632ca5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:49.039593 12749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_723061893666401a9728e4a49b584f5f" } modify_external_catalogs: true
I20260810 13:53:49.040118 12749 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_723061893666401a9728e4a49b584f5f" } modify_external_catalogs: true
I20260810 13:53:49.041297 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet e4afea2da7c54e508084be42dec35099 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:49.002525 14649 consensus_queue.cc:1048] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260810 13:53:48.952519 13639 consensus_queue.cc:260] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.049713 13042 raft_consensus.cc:3060] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.054181 13638 tablet_bootstrap.cc:492] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:49.059046 13042 raft_consensus.cc:2468] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:49.060060 13638 tablet_bootstrap.cc:654] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.063200 14272 tablet_replica.cc:333] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:49.064229 14389 ts_tablet_manager.cc:1950] T e4afea2da7c54e508084be42dec35099 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:49.065709 14272 raft_consensus.cc:2243] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:49.066366 14272 raft_consensus.cc:2272] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:49.068605 14272 ts_tablet_manager.cc:1916] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.063337 13639 ts_tablet_manager.cc:1434] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.116s user 0.010s sys 0.002s
I20260810 13:53:49.079595 12746 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9] alter complete (version 1)
I20260810 13:53:49.068590 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 262) took 1894 ms. Trace:
I20260810 13:53:49.082816 13223 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ba87c833e5459884173b65fb5645b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.082506 14389 rpcz_store.cc:276] 0810 13:53:47.174118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:47.228897 (+ 54779us) service_pool.cc:224] Handling call
0810 13:53:48.956933 (+1728036us) ts_tablet_manager.cc:1151] Deleting tablet e4afea2da7c54e508084be42dec35099
0810 13:53:48.956976 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:48.978841 (+ 21865us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:49.011470 (+ 32629us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:49.068529 (+ 57059us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1726946}
I20260810 13:53:49.085654 13167 leader_election.cc:304] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:49.086499 14597 raft_consensus.cc:2804] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:49.086936 14597 raft_consensus.cc:697] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:49.087704 14597 consensus_queue.cc:237] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.093282 13639 tablet_bootstrap.cc:492] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:49.094333 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 266) took 1356 ms. Trace:
I20260810 13:53:49.094810 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet e4afea2da7c54e508084be42dec35099 (table default.Table_2de7aaadcc9042a1a7142a894e0c8493 [id=777bd2c67c1b46859627304bbcb53524]) successfully deleted
I20260810 13:53:49.098201 14389 rpcz_store.cc:276] 0810 13:53:47.738405 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:47.750349 (+ 11944us) service_pool.cc:224] Handling call
0810 13:53:49.093991 (+1343642us) ts_tablet_manager.cc:1151] Deleting tablet ba05f4940220459f951adf3491f60b93
0810 13:53:49.094032 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.094278 (+ 246us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1337227}
W20260810 13:53:49.103231 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ba05f4940220459f951adf3491f60b93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba05f4940220459f951adf3491f60b93 already in progress: creating tablet
I20260810 13:53:49.104481 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 267) took 1333 ms. Trace:
I20260810 13:53:49.105858 14389 rpcz_store.cc:276] 0810 13:53:47.771608 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:47.771760 (+ 152us) service_pool.cc:224] Handling call
0810 13:53:49.104159 (+1332399us) ts_tablet_manager.cc:1151] Deleting tablet 8fa729726a7f4603b0f5085a56cf89f6
0810 13:53:49.104198 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.104430 (+ 232us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1331740}
W20260810 13:53:49.117965 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 8fa729726a7f4603b0f5085a56cf89f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fa729726a7f4603b0f5085a56cf89f6 already in progress: creating tablet
I20260810 13:53:49.119280 14389 tablet_replica.cc:333] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:49.120116 13638 tablet_bootstrap.cc:492] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:49.120537 13638 ts_tablet_manager.cc:1403] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.003s
I20260810 13:53:49.122537 13639 tablet_bootstrap.cc:654] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.120046 14389 raft_consensus.cc:2243] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:49.123256 14389 pending_rounds.cc:70] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:49.123014 13638 raft_consensus.cc:359] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.123625 13638 raft_consensus.cc:385] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.123526 14389 pending_rounds.cc:77] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971639153205248 op_type: NO_OP noop_request { }
I20260810 13:53:49.123916 13638 raft_consensus.cc:740] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.124066 14389 raft_consensus.cc:2889] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:49.124480 14389 raft_consensus.cc:2272] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:49.126194 13640 tablet_bootstrap.cc:654] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.126044 13638 consensus_queue.cc:260] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.131666 14272 ts_tablet_manager.cc:1929] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:49.136945 13638 ts_tablet_manager.cc:1434] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.016s user 0.005s sys 0.001s
W20260810 13:53:49.159346 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 158134us
I20260810 13:53:49.160650 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4afea2da7c54e508084be42dec35099" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:49.161437 13480 raft_consensus.cc:2393] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:49.162420 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_32e1324fe8ca42788d488f6d5ce8ca27" } new_table_name: "default.Table_456a959279c440c9bbedd036b78afab9" modify_external_catalogs: true
I20260810 13:53:49.148587 13223 tablet_service.cc:1558] Processing DeleteTablet for tablet eaaa924290594d319b02526550416571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.149997 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6cfbfc47b2484396fcb517d791aae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.151176 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet acaaa179b4fa4ca592674e24a4e54706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:31 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.127812 14389 ts_tablet_manager.cc:1916] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.168535 13638 tablet_bootstrap.cc:492] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:49.171439 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet b7dded9a7c2c4652b41131f0bc14a6b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:40 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.174453 12743 master_service.cc:960] ReplaceTablet: received request to replace tablet db50d31d0d6c45faa1eb138357d532b3 from {username='slave'} at 127.0.0.1:48758
W20260810 13:53:49.185063 13382 leader_election.cc:343] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:49.185360 13638 tablet_bootstrap.cc:654] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.185544 13382 leader_election.cc:304] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.186532 14703 consensus_queue.cc:1048] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:49.184297 14272 log.cc:1199] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/e4afea2da7c54e508084be42dec35099
I20260810 13:53:49.194169 14272 ts_tablet_manager.cc:1950] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:49.196074 13640 tablet_bootstrap.cc:492] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:49.196000 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet e4afea2da7c54e508084be42dec35099 (table default.Table_2de7aaadcc9042a1a7142a894e0c8493 [id=777bd2c67c1b46859627304bbcb53524]) successfully deleted
I20260810 13:53:49.196329 14389 ts_tablet_manager.cc:1929] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:49.196465 13640 ts_tablet_manager.cc:1403] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.313s user 0.010s sys 0.003s
I20260810 13:53:49.196661 14389 log.cc:1199] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/c5f2e89d61854ee5bf6955b8244215eb
I20260810 13:53:49.197391 14389 ts_tablet_manager.cc:1950] T c5f2e89d61854ee5bf6955b8244215eb P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:49.198490 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 269) took 1192 ms. Trace:
I20260810 13:53:49.198825 14389 rpcz_store.cc:276] 0810 13:53:48.006018 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.009572 (+ 3554us) service_pool.cc:224] Handling call
0810 13:53:49.119136 (+1109564us) ts_tablet_manager.cc:1151] Deleting tablet c5f2e89d61854ee5bf6955b8244215eb
0810 13:53:49.119176 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.184422 (+ 65246us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:49.196213 (+ 11791us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:49.198426 (+ 2213us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1108421}
I20260810 13:53:49.200182 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet c5f2e89d61854ee5bf6955b8244215eb (table default.Table_636572e9c1c24956bc53550f45390b1d [id=7ef508c9f0fc4ba99843e9a975526602]) successfully deleted
I20260810 13:53:49.202690 13639 tablet_bootstrap.cc:492] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:49.203121 13639 ts_tablet_manager.cc:1403] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.133s user 0.009s sys 0.009s
I20260810 13:53:49.205401 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet c5f2e89d61854ee5bf6955b8244215eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:49.206148 14272 tablet_replica.cc:333] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:49.206928 14272 raft_consensus.cc:2243] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:49.207527 14272 raft_consensus.cc:2272] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:49.209586 14703 raft_consensus.cc:2749] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:49.210827 14272 ts_tablet_manager.cc:1916] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.214392 12743 master_service.cc:960] ReplaceTablet: received request to replace tablet f19e7aa805bd417eae45fb43ac18a66d from {username='slave'} at 127.0.0.1:48758
W20260810 13:53:49.216279 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 64e93928dcb94ae296590c4dedfd1781 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 64e93928dcb94ae296590c4dedfd1781 already in progress: creating tablet
W20260810 13:53:49.217015 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet c4db9d7e82414cab8a69618effe89b40 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4db9d7e82414cab8a69618effe89b40 already in progress: creating tablet
I20260810 13:53:49.212610 13639 raft_consensus.cc:359] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.221834 13638 tablet_bootstrap.cc:492] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:49.221731 13640 raft_consensus.cc:359] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.222301 13638 ts_tablet_manager.cc:1403] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.054s user 0.012s sys 0.000s
I20260810 13:53:49.222491 13640 raft_consensus.cc:385] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.222779 13640 raft_consensus.cc:740] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.223516 13640 consensus_queue.cc:260] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.224924 13638 raft_consensus.cc:359] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.225663 13638 raft_consensus.cc:385] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.225952 13638 raft_consensus.cc:740] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.226605 13638 consensus_queue.cc:260] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.220841 13639 raft_consensus.cc:385] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.228142 13639 raft_consensus.cc:740] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.228929 13639 consensus_queue.cc:260] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.233681 13639 ts_tablet_manager.cc:1434] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.030s user 0.005s sys 0.002s
I20260810 13:53:49.229754 13638 ts_tablet_manager.cc:1434] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260810 13:53:49.234602 14658 tablet.cc:1724] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:49.235446 13638 tablet_bootstrap.cc:492] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:49.237067 13639 tablet_bootstrap.cc:492] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:49.225517 12951 leader_election.cc:304] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:49.237841 12951 raft_consensus.cc:2686] T e4afea2da7c54e508084be42dec35099 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:49.242303 14389 tablet_replica.cc:333] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:49.242996 13638 tablet_bootstrap.cc:654] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.243075 14389 raft_consensus.cc:2243] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:49.243570 14389 raft_consensus.cc:2272] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:49.248876 14725 raft_consensus.cc:493] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:49.249341 14725 raft_consensus.cc:515] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.251358 14725 leader_election.cc:290] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:49.254914 13640 ts_tablet_manager.cc:1434] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.058s user 0.003s sys 0.004s
I20260810 13:53:49.259773 14389 ts_tablet_manager.cc:1916] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.261059 13638 tablet_bootstrap.cc:492] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:49.261511 13638 ts_tablet_manager.cc:1403] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.003s
I20260810 13:53:49.264041 13638 raft_consensus.cc:359] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.264833 13638 raft_consensus.cc:385] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.264997 13639 tablet_bootstrap.cc:654] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.265151 13638 raft_consensus.cc:740] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.266109 13638 consensus_queue.cc:260] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.268131 13638 ts_tablet_manager.cc:1434] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20260810 13:53:49.269037 13638 tablet_bootstrap.cc:492] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:49.274518 13638 tablet_bootstrap.cc:654] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.268666 13640 tablet_bootstrap.cc:492] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:49.285261 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba87c833e5459884173b65fb5645b6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:49.285960 13638 tablet_bootstrap.cc:492] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:49.285887 13480 raft_consensus.cc:2468] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:49.286433 13638 ts_tablet_manager.cc:1403] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.000s
I20260810 13:53:49.288898 13638 raft_consensus.cc:359] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.289743 13638 raft_consensus.cc:385] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.290031 13638 raft_consensus.cc:740] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.291604 13638 consensus_queue.cc:260] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.292662 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5f2e89d61854ee5bf6955b8244215eb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:49.294919 13470 raft_consensus.cc:3060] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.295173 14272 ts_tablet_manager.cc:1929] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:49.295564 14272 log.cc:1199] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/c5f2e89d61854ee5bf6955b8244215eb
I20260810 13:53:49.296212 14272 ts_tablet_manager.cc:1950] T c5f2e89d61854ee5bf6955b8244215eb P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:49.299440 13425 tablet_service.cc:1558] Processing DeleteTablet for tablet eaaa924290594d319b02526550416571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:49.292995 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:49.300509 13476 raft_consensus.cc:2468] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:49.301352 13639 tablet_bootstrap.cc:492] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:49.301733 13639 ts_tablet_manager.cc:1403] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.000s
I20260810 13:53:49.304244 13470 raft_consensus.cc:2468] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:49.304327 13639 raft_consensus.cc:359] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.304953 13639 raft_consensus.cc:385] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.305207 13639 raft_consensus.cc:740] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.305794 13639 consensus_queue.cc:260] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.306529 13425 tablet_service.cc:1558] Processing DeleteTablet for tablet e9840da46a92439f8c96bc3714650f17 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:48 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:49.307349 13638 ts_tablet_manager.cc:1434] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
I20260810 13:53:49.308200 13638 tablet_bootstrap.cc:492] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:49.307974 13425 tablet_service.cc:1558] Processing DeleteTablet for tablet db50d31d0d6c45faa1eb138357d532b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:48 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:49.312819 13425 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ba87c833e5459884173b65fb5645b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:49.313827 13638 tablet_bootstrap.cc:654] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.315773 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet c5f2e89d61854ee5bf6955b8244215eb (table default.Table_636572e9c1c24956bc53550f45390b1d [id=7ef508c9f0fc4ba99843e9a975526602]) successfully deleted
I20260810 13:53:49.319409 14273 ts_tablet_manager.cc:1929] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:49.323115 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet cea93840561c4cb3b90d46e4aa70f542
I20260810 13:53:49.323992 14389 ts_tablet_manager.cc:1929] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:49.330902 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet cea93840561c4cb3b90d46e4aa70f542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:48 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:49.337316 14273 log.cc:1199] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/a58df75cb91544ef863a09f4d6004da0
W20260810 13:53:49.338729 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d78892783474b329e31bf2df7d2952c consensus state has no leader
I20260810 13:53:49.338757 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2d75c2da0411444ba34cab36ab78b40b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:49.342414 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d75c2da0411444ba34cab36ab78b40b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:49.345875 13639 ts_tablet_manager.cc:1434] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.042s user 0.006s sys 0.000s
I20260810 13:53:49.329274 13425 tablet_service.cc:1558] Processing DeleteTablet for tablet b7dded9a7c2c4652b41131f0bc14a6b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:40 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:49.347064 14273 ts_tablet_manager.cc:1950] T a58df75cb91544ef863a09f4d6004da0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:49.350843 14710 raft_consensus.cc:493] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:49.351310 14710 raft_consensus.cc:515] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.353135 13639 tablet_bootstrap.cc:492] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:49.353529 14710 leader_election.cc:290] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:49.347077 14272 tablet_replica.cc:333] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:49.325307 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet cea93840561c4cb3b90d46e4aa70f542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:48 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.345588 14614 raft_consensus.cc:493] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:49.359208 14614 raft_consensus.cc:515] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.360931 13639 tablet_bootstrap.cc:654] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.361126 14614 leader_election.cc:290] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:49.354681 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:49.362241 13259 raft_consensus.cc:2468] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:49.358875 14389 log.cc:1199] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/d2f8801796064c39ba1c81c64d622d68
I20260810 13:53:49.363905 12952 leader_election.cc:304] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:49.364281 14389 ts_tablet_manager.cc:1950] T d2f8801796064c39ba1c81c64d622d68 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:49.364768 14710 raft_consensus.cc:2804] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:49.365104 14710 raft_consensus.cc:493] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:49.365423 14710 raft_consensus.cc:3060] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.365736 14272 raft_consensus.cc:2243] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:49.366827 14272 raft_consensus.cc:2272] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:49.369168 14272 ts_tablet_manager.cc:1916] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.373570 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dded9a7c2c4652b41131f0bc14a6b5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:49.374899 13167 leader_election.cc:343] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:49.375525 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet cea93840561c4cb3b90d46e4aa70f542 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:48 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:49.377928 13164 leader_election.cc:304] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.379175 13638 tablet_bootstrap.cc:492] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:49.379781 13638 ts_tablet_manager.cc:1403] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.072s user 0.024s sys 0.012s
I20260810 13:53:49.380353 14597 raft_consensus.cc:2804] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:49.380738 13639 tablet_bootstrap.cc:492] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:49.380828 14597 raft_consensus.cc:493] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:49.381119 13639 ts_tablet_manager.cc:1403] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.028s user 0.013s sys 0.000s
I20260810 13:53:49.381150 14597 raft_consensus.cc:3060] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.385434 13164 leader_election.cc:304] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.388650 14614 raft_consensus.cc:2804] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:49.389086 14614 raft_consensus.cc:493] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:49.389496 14614 raft_consensus.cc:3060] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.390010 13639 raft_consensus.cc:359] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.389561 13640 tablet_bootstrap.cc:654] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.390623 13639 raft_consensus.cc:385] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.390864 13639 raft_consensus.cc:740] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.391502 13639 consensus_queue.cc:260] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.393816 14272 ts_tablet_manager.cc:1929] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:49.394193 14272 log.cc:1199] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/cea93840561c4cb3b90d46e4aa70f542
I20260810 13:53:49.386323 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba87c833e5459884173b65fb5645b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:49.394970 14272 ts_tablet_manager.cc:1950] T cea93840561c4cb3b90d46e4aa70f542 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:49.399607 13639 ts_tablet_manager.cc:1434] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260810 13:53:49.399463 14597 raft_consensus.cc:515] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.400619 13259 raft_consensus.cc:2393] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:49.402316 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]) successfully deleted
I20260810 13:53:49.404402 13639 tablet_bootstrap.cc:492] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:49.413568 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba87c833e5459884173b65fb5645b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:49.414217 13041 raft_consensus.cc:2468] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
W20260810 13:53:49.422559 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 43558us
I20260810 13:53:49.429262 13639 tablet_bootstrap.cc:654] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.429241 13638 raft_consensus.cc:359] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.429924 13638 raft_consensus.cc:385] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.430183 13638 raft_consensus.cc:740] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.431430 13638 consensus_queue.cc:260] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.436867 14614 raft_consensus.cc:515] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.438148 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 277) took 1296 ms. Trace:
I20260810 13:53:49.440294 14389 rpcz_store.cc:276] 0810 13:53:48.141377 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.141594 (+ 217us) service_pool.cc:224] Handling call
0810 13:53:49.240931 (+1099337us) ts_tablet_manager.cc:1151] Deleting tablet d2f8801796064c39ba1c81c64d622d68
0810 13:53:49.240973 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.283358 (+ 42385us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:49.323837 (+ 40479us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:49.438084 (+114247us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1083534}
I20260810 13:53:49.441777 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]) successfully deleted
I20260810 13:53:49.443027 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 278) took 1284 ms. Trace:
I20260810 13:53:49.444134 14389 rpcz_store.cc:276] 0810 13:53:48.158277 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.158405 (+ 128us) service_pool.cc:224] Handling call
0810 13:53:49.442654 (+1284249us) ts_tablet_manager.cc:1151] Deleting tablet 17df06cad1404d96bda5822be6a6e995
0810 13:53:49.442713 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.442976 (+ 263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1283652}
W20260810 13:53:49.446122 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 17df06cad1404d96bda5822be6a6e995 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17df06cad1404d96bda5822be6a6e995 already in progress: creating tablet
I20260810 13:53:49.420832 14759 tablet.cc:1724] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:49.451871 13382 leader_election.cc:304] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:49.452927 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 272) took 1445 ms. Trace:
I20260810 13:53:49.455591 13640 tablet_bootstrap.cc:492] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:49.456033 13640 ts_tablet_manager.cc:1403] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.188s user 0.009s sys 0.000s
I20260810 13:53:49.455921 14614 leader_election.cc:290] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:49.459357 14389 rpcz_store.cc:276] 0810 13:53:48.007179 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.019570 (+ 12391us) service_pool.cc:224] Handling call
0810 13:53:49.452562 (+1432992us) ts_tablet_manager.cc:1151] Deleting tablet 918edf5d7b4f45009c5d476588399d0c
0810 13:53:49.452602 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.452876 (+ 274us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1253762}
I20260810 13:53:49.461136 14730 raft_consensus.cc:2804] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:49.461519 14730 raft_consensus.cc:493] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:49.461892 14730 raft_consensus.cc:3060] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.462028 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:49.462666 13470 raft_consensus.cc:2468] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:53:49.463967 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 918edf5d7b4f45009c5d476588399d0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 918edf5d7b4f45009c5d476588399d0c already in progress: creating tablet
I20260810 13:53:49.464344 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 280) took 1151 ms. Trace:
I20260810 13:53:49.464630 14389 rpcz_store.cc:276] 0810 13:53:48.313174 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.313323 (+ 149us) service_pool.cc:224] Handling call
0810 13:53:49.464015 (+1150692us) ts_tablet_manager.cc:1151] Deleting tablet f4946f79b54c46b1a59edf169109ab47
0810 13:53:49.464057 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.464289 (+ 232us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1149627}
W20260810 13:53:49.465759 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet f4946f79b54c46b1a59edf169109ab47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4946f79b54c46b1a59edf169109ab47 already in progress: creating tablet
I20260810 13:53:49.470418 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 229) took 5419 ms. Trace:
I20260810 13:53:49.476907 13638 ts_tablet_manager.cc:1434] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.097s user 0.008s sys 0.004s
I20260810 13:53:49.479977 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 8c80bc85fe25433ab2559ea0ada61978
I20260810 13:53:49.480921 14597 leader_election.cc:290] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:49.482230 13638 tablet_bootstrap.cc:492] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:49.486737 14389 tablet_replica.cc:333] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
W20260810 13:53:49.487406 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet db50d31d0d6c45faa1eb138357d532b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db50d31d0d6c45faa1eb138357d532b3 already in progress: creating tablet
I20260810 13:53:49.487471 14389 raft_consensus.cc:2243] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:49.487906 14389 raft_consensus.cc:2272] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:49.488070 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet e9840da46a92439f8c96bc3714650f17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9840da46a92439f8c96bc3714650f17 already in progress: creating tablet
I20260810 13:53:49.487938 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba87c833e5459884173b65fb5645b6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:49.488561 13049 raft_consensus.cc:3060] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.490361 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c80bc85fe25433ab2559ea0ada61978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.497172 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:49.498921 13049 raft_consensus.cc:2468] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:49.500319 13167 leader_election.cc:304] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:53:49.501032 13167 raft_consensus.cc:2686] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:49.503618 14389 ts_tablet_manager.cc:1916] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.505239 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:49.505821 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c80bc85fe25433ab2559ea0ada61978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:49.506844 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:49.428135 14710 raft_consensus.cc:515] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:49.509276 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 8c80bc85fe25433ab2559ea0ada61978 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8c80bc85fe25433ab2559ea0ada61978 already in progress: creating tablet
I20260810 13:53:49.509608 14273 rpcz_store.cc:276] 0810 13:53:44.050622 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:44.055954 (+ 5332us) service_pool.cc:224] Handling call
0810 13:53:48.827985 (+4772031us) ts_tablet_manager.cc:1151] Deleting tablet a58df75cb91544ef863a09f4d6004da0
0810 13:53:48.828044 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.117060 (+289016us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:49.199249 (+ 82189us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:49.470350 (+271101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21039,"tablet-delete.queue_time_us":4671961}
I20260810 13:53:49.518561 13639 tablet_bootstrap.cc:492] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:49.518996 13639 ts_tablet_manager.cc:1403] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.115s user 0.008s sys 0.007s
I20260810 13:53:49.519507 13041 raft_consensus.cc:2393] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:53:49.523135 14710 leader_election.cc:290] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:49.470258 14730 raft_consensus.cc:515] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.524366 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:49.525239 13257 raft_consensus.cc:2393] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:49.525473 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:49.525738 14730 leader_election.cc:290] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:49.528657 12749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3cf5094c58ae404aa2c68fa007294f77" } modify_external_catalogs: true
I20260810 13:53:49.529202 12749 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3cf5094c58ae404aa2c68fa007294f77" } modify_external_catalogs: true
I20260810 13:53:49.531708 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6cfbfc47b2484396fcb517d791aae2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:49.532617 14272 tablet_replica.cc:333] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:49.533707 14272 raft_consensus.cc:2243] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:49.533586 13639 raft_consensus.cc:359] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.534210 14272 raft_consensus.cc:2272] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:49.534276 13639 raft_consensus.cc:385] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:53:49.534212 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 62356.2us
I20260810 13:53:49.534580 13639 raft_consensus.cc:740] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.535465 13639 consensus_queue.cc:260] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.536953 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:49.537556 13480 raft_consensus.cc:3060] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.538192 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dded9a7c2c4652b41131f0bc14a6b5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:49.538762 13470 raft_consensus.cc:2468] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:49.540627 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet 9566586ecdd24e94bad62906c2166afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:34 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:49.543206 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e96d10ab0bc341a3b9b5a18ef701ee95" } new_table_name: "default.Table_5d1526181af947a2ae46e8e9e2718688" modify_external_catalogs: true
I20260810 13:53:49.544525 14272 ts_tablet_manager.cc:1916] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.547331 13640 raft_consensus.cc:359] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.548347 14730 raft_consensus.cc:493] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:49.548841 14730 raft_consensus.cc:515] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.550763 14730 leader_election.cc:290] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:49.553565 13639 ts_tablet_manager.cc:1434] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
I20260810 13:53:49.564081 13639 tablet_bootstrap.cc:492] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:49.572907 13480 raft_consensus.cc:2468] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:49.577936 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ba701a453546088933416d17e71127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:49.578855 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 240) took 4346 ms. Trace:
I20260810 13:53:49.579241 14273 rpcz_store.cc:276] 0810 13:53:45.232148 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.260873 (+ 28725us) service_pool.cc:224] Handling call
0810 13:53:49.578356 (+4317483us) ts_tablet_manager.cc:1151] Deleting tablet 0c4e37b80b7645c2a14f3ab0c5e919d2
0810 13:53:49.578506 (+ 150us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.578804 (+ 298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4315848}
I20260810 13:53:49.579707 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c80bc85fe25433ab2559ea0ada61978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:49.572504 14389 ts_tablet_manager.cc:1929] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:49.583436 13164 leader_election.cc:304] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.583449 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba87c833e5459884173b65fb5645b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:49.583850 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet a58df75cb91544ef863a09f4d6004da0 (table default.Table_3afcf9952f64439db184876b30cf6bba [id=01496bab35984719a64ca2ee8e8324dd]) successfully deleted
I20260810 13:53:49.584621 13037 raft_consensus.cc:2393] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:49.585634 13164 leader_election.cc:304] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.586440 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ba701a453546088933416d17e71127" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:49.586781 14614 raft_consensus.cc:2804] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:49.585371 14389 log.cc:1199] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/92ba87c833e5459884173b65fb5645b6
I20260810 13:53:49.587301 14614 raft_consensus.cc:493] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:49.587868 14614 raft_consensus.cc:3060] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.588003 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ba701a453546088933416d17e71127" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:49.589157 13261 raft_consensus.cc:2468] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:49.589151 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba87c833e5459884173b65fb5645b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:49.593323 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ba87c833e5459884173b65fb5645b6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:49.592610 14389 ts_tablet_manager.cc:1950] T 92ba87c833e5459884173b65fb5645b6 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:49.597692 14763 raft_consensus.cc:2804] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:49.598481 14763 raft_consensus.cc:697] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:49.598788 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:49.600191 14763 consensus_queue.cc:237] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.601214 13480 raft_consensus.cc:2393] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:49.608731 13640 raft_consensus.cc:385] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.609090 13640 raft_consensus.cc:740] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.610314 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 92ba87c833e5459884173b65fb5645b6 (table default.Table_57aa5df7d41e490da1c7f3cbbf615728 [id=8b0d7ace0c6f4b9592148341b6da7c50]) successfully deleted
I20260810 13:53:49.609977 13640 consensus_queue.cc:260] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.612296 13640 ts_tablet_manager.cc:1434] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.156s user 0.006s sys 0.000s
I20260810 13:53:49.617024 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet 92ba87c833e5459884173b65fb5645b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:49.633119 14389 tablet_replica.cc:333] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:49.635020 14389 raft_consensus.cc:2243] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:49.635501 14389 raft_consensus.cc:2272] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:49.637204 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 already in progress: creating tablet
I20260810 13:53:49.639243 14614 raft_consensus.cc:515] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.641237 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6cfbfc47b2484396fcb517d791aae2" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:49.642469 13480 raft_consensus.cc:2393] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:49.649255 13640 tablet_bootstrap.cc:492] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:49.649807 13639 tablet_bootstrap.cc:654] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.660516 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dded9a7c2c4652b41131f0bc14a6b5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:49.653267 14389 ts_tablet_manager.cc:1916] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:49.673076 13382 leader_election.cc:343] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:49.676344 13382 leader_election.cc:304] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.677022 12951 leader_election.cc:304] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:49.677379 13382 leader_election.cc:343] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: Tablet not RUNNING: STOPPED
W20260810 13:53:49.677569 12951 raft_consensus.cc:2686] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:49.677704 13382 leader_election.cc:304] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.679121 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:49.580636 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 250) took 4342 ms. Trace:
I20260810 13:53:49.691900 14273 rpcz_store.cc:276] 0810 13:53:45.238675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.262810 (+ 24135us) service_pool.cc:224] Handling call
0810 13:53:49.580312 (+4317502us) ts_tablet_manager.cc:1151] Deleting tablet ce9243eda3974532aff0425885f54166
0810 13:53:49.580351 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.580589 (+ 238us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4316840}
I20260810 13:53:49.693326 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 252) took 4454 ms. Trace:
I20260810 13:53:49.693719 14273 rpcz_store.cc:276] 0810 13:53:45.239352 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.490458 (+251106us) service_pool.cc:224] Handling call
0810 13:53:49.692954 (+4202496us) ts_tablet_manager.cc:1151] Deleting tablet ac9e3d3430044a5e85e2d812b7e221f5
0810 13:53:49.693000 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:49.693271 (+ 271us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4044290}
I20260810 13:53:49.696290 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_845b7e0e51384b20b1eac181c1e04ddf" } modify_external_catalogs: true
I20260810 13:53:49.696830 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_845b7e0e51384b20b1eac181c1e04ddf" } modify_external_catalogs: true
I20260810 13:53:49.703672 14272 ts_tablet_manager.cc:1929] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:49.704044 14272 log.cc:1199] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/2c6cfbfc47b2484396fcb517d791aae2
I20260810 13:53:49.700435 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:49.704649 14272 ts_tablet_manager.cc:1950] T 2c6cfbfc47b2484396fcb517d791aae2 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:49.705819 14272 tablet_replica.cc:333] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:49.706049 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 2c6cfbfc47b2484396fcb517d791aae2 (table default.Table_84a5a2b5e80343c194da3ea9661f2a81 [id=d9297758ec4f42bda21e7490d69498cf]) successfully deleted
I20260810 13:53:49.707662 13639 tablet_bootstrap.cc:492] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:49.708078 13639 ts_tablet_manager.cc:1403] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.144s user 0.011s sys 0.008s
W20260810 13:53:49.710204 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1122dcf7bcea4654bf29ff01fc4a350d consensus state has no leader
I20260810 13:53:49.710578 13639 raft_consensus.cc:359] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.711374 13639 raft_consensus.cc:385] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.711666 13639 raft_consensus.cc:740] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.715477 13639 consensus_queue.cc:260] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.720716 13638 tablet_bootstrap.cc:654] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.732065 14272 raft_consensus.cc:2243] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:49.732525 14272 raft_consensus.cc:2272] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:49.736476 14272 ts_tablet_manager.cc:1916] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.748471 13223 tablet_service.cc:1558] Processing DeleteTablet for tablet f7afa380245248f5bac203b0905721c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.748729 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ba701a453546088933416d17e71127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.748482 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 2327309017db4094907b3e405988f224 with delete_type TABLET_DATA_DELETED (replaced by tablet 75b8030450554de3b97266f348329ea6) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:49.748111 13167 leader_election.cc:343] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:49.715413 14597 raft_consensus.cc:493] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:49.754518 14597 raft_consensus.cc:515] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.736745 13639 ts_tablet_manager.cc:1434] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.009s user 0.007s sys 0.001s
W20260810 13:53:49.757223 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 81829.9us
W20260810 13:53:49.759018 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1122dcf7bcea4654bf29ff01fc4a350d consensus state has no leader
I20260810 13:53:49.762241 13639 tablet_bootstrap.cc:492] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:49.771696 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2064484b9e46478f9efb67e9f24d6dd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:49.768079 14772 raft_consensus.cc:493] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:49.772518 14772 raft_consensus.cc:515] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:49.773661 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2064484b9e46478f9efb67e9f24d6dd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:49.774344 14389 ts_tablet_manager.cc:1929] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:49.774673 14389 log.cc:1199] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/eaaa924290594d319b02526550416571
I20260810 13:53:49.775300 14389 ts_tablet_manager.cc:1950] T eaaa924290594d319b02526550416571 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:49.777554 14614 leader_election.cc:290] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:49.778541 14597 leader_election.cc:290] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:49.779256 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet eaaa924290594d319b02526550416571 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:49.779222 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04860a72c64a5db966e2784c6dbbf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:49.780092 14772 leader_election.cc:290] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
W20260810 13:53:49.782778 13167 leader_election.cc:343] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:49.789379 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acaaa179b4fa4ca592674e24a4e54706" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:49.808672 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet eaaa924290594d319b02526550416571 (table default.Table_2560857e4f9f4c45988374f05f107f9c [id=b4f568587c6841999ef3750b3cd4044a]) successfully deleted
I20260810 13:53:49.812309 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.816465 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet f19e7aa805bd417eae45fb43ac18a66d
I20260810 13:53:49.817368 13639 tablet_bootstrap.cc:654] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.817827 12743 catalog_manager.cc:6807] ReplaceTablet: tablet f19e7aa805bd417eae45fb43ac18a66d deleted and replaced by tablet cafed58a5994479e91678ddbe74cd353
I20260810 13:53:49.820581 14273 tablet_replica.cc:333] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:49.821440 14273 raft_consensus.cc:2243] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:49.821973 14273 raft_consensus.cc:2272] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:49.721024 14767 raft_consensus.cc:2804] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:49.721418 14703 raft_consensus.cc:2749] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:53:49.825441 14767 raft_consensus.cc:493] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:49.825976 14767 raft_consensus.cc:3060] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:49.721848 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 44492us
I20260810 13:53:49.828754 13049 raft_consensus.cc:2468] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:49.830768 13167 leader_election.cc:304] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:49.831038 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04860a72c64a5db966e2784c6dbbf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:49.831709 13382 consensus_peers.cc:597] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2f8801796064c39ba1c81c64d622d68. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:49.831832 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dded9a7c2c4652b41131f0bc14a6b5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:49.723057 13640 tablet_bootstrap.cc:654] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:49.832019 14763 raft_consensus.cc:2804] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:49.832322 13470 raft_consensus.cc:3060] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.832513 14763 raft_consensus.cc:493] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:49.833386 14763 raft_consensus.cc:3060] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.834965 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet f19e7aa805bd417eae45fb43ac18a66d with delete_type TABLET_DATA_DELETED (replaced by tablet cafed58a5994479e91678ddbe74cd353) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:49.835711 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acaaa179b4fa4ca592674e24a4e54706" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:49.836313 13480 raft_consensus.cc:2468] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:53:49.838344 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet ce9243eda3974532aff0425885f54166 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce9243eda3974532aff0425885f54166 already in progress: creating tablet
W20260810 13:53:49.839025 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet ac9e3d3430044a5e85e2d812b7e221f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ac9e3d3430044a5e85e2d812b7e221f5 already in progress: creating tablet
W20260810 13:53:49.840885 13164 leader_election.cc:343] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:49.841293 13164 leader_election.cc:304] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.841656 14763 raft_consensus.cc:515] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.842039 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet f19e7aa805bd417eae45fb43ac18a66d with delete_type TABLET_DATA_DELETED (replaced by tablet cafed58a5994479e91678ddbe74cd353) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:49.842377 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet f19e7aa805bd417eae45fb43ac18a66d with delete_type TABLET_DATA_DELETED (replaced by tablet cafed58a5994479e91678ddbe74cd353) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:49.841286 13470 raft_consensus.cc:2468] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:49.842954 14772 raft_consensus.cc:2749] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:49.844904 14763 leader_election.cc:290] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:53:49.845983 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acaaa179b4fa4ca592674e24a4e54706" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:49.846607 13042 raft_consensus.cc:3060] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.852077 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acaaa179b4fa4ca592674e24a4e54706" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:49.853106 13470 raft_consensus.cc:3060] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.852994 13164 leader_election.cc:304] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.853652 14763 raft_consensus.cc:2804] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:49.854096 14763 raft_consensus.cc:697] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:49.854874 14763 consensus_queue.cc:237] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.856815 14389 tablet_replica.cc:333] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:49.857600 14389 raft_consensus.cc:2243] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:49.858345 14389 pending_rounds.cc:70] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:49.858645 14389 pending_rounds.cc:77] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971641422086144 op_type: NO_OP noop_request { }
I20260810 13:53:49.859031 14389 raft_consensus.cc:2889] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:49.859333 14389 raft_consensus.cc:2272] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:49.859310 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_071663fc830e44ef9d25a38fc8301ba7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:49.861174 13639 tablet_bootstrap.cc:492] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:49.861627 13639 ts_tablet_manager.cc:1403] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.100s user 0.007s sys 0.007s
W20260810 13:53:49.861821 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_071663fc830e44ef9d25a38fc8301ba7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:49.862221 14273 ts_tablet_manager.cc:1916] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.866079 13042 raft_consensus.cc:2468] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:49.848420 14767 raft_consensus.cc:515] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.874737 14389 ts_tablet_manager.cc:1916] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:49.880708 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ba701a453546088933416d17e71127" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:49.885248 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35ba701a453546088933416d17e71127" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:49.885946 13257 raft_consensus.cc:3060] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.886991 14767 leader_election.cc:290] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:49.894996 13167 leader_election.cc:304] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:49.897547 14772 raft_consensus.cc:2804] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:49.898187 14772 raft_consensus.cc:697] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:49.900955 14772 consensus_queue.cc:237] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.903362 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
W20260810 13:53:49.904982 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 106448us
I20260810 13:53:49.907150 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet acaaa179b4fa4ca592674e24a4e54706 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:31 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:49.920217 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ae5a7110be7d4f6d81477dec588d4b64" } new_table_name: "default.Table_ea78a26b840d41b0bb76bbc37881b9c7" modify_external_catalogs: true
I20260810 13:53:49.935606 14597 raft_consensus.cc:493] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:49.936121 14597 raft_consensus.cc:515] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.938329 14597 leader_election.cc:290] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:49.938556 13638 tablet_bootstrap.cc:492] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:49.939108 13638 ts_tablet_manager.cc:1403] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.457s user 0.011s sys 0.000s
I20260810 13:53:49.940241 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7afa380245248f5bac203b0905721c6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:49.940927 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7afa380245248f5bac203b0905721c6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:49.942530 13167 leader_election.cc:343] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:49.943068 13164 leader_election.cc:343] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:49.943480 13164 leader_election.cc:304] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:49.944167 14597 raft_consensus.cc:2749] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:49.947438 14272 ts_tablet_manager.cc:1929] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:49.864464 13639 raft_consensus.cc:359] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.953452 13639 raft_consensus.cc:385] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.953812 13639 raft_consensus.cc:740] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:49.954859 13639 consensus_queue.cc:260] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.957098 13049 raft_consensus.cc:3060] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:49.961321 13639 ts_tablet_manager.cc:1434] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.099s user 0.007s sys 0.001s
I20260810 13:53:49.947933 14272 log.cc:1199] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/9566586ecdd24e94bad62906c2166afd
I20260810 13:53:49.984925 14272 ts_tablet_manager.cc:1950] T 9566586ecdd24e94bad62906c2166afd P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:49.988940 13257 raft_consensus.cc:2468] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:49.995702 13638 raft_consensus.cc:359] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.996444 13638 raft_consensus.cc:385] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:49.999017 13382 leader_election.cc:304] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:50.000696 14730 raft_consensus.cc:2804] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:50.004308 13639 tablet_bootstrap.cc:492] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:50.004222 14730 raft_consensus.cc:697] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:50.006563 14272 tablet_replica.cc:333] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:50.005995 14730 consensus_queue.cc:237] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.007413 14272 raft_consensus.cc:2243] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.009536 14272 raft_consensus.cc:2272] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.011183 14272 ts_tablet_manager.cc:1916] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.018419 13640 tablet_bootstrap.cc:492] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:50.018823 13640 ts_tablet_manager.cc:1403] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.370s user 0.006s sys 0.016s
I20260810 13:53:50.020596 13639 tablet_bootstrap.cc:654] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.022370 13640 raft_consensus.cc:359] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.023037 13640 raft_consensus.cc:385] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.022886 13470 raft_consensus.cc:2468] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:50.023331 13640 raft_consensus.cc:740] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.024379 13640 consensus_queue.cc:260] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.025005 14763 raft_consensus.cc:493] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:50.025497 14763 raft_consensus.cc:515] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.026665 13640 ts_tablet_manager.cc:1434] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260810 13:53:50.027551 13640 tablet_bootstrap.cc:492] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:50.027735 14763 leader_election.cc:290] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:50.029975 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2327309017db4094907b3e405988f224" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:50.030781 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 9566586ecdd24e94bad62906c2166afd (table default.Table_e9ba4f3b33c04d40b8eec3b0ff44485f [id=cccb8bdc8e41456d8c9614c8ca334a29]) successfully deleted
W20260810 13:53:50.031386 13167 leader_election.cc:343] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:50.045274 14389 ts_tablet_manager.cc:1929] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:50.045672 14389 log.cc:1199] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/2c6cfbfc47b2484396fcb517d791aae2
I20260810 13:53:50.046433 14389 ts_tablet_manager.cc:1950] T 2c6cfbfc47b2484396fcb517d791aae2 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:50.049090 13639 tablet_bootstrap.cc:492] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:50.049506 13639 ts_tablet_manager.cc:1403] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.000s
I20260810 13:53:50.053740 13640 tablet_bootstrap.cc:654] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.053648 13639 raft_consensus.cc:359] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.054252 13639 raft_consensus.cc:385] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.054493 13639 raft_consensus.cc:740] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.055104 13639 consensus_queue.cc:260] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:49.996714 13638 raft_consensus.cc:740] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.058691 13638 consensus_queue.cc:260] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.070297 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 2c6cfbfc47b2484396fcb517d791aae2 (table default.Table_84a5a2b5e80343c194da3ea9661f2a81 [id=d9297758ec4f42bda21e7490d69498cf]) successfully deleted
I20260810 13:53:50.072913 14389 tablet_replica.cc:333] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:50.073688 14389 raft_consensus.cc:2243] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:50.074036 13049 raft_consensus.cc:2468] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:50.074359 14389 pending_rounds.cc:70] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:50.061012 13638 ts_tablet_manager.cc:1434] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.122s user 0.009s sys 0.000s
I20260810 13:53:50.075768 13638 tablet_bootstrap.cc:492] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:50.078373 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:50.081566 13640 tablet_bootstrap.cc:492] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:50.082006 13640 ts_tablet_manager.cc:1403] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.055s user 0.007s sys 0.003s
I20260810 13:53:50.084461 13639 ts_tablet_manager.cc:1434] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.033s user 0.004s sys 0.000s
I20260810 13:53:50.084481 13640 raft_consensus.cc:359] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.085250 13640 raft_consensus.cc:385] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.091831 13639 tablet_bootstrap.cc:492] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:50.074595 14389 pending_rounds.cc:77] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971642607071232 op_type: NO_OP noop_request { }
I20260810 13:53:50.092967 14389 raft_consensus.cc:2889] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:50.093261 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ba701a453546088933416d17e71127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:50.093364 14389 raft_consensus.cc:2272] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.095005 13640 raft_consensus.cc:740] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.096001 14389 ts_tablet_manager.cc:1916] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.095989 13640 consensus_queue.cc:260] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.098158 14272 ts_tablet_manager.cc:1929] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.098510 14272 log.cc:1199] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/92ba87c833e5459884173b65fb5645b6
I20260810 13:53:50.099161 14272 ts_tablet_manager.cc:1950] T 92ba87c833e5459884173b65fb5645b6 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:50.100400 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 92ba87c833e5459884173b65fb5645b6 (table default.Table_57aa5df7d41e490da1c7f3cbbf615728 [id=8b0d7ace0c6f4b9592148341b6da7c50]) successfully deleted
I20260810 13:53:50.105094 14272 tablet_replica.cc:333] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:50.105937 14272 raft_consensus.cc:2243] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.106376 14272 raft_consensus.cc:2272] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.109928 13640 ts_tablet_manager.cc:1434] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.028s user 0.006s sys 0.001s
I20260810 13:53:50.113029 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet 2327309017db4094907b3e405988f224 with delete_type TABLET_DATA_DELETED (replaced by tablet 75b8030450554de3b97266f348329ea6) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:50.113888 13640 tablet_bootstrap.cc:492] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:50.114967 13639 tablet_bootstrap.cc:654] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.117760 14272 ts_tablet_manager.cc:1916] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.132335 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2327309017db4094907b3e405988f224" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:50.132230 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_22e32aea1f65480bb9ff9718ea6f6abb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:50.133178 13470 raft_consensus.cc:2468] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:53:50.133796 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22e32aea1f65480bb9ff9718ea6f6abb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:50.136029 13164 leader_election.cc:304] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:50.136827 14763 raft_consensus.cc:2804] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:50.137154 14763 raft_consensus.cc:493] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:50.137470 14763 raft_consensus.cc:3060] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:50.143296 13640 tablet_bootstrap.cc:654] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.152669 14763 raft_consensus.cc:515] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.155035 14763 leader_election.cc:290] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:50.155395 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2327309017db4094907b3e405988f224" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:50.155934 13049 raft_consensus.cc:3060] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:50.157143 13639 tablet_bootstrap.cc:492] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:50.157553 13639 ts_tablet_manager.cc:1403] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.066s user 0.011s sys 0.000s
I20260810 13:53:50.161116 13638 tablet_bootstrap.cc:654] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.164925 13639 raft_consensus.cc:359] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.166827 13639 raft_consensus.cc:385] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.167078 13639 raft_consensus.cc:740] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.168092 13639 consensus_queue.cc:260] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.180047 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2327309017db4094907b3e405988f224" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:50.180641 13470 raft_consensus.cc:3060] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:50.187790 13639 ts_tablet_manager.cc:1434] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
I20260810 13:53:50.201267 13049 raft_consensus.cc:2468] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:50.200063 13639 tablet_bootstrap.cc:492] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:50.206514 12745 master_service.cc:960] ReplaceTablet: received request to replace tablet 4dea61b84b614ead8830873568f9b7c4 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:50.209169 13640 tablet_bootstrap.cc:492] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:50.209715 13640 ts_tablet_manager.cc:1403] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.096s user 0.007s sys 0.004s
I20260810 13:53:50.208072 13638 tablet_bootstrap.cc:492] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:50.210229 13638 ts_tablet_manager.cc:1403] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.135s user 0.009s sys 0.001s
I20260810 13:53:50.214569 13640 raft_consensus.cc:359] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.215198 13640 raft_consensus.cc:385] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.215087 13167 leader_election.cc:304] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:50.215462 13640 raft_consensus.cc:740] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.216080 13470 raft_consensus.cc:2468] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:50.216105 14763 raft_consensus.cc:2804] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:50.224099 14389 ts_tablet_manager.cc:1929] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:50.230115 14389 log.cc:1199] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/acaaa179b4fa4ca592674e24a4e54706
I20260810 13:53:50.236254 14389 ts_tablet_manager.cc:1950] T acaaa179b4fa4ca592674e24a4e54706 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:50.216629 14763 raft_consensus.cc:697] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:50.225082 13638 raft_consensus.cc:359] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.238073 13638 raft_consensus.cc:385] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.238425 13638 raft_consensus.cc:740] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.238565 14763 consensus_queue.cc:237] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.239240 13638 consensus_queue.cc:260] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.241509 13638 ts_tablet_manager.cc:1434] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.031s user 0.005s sys 0.001s
I20260810 13:53:50.242561 13638 tablet_bootstrap.cc:492] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:50.227814 13640 consensus_queue.cc:260] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.258260 13640 ts_tablet_manager.cc:1434] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.048s user 0.010s sys 0.000s
I20260810 13:53:50.263527 13640 tablet_bootstrap.cc:492] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:50.271277 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_85b411d6527d4231a4934a690459d06d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:50.281271 14272 ts_tablet_manager.cc:1929] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.283068 14272 log.cc:1199] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/eaaa924290594d319b02526550416571
I20260810 13:53:50.284996 14272 ts_tablet_manager.cc:1950] T eaaa924290594d319b02526550416571 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:50.288285 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet d9ada39233e9421d9870565c73f2ee16
I20260810 13:53:50.291649 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet f7afa380245248f5bac203b0905721c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:50.260426 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 288) took 1109 ms. Trace:
I20260810 13:53:50.294759 13020 tablet_service.cc:1558] Processing DeleteTablet for tablet d9ada39233e9421d9870565c73f2ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:50.294368 14389 rpcz_store.cc:276] 0810 13:53:49.150696 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.151017 (+ 321us) service_pool.cc:224] Handling call
0810 13:53:50.072757 (+921740us) ts_tablet_manager.cc:1151] Deleting tablet acaaa179b4fa4ca592674e24a4e54706
0810 13:53:50.072800 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.153698 (+ 80898us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.223960 (+ 70262us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.259579 (+ 35619us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":905026}
I20260810 13:53:50.295758 14389 tablet_replica.cc:333] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:50.299562 13640 tablet_bootstrap.cc:654] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.296125 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet acaaa179b4fa4ca592674e24a4e54706 (table default.Table_bb7f1a0edf05477c9bef48a64c4b391a [id=44416790a2a54b08ae687611fc087cdd]) successfully deleted
I20260810 13:53:50.324831 12746 master_service.cc:960] ReplaceTablet: received request to replace tablet 3db559714d84493ebaf7d3b51719d81c from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:50.326931 14802 tablet.cc:1724] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:50.331259 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet d9ada39233e9421d9870565c73f2ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:50.331435 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet d9ada39233e9421d9870565c73f2ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:50.296634 14389 raft_consensus.cc:2243] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
W20260810 13:53:50.332607 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85b411d6527d4231a4934a690459d06d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:50.333396 14389 pending_rounds.cc:70] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:50.333624 14389 pending_rounds.cc:77] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971642294046720 op_type: NO_OP noop_request { }
I20260810 13:53:50.333962 14389 raft_consensus.cc:2889] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:50.334301 14389 raft_consensus.cc:2272] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.336535 14389 ts_tablet_manager.cc:1916] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.338033 14273 ts_tablet_manager.cc:1929] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.349396 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_91b7a336c30a4dcfafc6aa52bf1b1929" } new_table_name: "default.Table_8b694afed3584daaa326e8817c01b2da" modify_external_catalogs: true
I20260810 13:53:50.355321 13638 tablet_bootstrap.cc:654] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.322372 14803 tablet.cc:1724] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:50.365509 14272 tablet_replica.cc:333] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:50.366662 14272 raft_consensus.cc:2243] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.374131 14272 raft_consensus.cc:2272] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.382254 14272 ts_tablet_manager.cc:1916] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.398586 13638 tablet_bootstrap.cc:492] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:50.399026 13638 ts_tablet_manager.cc:1403] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.157s user 0.005s sys 0.005s
I20260810 13:53:50.420014 14818 tablet.cc:1724] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:50.435663 14273 log.cc:1199] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/e4afea2da7c54e508084be42dec35099
I20260810 13:53:50.422242 14815 tablet.cc:1724] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:50.437914 14273 ts_tablet_manager.cc:1950] T e4afea2da7c54e508084be42dec35099 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:50.440800 13638 raft_consensus.cc:359] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.441504 13638 raft_consensus.cc:385] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.441771 13638 raft_consensus.cc:740] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.449239 14710 raft_consensus.cc:493] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:50.449505 13638 consensus_queue.cc:260] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.449811 14710 raft_consensus.cc:515] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.452090 13638 ts_tablet_manager.cc:1434] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.053s user 0.006s sys 0.000s
I20260810 13:53:50.453845 14710 leader_election.cc:290] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:50.455788 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7afa380245248f5bac203b0905721c6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:50.456636 13257 raft_consensus.cc:2468] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:50.458408 12952 leader_election.cc:304] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:50.459628 14710 raft_consensus.cc:2804] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:50.460207 14710 raft_consensus.cc:493] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:50.460618 14710 raft_consensus.cc:3060] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:50.473351 13639 tablet_bootstrap.cc:654] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.477648 13638 tablet_bootstrap.cc:492] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:50.482945 14389 ts_tablet_manager.cc:1929] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:50.483398 14389 log.cc:1199] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/b7dded9a7c2c4652b41131f0bc14a6b5
I20260810 13:53:50.500576 13640 tablet_bootstrap.cc:492] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:50.501122 13640 ts_tablet_manager.cc:1403] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.238s user 0.024s sys 0.027s
I20260810 13:53:50.502774 14821 tablet.cc:1724] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:50.504993 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7afa380245248f5bac203b0905721c6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:50.506182 12951 leader_election.cc:343] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:50.506860 13640 raft_consensus.cc:359] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.507493 13640 raft_consensus.cc:385] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.507730 13640 raft_consensus.cc:740] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.508347 13640 consensus_queue.cc:260] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.512445 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 254) took 5262 ms. Trace:
I20260810 13:53:50.512768 14273 rpcz_store.cc:276] 0810 13:53:45.250224 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.734610 (+484386us) service_pool.cc:224] Handling call
0810 13:53:49.820415 (+4085805us) ts_tablet_manager.cc:1151] Deleting tablet e4afea2da7c54e508084be42dec35099
0810 13:53:49.820461 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.163082 (+342621us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.337914 (+174832us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.512385 (+174471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118528,"tablet-delete.queue_time_us":4085284}
I20260810 13:53:50.514041 13640 ts_tablet_manager.cc:1434] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20260810 13:53:50.514008 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet e4afea2da7c54e508084be42dec35099 (table default.Table_2de7aaadcc9042a1a7142a894e0c8493 [id=777bd2c67c1b46859627304bbcb53524]) successfully deleted
I20260810 13:53:50.514977 13640 tablet_bootstrap.cc:492] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:50.518471 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9f48e93a010b4fc5b43124a1f8248ddf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:50.528653 13638 tablet_bootstrap.cc:654] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.484242 14389 ts_tablet_manager.cc:1950] T b7dded9a7c2c4652b41131f0bc14a6b5 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:50.531134 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 289) took 1360 ms. Trace:
I20260810 13:53:50.533684 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_61ea331d19cb4393a84ea7b467d1d733" } modify_external_catalogs: true
I20260810 13:53:50.534332 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_61ea331d19cb4393a84ea7b467d1d733" } modify_external_catalogs: true
I20260810 13:53:50.541865 13640 tablet_bootstrap.cc:654] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.531458 14389 rpcz_store.cc:276] 0810 13:53:49.171144 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.171276 (+ 132us) service_pool.cc:224] Handling call
0810 13:53:50.295561 (+1124285us) ts_tablet_manager.cc:1151] Deleting tablet b7dded9a7c2c4652b41131f0bc14a6b5
0810 13:53:50.295618 (+ 57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.410890 (+115272us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.482793 (+ 71903us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.531074 (+ 48281us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1123683}
I20260810 13:53:50.540081 14821 tablet.cc:1724] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:50.549614 14389 tablet_replica.cc:333] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
W20260810 13:53:50.549628 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f48e93a010b4fc5b43124a1f8248ddf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:50.550364 14389 raft_consensus.cc:2243] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.550889 14389 raft_consensus.cc:2272] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.552816 14389 ts_tablet_manager.cc:1916] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.554492 14703 raft_consensus.cc:493] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:50.554952 14703 raft_consensus.cc:515] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.557551 14703 leader_election.cc:290] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:50.559190 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04860a72c64a5db966e2784c6dbbf0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:50.560034 13257 raft_consensus.cc:2468] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:50.564046 13382 leader_election.cc:304] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:50.564904 14703 raft_consensus.cc:2804] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:50.363935 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet eaaa924290594d319b02526550416571 (table default.Table_2560857e4f9f4c45988374f05f107f9c [id=b4f568587c6841999ef3750b3cd4044a]) successfully deleted
I20260810 13:53:50.565349 14703 raft_consensus.cc:493] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 13:53:50.565636 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 201708us
I20260810 13:53:50.565944 14703 raft_consensus.cc:3060] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:50.565814 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04860a72c64a5db966e2784c6dbbf0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:50.567338 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet b7dded9a7c2c4652b41131f0bc14a6b5 (table default.Table_f607f9e067574d68809ebee30bc17d75 [id=4e674333f87c408fa06b5852511ad168]) successfully deleted
W20260810 13:53:50.568624 13382 leader_election.cc:343] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:50.569965 14272 ts_tablet_manager.cc:1929] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.570325 14272 log.cc:1199] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/acaaa179b4fa4ca592674e24a4e54706
I20260810 13:53:50.570920 14272 ts_tablet_manager.cc:1950] T acaaa179b4fa4ca592674e24a4e54706 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:50.568095 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet f19e7aa805bd417eae45fb43ac18a66d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f19e7aa805bd417eae45fb43ac18a66d already in progress: creating tablet
I20260810 13:53:50.583849 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet acaaa179b4fa4ca592674e24a4e54706 (table default.Table_bb7f1a0edf05477c9bef48a64c4b391a [id=44416790a2a54b08ae687611fc087cdd]) successfully deleted
I20260810 13:53:50.587189 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c7eb242f15844cdebd526a6dee37d0ba" } new_table_name: "default.Table_d4b862f23534424d922dc35969230ef6" modify_external_catalogs: true
I20260810 13:53:50.590373 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ee819fc496fe4a48bf43d70ba6a6cbde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:50.591948 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee819fc496fe4a48bf43d70ba6a6cbde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:50.597996 14272 tablet_replica.cc:333] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:50.607287 14272 raft_consensus.cc:2243] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 13:53:50.609176 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 674599456f9a49dc98d8d089c166ca89 consensus state has no leader
I20260810 13:53:50.607824 14272 raft_consensus.cc:2272] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.612501 14272 ts_tablet_manager.cc:1916] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.608676 14703 raft_consensus.cc:515] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.619051 14703 leader_election.cc:290] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:50.619861 13638 tablet_bootstrap.cc:492] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:50.620344 13638 ts_tablet_manager.cc:1403] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.143s user 0.006s sys 0.012s
I20260810 13:53:50.621373 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04860a72c64a5db966e2784c6dbbf0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:50.620416 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04860a72c64a5db966e2784c6dbbf0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:50.625480 13257 raft_consensus.cc:3060] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:50.623049 14767 raft_consensus.cc:493] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:50.635999 14767 raft_consensus.cc:515] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.638999 14767 leader_election.cc:290] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:50.623777 13382 leader_election.cc:343] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:50.635398 13640 tablet_bootstrap.cc:492] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:50.641090 13640 ts_tablet_manager.cc:1403] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.126s user 0.010s sys 0.007s
I20260810 13:53:50.643196 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:50.643986 13259 raft_consensus.cc:2468] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:50.645020 13638 raft_consensus.cc:359] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.645635 13638 raft_consensus.cc:385] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.646021 13638 raft_consensus.cc:740] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.645804 13382 leader_election.cc:304] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:50.646965 14767 raft_consensus.cc:2804] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:50.647563 14767 raft_consensus.cc:493] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:50.648099 14767 raft_consensus.cc:3060] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:50.644403 13640 raft_consensus.cc:359] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.649514 13640 raft_consensus.cc:385] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.649845 13640 raft_consensus.cc:740] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.653622 13640 consensus_queue.cc:260] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.654870 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:50.654868 13638 consensus_queue.cc:260] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:50.656911 13382 leader_election.cc:343] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:50.658675 14763 raft_consensus.cc:493] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:50.659164 14763 raft_consensus.cc:515] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.661245 14763 leader_election.cc:290] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:50.666183 13257 raft_consensus.cc:2468] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:50.673326 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 256) took 5421 ms. Trace:
I20260810 13:53:50.671523 14272 ts_tablet_manager.cc:1929] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.673990 14272 log.cc:1199] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/35ba701a453546088933416d17e71127
I20260810 13:53:50.673741 14273 rpcz_store.cc:276] 0810 13:53:45.251739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:45.735167 (+483428us) service_pool.cc:224] Handling call
0810 13:53:50.672941 (+4937774us) ts_tablet_manager.cc:1151] Deleting tablet 8b82b59b066c4240a387e7de48de9c70
0810 13:53:50.672986 (+ 45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.673266 (+ 280us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4937253}
I20260810 13:53:50.674621 14272 ts_tablet_manager.cc:1950] T 35ba701a453546088933416d17e71127 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:50.675097 14273 tablet_replica.cc:333] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:50.675912 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 35ba701a453546088933416d17e71127 (table default.Table_e54429fe3e9c4a46849ec51775c7b98d [id=5fa0d1b7c3134c4c9e2f3a8ae8c5ff8a]) successfully deleted
W20260810 13:53:50.677080 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 8b82b59b066c4240a387e7de48de9c70 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8b82b59b066c4240a387e7de48de9c70 already in progress: creating tablet
I20260810 13:53:50.677179 13382 leader_election.cc:304] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:50.680764 14272 tablet_replica.cc:333] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:50.681095 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c80bc85fe25433ab2559ea0ada61978" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:50.681514 14272 raft_consensus.cc:2243] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.681931 14272 raft_consensus.cc:2272] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.682420 14703 raft_consensus.cc:2804] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:50.687076 14703 raft_consensus.cc:697] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:50.668637 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c80bc85fe25433ab2559ea0ada61978" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:50.687974 14703 consensus_queue.cc:237] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:50.689339 13167 leader_election.cc:343] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:50.683581 14272 ts_tablet_manager.cc:1916] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.693464 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_de6ec143f22d4a129657021013e42fb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:50.695116 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de6ec143f22d4a129657021013e42fb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:50.697045 13640 ts_tablet_manager.cc:1434] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.056s user 0.007s sys 0.001s
I20260810 13:53:50.701344 13640 tablet_bootstrap.cc:492] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:50.702947 13638 ts_tablet_manager.cc:1434] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.078s user 0.002s sys 0.005s
I20260810 13:53:50.704216 13638 tablet_bootstrap.cc:492] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:50.708420 14389 ts_tablet_manager.cc:1929] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:50.725796 14710 raft_consensus.cc:515] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:50.727080 13164 leader_election.cc:343] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:50.729499 13164 leader_election.cc:304] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:50.730849 14763 raft_consensus.cc:2749] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:50.731729 14389 log.cc:1199] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/cea93840561c4cb3b90d46e4aa70f542
I20260810 13:53:50.732607 14389 ts_tablet_manager.cc:1950] T cea93840561c4cb3b90d46e4aa70f542 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:50.735668 14273 raft_consensus.cc:2243] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.736127 14273 raft_consensus.cc:2272] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.742377 14703 raft_consensus.cc:493] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:50.743381 14703 raft_consensus.cc:515] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.745333 14703 leader_election.cc:290] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:50.754140 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 290) took 1429 ms. Trace:
I20260810 13:53:50.758590 13640 tablet_bootstrap.cc:654] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.758977 14389 rpcz_store.cc:276] 0810 13:53:49.324995 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.325144 (+ 149us) service_pool.cc:224] Handling call
0810 13:53:50.549446 (+1224302us) ts_tablet_manager.cc:1151] Deleting tablet cea93840561c4cb3b90d46e4aa70f542
0810 13:53:50.549496 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.622961 (+ 73465us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.708288 (+ 85327us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.754072 (+ 45784us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1190515}
I20260810 13:53:50.762728 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]) successfully deleted
I20260810 13:53:50.763775 14389 tablet_replica.cc:333] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:50.767122 14389 raft_consensus.cc:2243] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.772986 14389 raft_consensus.cc:2272] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.755791 13638 tablet_bootstrap.cc:654] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:50.778841 14389 ts_tablet_manager.cc:1916] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.781448 14767 raft_consensus.cc:515] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:50.798009 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f consensus state has no leader
I20260810 13:53:50.729097 14272 ts_tablet_manager.cc:1929] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.804204 14272 log.cc:1199] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/2327309017db4094907b3e405988f224
I20260810 13:53:50.805259 14272 ts_tablet_manager.cc:1950] T 2327309017db4094907b3e405988f224 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:50.730967 13639 tablet_bootstrap.cc:492] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:50.807032 14272 tablet_replica.cc:333] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:50.807197 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 2327309017db4094907b3e405988f224 (table default.Table_72d6991df9c54bd9a1427cb6b1e98570 [id=924550c187ce43b4940231335048eefa]) successfully deleted
I20260810 13:53:50.807926 13639 ts_tablet_manager.cc:1403] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.608s user 0.015s sys 0.001s
I20260810 13:53:50.808203 14272 raft_consensus.cc:2243] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.765863 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7afa380245248f5bac203b0905721c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:50.803259 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:50.808931 14272 raft_consensus.cc:2272] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.811575 14389 ts_tablet_manager.cc:1929] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.811944 14389 log.cc:1199] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/8c80bc85fe25433ab2559ea0ada61978
I20260810 13:53:50.812599 14389 ts_tablet_manager.cc:1950] T 8c80bc85fe25433ab2559ea0ada61978 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:50.814265 13639 raft_consensus.cc:359] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.815053 13639 raft_consensus.cc:385] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.815526 13639 raft_consensus.cc:740] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.826949 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 291) took 1338 ms. Trace:
I20260810 13:53:50.827386 14389 rpcz_store.cc:276] 0810 13:53:49.488833 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.490187 (+ 1354us) service_pool.cc:224] Handling call
0810 13:53:50.763625 (+1273438us) ts_tablet_manager.cc:1151] Deleting tablet 8c80bc85fe25433ab2559ea0ada61978
0810 13:53:50.763668 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.798240 (+ 34572us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.811450 (+ 13210us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.826882 (+ 15432us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1272842}
I20260810 13:53:50.828898 14389 tablet_replica.cc:333] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:50.829515 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_85f493dcd0f449778d7b96db1b7944df" } new_table_name: "default.Table_198786add2fc4ddda490f49366a8eeed" modify_external_catalogs: true
I20260810 13:53:50.830945 14389 raft_consensus.cc:2243] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.831456 14389 raft_consensus.cc:2272] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.827800 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_7515aaeccfe14052b6fd5de21c880a9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:50.833211 14389 ts_tablet_manager.cc:1916] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.828544 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 8c80bc85fe25433ab2559ea0ada61978 (table default.Table_723061893666401a9728e4a49b584f5f [id=8aaef23848b848bebe6d6d9069d961fd]) successfully deleted
W20260810 13:53:50.834172 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f4946f79b54c46b1a59edf169109ab47 (table default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f4946f79b54c46b1a59edf169109ab47 consensus state has no leader
I20260810 13:53:50.838478 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7afa380245248f5bac203b0905721c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:50.849836 14710 leader_election.cc:290] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:50.851065 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7afa380245248f5bac203b0905721c6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
W20260810 13:53:50.852463 12952 leader_election.cc:343] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: Tablet not RUNNING: STOPPED
I20260810 13:53:50.879604 14389 ts_tablet_manager.cc:1929] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.879994 14389 log.cc:1199] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/f7afa380245248f5bac203b0905721c6
I20260810 13:53:50.880360 14272 ts_tablet_manager.cc:1916] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.880635 14389 ts_tablet_manager.cc:1950] T f7afa380245248f5bac203b0905721c6 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:50.894867 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 294) took 1148 ms. Trace:
I20260810 13:53:50.895210 14389 rpcz_store.cc:276] 0810 13:53:49.746779 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.748321 (+ 1542us) service_pool.cc:224] Handling call
0810 13:53:50.828731 (+1080410us) ts_tablet_manager.cc:1151] Deleting tablet f7afa380245248f5bac203b0905721c6
0810 13:53:50.828773 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.861280 (+ 32507us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.879481 (+ 18201us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.894793 (+ 15312us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1079700}
I20260810 13:53:50.896878 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet f7afa380245248f5bac203b0905721c6 (table default.Table_cf87937d4ae348878fccadff2eca2c6b [id=7db25ca91e1a4ed1b9645002bee461ca]) successfully deleted
I20260810 13:53:50.903425 14389 tablet_replica.cc:333] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:50.904246 14389 raft_consensus.cc:2243] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:50.905057 14389 raft_consensus.cc:2272] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:50.909462 14389 ts_tablet_manager.cc:1916] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.913944 13638 tablet_bootstrap.cc:492] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:50.914397 13638 ts_tablet_manager.cc:1403] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.210s user 0.008s sys 0.012s
I20260810 13:53:50.916759 14273 ts_tablet_manager.cc:1916] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:50.891108 13639 consensus_queue.cc:260] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.920419 13639 ts_tablet_manager.cc:1434] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.112s user 0.002s sys 0.005s
I20260810 13:53:50.923869 14763 raft_consensus.cc:493] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:50.924322 14763 raft_consensus.cc:515] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.928400 14763 leader_election.cc:290] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:50.929198 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62023d553cd46cab920de44baa96eec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:50.932310 13167 leader_election.cc:343] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:50.936057 13640 tablet_bootstrap.cc:492] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:50.935954 14767 leader_election.cc:290] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:50.936523 13640 ts_tablet_manager.cc:1403] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.235s user 0.027s sys 0.019s
W20260810 13:53:50.940857 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7515aaeccfe14052b6fd5de21c880a9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:50.949339 13639 tablet_bootstrap.cc:492] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:50.951292 13638 raft_consensus.cc:359] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.959003 13640 raft_consensus.cc:359] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.963057 13640 raft_consensus.cc:385] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.963414 13640 raft_consensus.cc:740] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.964073 13640 consensus_queue.cc:260] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:50.966066 13640 ts_tablet_manager.cc:1434] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260810 13:53:50.966692 13638 raft_consensus.cc:385] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:50.970160 14272 ts_tablet_manager.cc:1929] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.970782 13638 raft_consensus.cc:740] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:50.975977 13640 tablet_bootstrap.cc:492] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:53:50.979223 13382 leader_election.cc:343] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: Tablet not RUNNING: STOPPED
W20260810 13:53:50.980054 13382 leader_election.cc:343] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:50.980793 13382 leader_election.cc:343] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:50.981382 13382 leader_election.cc:304] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:50.951537 14273 ts_tablet_manager.cc:1929] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:50.982939 14273 log.cc:1199] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/9566586ecdd24e94bad62906c2166afd
I20260810 13:53:50.983579 14273 ts_tablet_manager.cc:1950] T 9566586ecdd24e94bad62906c2166afd P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:50.983526 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7afa380245248f5bac203b0905721c6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:50.984524 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:50.994052 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 258) took 4798 ms. Trace:
I20260810 13:53:50.993994 13257 raft_consensus.cc:3060] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:50.994344 14273 rpcz_store.cc:276] 0810 13:53:46.196081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.212757 (+ 16676us) service_pool.cc:224] Handling call
0810 13:53:50.674955 (+4462198us) ts_tablet_manager.cc:1151] Deleting tablet 9566586ecdd24e94bad62906c2166afd
0810 13:53:50.674994 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.938182 (+263188us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.951372 (+ 13190us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:50.993993 (+ 42621us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4461572}
I20260810 13:53:50.995663 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 257) took 4800 ms. Trace:
I20260810 13:53:50.996043 14273 rpcz_store.cc:276] 0810 13:53:46.195667 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.298831 (+103164us) service_pool.cc:224] Handling call
0810 13:53:50.995225 (+4696394us) ts_tablet_manager.cc:1151] Deleting tablet cb8aea1057f445a9b060d138952324ca
0810 13:53:50.995265 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.995588 (+ 323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4666385}
I20260810 13:53:50.999284 13640 tablet_bootstrap.cc:654] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:51.000739 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 265) took 4332 ms. Trace:
I20260810 13:53:51.001075 14273 rpcz_store.cc:276] 0810 13:53:46.668556 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.668680 (+ 124us) service_pool.cc:224] Handling call
0810 13:53:50.997027 (+4328347us) ts_tablet_manager.cc:1151] Deleting tablet ab4cd2e5c73e467eb1bc4623e5d5e831
0810 13:53:51.000316 (+ 3289us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.000634 (+ 318us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4327633}
I20260810 13:53:51.008854 14273 tablet_replica.cc:333] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.009706 14273 raft_consensus.cc:2243] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.010252 14273 raft_consensus.cc:2272] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.011981 14273 ts_tablet_manager.cc:1916] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.013720 14844 raft_consensus.cc:2749] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:51.014034 13257 raft_consensus.cc:2468] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:51.014586 13470 raft_consensus.cc:3060] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:51.034092 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8054f93e82de4c898987acb86f25e5d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:51.034853 12796 debug-util.cc:398] Leaking SignalData structure 0x7b08000deb80 after lost signal to thread 12681
W20260810 13:53:51.035662 12796 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0380 after lost signal to thread 12801
I20260810 13:53:51.052970 14272 log.cc:1199] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/f7afa380245248f5bac203b0905721c6
I20260810 13:53:51.053480 13470 raft_consensus.cc:2468] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:51.053911 14272 ts_tablet_manager.cc:1950] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:51.055490 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet f7afa380245248f5bac203b0905721c6 (table default.Table_cf87937d4ae348878fccadff2eca2c6b [id=7db25ca91e1a4ed1b9645002bee461ca]) successfully deleted
I20260810 13:53:51.056438 14272 tablet_replica.cc:333] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:51.054811 14273 ts_tablet_manager.cc:1929] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:51.060981 14273 log.cc:1199] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/2327309017db4094907b3e405988f224
I20260810 13:53:51.008174 13638 consensus_queue.cc:260] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.061877 14273 ts_tablet_manager.cc:1950] T 2327309017db4094907b3e405988f224 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:51.064637 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 260) took 4422 ms. Trace:
I20260810 13:53:51.065946 14273 rpcz_store.cc:276] 0810 13:53:46.642395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.642554 (+ 159us) service_pool.cc:224] Handling call
0810 13:53:51.001934 (+4359380us) ts_tablet_manager.cc:1151] Deleting tablet 2327309017db4094907b3e405988f224
0810 13:53:51.008738 (+ 6804us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.026028 (+ 17290us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.054662 (+ 28634us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.064572 (+ 9910us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4325003}
I20260810 13:53:51.074172 14389 ts_tablet_manager.cc:1929] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:51.074635 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 261) took 4429 ms. Trace:
I20260810 13:53:51.074945 14273 rpcz_store.cc:276] 0810 13:53:46.644252 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.644369 (+ 117us) service_pool.cc:224] Handling call
0810 13:53:51.066893 (+4422524us) ts_tablet_manager.cc:1151] Deleting tablet 2b67e5a2b5334147b9d25f2ddc73de31
0810 13:53:51.073723 (+ 6830us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.074008 (+ 285us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4388595}
I20260810 13:53:51.076138 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 263) took 4428 ms. Trace:
I20260810 13:53:51.076516 14273 rpcz_store.cc:276] 0810 13:53:46.647656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.658482 (+ 10826us) service_pool.cc:224] Handling call
0810 13:53:51.075819 (+4417337us) ts_tablet_manager.cc:1151] Deleting tablet 69a3a4d2724b42da83a523e208b5714b
0810 13:53:51.075861 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.076086 (+ 225us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4390850}
I20260810 13:53:51.077507 14273 tablet_replica.cc:333] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.078373 14273 raft_consensus.cc:2243] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.078848 14273 raft_consensus.cc:2272] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.085249 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 9566586ecdd24e94bad62906c2166afd (table default.Table_e9ba4f3b33c04d40b8eec3b0ff44485f [id=cccb8bdc8e41456d8c9614c8ca334a29]) successfully deleted
I20260810 13:53:51.086889 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62023d553cd46cab920de44baa96eec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:51.087512 13472 raft_consensus.cc:2468] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:51.089784 13638 ts_tablet_manager.cc:1434] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.175s user 0.006s sys 0.002s
I20260810 13:53:51.093324 13638 tablet_bootstrap.cc:492] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:51.080672 14273 ts_tablet_manager.cc:1916] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.074558 14389 log.cc:1199] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/35ba701a453546088933416d17e71127
I20260810 13:53:51.103645 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_45d852d5a1024cf4ad4560802702a072" } new_table_name: "default.Table_434a11c94e0d4745aaf9a178ac49b127" modify_external_catalogs: true
I20260810 13:53:51.103961 14389 ts_tablet_manager.cc:1950] T 35ba701a453546088933416d17e71127 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:51.109644 12744 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_ea78a26b840d41b0bb76bbc37881b9c7 [id=c93d3c57643543cda0f021e1171b3365] alter complete (version 1)
I20260810 13:53:51.117441 14710 raft_consensus.cc:493] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:51.117946 14710 raft_consensus.cc:515] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.121304 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 292) took 1406 ms. Trace:
I20260810 13:53:51.121438 14710 leader_election.cc:290] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:51.121627 14389 rpcz_store.cc:276] 0810 13:53:49.715131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.729403 (+ 14272us) service_pool.cc:224] Handling call
0810 13:53:50.903263 (+1173860us) ts_tablet_manager.cc:1151] Deleting tablet 35ba701a453546088933416d17e71127
0810 13:53:50.903304 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:50.947329 (+ 44025us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.074047 (+126718us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.121190 (+ 47143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1153929}
I20260810 13:53:51.123044 14273 ts_tablet_manager.cc:1929] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:51.123428 14273 log.cc:1199] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/c5f2e89d61854ee5bf6955b8244215eb
I20260810 13:53:51.124078 14273 ts_tablet_manager.cc:1950] T c5f2e89d61854ee5bf6955b8244215eb P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:51.125398 14389 tablet_replica.cc:333] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:51.126184 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 266) took 4398 ms. Trace:
I20260810 13:53:51.126515 14273 rpcz_store.cc:276] 0810 13:53:46.727328 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.727493 (+ 165us) service_pool.cc:224] Handling call
0810 13:53:51.077353 (+4349860us) ts_tablet_manager.cc:1151] Deleting tablet c5f2e89d61854ee5bf6955b8244215eb
0810 13:53:51.077391 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.116305 (+ 38914us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.122928 (+ 6623us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.126121 (+ 3193us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4348479}
I20260810 13:53:51.127640 14273 tablet_replica.cc:333] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.128422 14273 raft_consensus.cc:2243] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.128914 14273 raft_consensus.cc:2272] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.128726 14389 raft_consensus.cc:2243] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:51.130724 14273 ts_tablet_manager.cc:1916] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:51.151391 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d2d209f801b4aa0aff3137a51fc7556 consensus state has no leader
I20260810 13:53:51.155875 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_802dbe2ed82d4d25962ab8ba68d22fa9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:51.159860 14273 ts_tablet_manager.cc:1929] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:51.160331 14273 log.cc:1199] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/acaaa179b4fa4ca592674e24a4e54706
I20260810 13:53:51.161111 14273 ts_tablet_manager.cc:1950] T acaaa179b4fa4ca592674e24a4e54706 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:51.163745 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 270) took 4226 ms. Trace:
I20260810 13:53:51.164135 14273 rpcz_store.cc:276] 0810 13:53:46.937673 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:46.939813 (+ 2140us) service_pool.cc:224] Handling call
0810 13:53:51.127483 (+4187670us) ts_tablet_manager.cc:1151] Deleting tablet acaaa179b4fa4ca592674e24a4e54706
0810 13:53:51.127534 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.139750 (+ 12216us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.159709 (+ 19959us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.163651 (+ 3942us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4187166}
I20260810 13:53:51.166152 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 273) took 4168 ms. Trace:
I20260810 13:53:51.166481 14273 rpcz_store.cc:276] 0810 13:53:46.998180 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:47.000844 (+ 2664us) service_pool.cc:224] Handling call
0810 13:53:51.165740 (+4164896us) ts_tablet_manager.cc:1151] Deleting tablet b820c99b33264add8df5fd443981d0cc
0810 13:53:51.165786 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.166053 (+ 267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4163740}
I20260810 13:53:51.167893 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 272) took 4170 ms. Trace:
I20260810 13:53:51.168210 14273 rpcz_store.cc:276] 0810 13:53:46.997768 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:47.002301 (+ 4533us) service_pool.cc:224] Handling call
0810 13:53:51.167536 (+4165235us) ts_tablet_manager.cc:1151] Deleting tablet 7a745bc711004993830b40ca1c93c63b
0810 13:53:51.167575 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.167842 (+ 267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4164312}
I20260810 13:53:51.170884 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 280) took 3455 ms. Trace:
I20260810 13:53:51.171226 14273 rpcz_store.cc:276] 0810 13:53:47.715006 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:47.718030 (+ 3024us) service_pool.cc:224] Handling call
0810 13:53:51.170535 (+3452505us) ts_tablet_manager.cc:1151] Deleting tablet ba05f4940220459f951adf3491f60b93
0810 13:53:51.170590 (+ 55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.170826 (+ 236us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3451821}
I20260810 13:53:51.172431 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 281) took 3357 ms. Trace:
I20260810 13:53:51.172780 14273 rpcz_store.cc:276] 0810 13:53:47.815032 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:47.819757 (+ 4725us) service_pool.cc:224] Handling call
0810 13:53:51.172111 (+3352354us) ts_tablet_manager.cc:1151] Deleting tablet 8fa729726a7f4603b0f5085a56cf89f6
0810 13:53:51.172152 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.172388 (+ 236us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3351622}
I20260810 13:53:51.173998 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 285) took 2480 ms. Trace:
I20260810 13:53:51.174321 14273 rpcz_store.cc:276] 0810 13:53:48.693978 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.695032 (+ 1054us) service_pool.cc:224] Handling call
0810 13:53:51.173655 (+2478623us) ts_tablet_manager.cc:1151] Deleting tablet 918edf5d7b4f45009c5d476588399d0c
0810 13:53:51.173690 (+ 35us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.173951 (+ 261us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2477563}
I20260810 13:53:51.175357 14273 tablet_replica.cc:333] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.176213 14273 raft_consensus.cc:2243] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:51.177353 14273 raft_consensus.cc:2272] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.179939 14273 ts_tablet_manager.cc:1916] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.057292 14272 raft_consensus.cc:2243] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.189298 14272 raft_consensus.cc:2272] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.192277 14272 ts_tablet_manager.cc:1916] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:51.193141 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet cb8aea1057f445a9b060d138952324ca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb8aea1057f445a9b060d138952324ca already in progress: creating tablet
W20260810 13:53:51.194257 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ab4cd2e5c73e467eb1bc4623e5d5e831 already in progress: creating tablet
I20260810 13:53:51.195233 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 2327309017db4094907b3e405988f224 (table default.Table_72d6991df9c54bd9a1427cb6b1e98570 [id=924550c187ce43b4940231335048eefa]) successfully deleted
W20260810 13:53:51.196117 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 2b67e5a2b5334147b9d25f2ddc73de31 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b67e5a2b5334147b9d25f2ddc73de31 already in progress: creating tablet
W20260810 13:53:51.197278 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 69a3a4d2724b42da83a523e208b5714b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69a3a4d2724b42da83a523e208b5714b already in progress: creating tablet
I20260810 13:53:51.198530 14273 ts_tablet_manager.cc:1929] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:51.199236 14273 log.cc:1199] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/d2f8801796064c39ba1c81c64d622d68
I20260810 13:53:51.201663 14273 ts_tablet_manager.cc:1950] T d2f8801796064c39ba1c81c64d622d68 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:51.202976 13382 leader_election.cc:304] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:51.122864 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 35ba701a453546088933416d17e71127 (table default.Table_e54429fe3e9c4a46849ec51775c7b98d [id=5fa0d1b7c3134c4c9e2f3a8ae8c5ff8a]) successfully deleted
W20260810 13:53:51.204056 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 81213.7us
W20260810 13:53:51.204967 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:51.211948 13640 tablet_bootstrap.cc:492] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:51.212420 13640 ts_tablet_manager.cc:1403] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.237s user 0.020s sys 0.034s
I20260810 13:53:51.251829 14389 pending_rounds.cc:70] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:51.251899 14842 raft_consensus.cc:2804] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:51.252107 14389 pending_rounds.cc:77] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971643952091136 op_type: NO_OP noop_request { }
I20260810 13:53:51.252372 14842 raft_consensus.cc:697] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:51.252463 14389 raft_consensus.cc:2889] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:51.252799 14389 raft_consensus.cc:2272] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.253197 14842 consensus_queue.cc:237] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.254515 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 290) took 2554 ms. Trace:
I20260810 13:53:51.254820 14273 rpcz_store.cc:276] 0810 13:53:48.700248 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.700422 (+ 174us) service_pool.cc:224] Handling call
0810 13:53:51.175191 (+2474769us) ts_tablet_manager.cc:1151] Deleting tablet d2f8801796064c39ba1c81c64d622d68
0810 13:53:51.175228 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.188646 (+ 13418us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.198355 (+ 9709us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.254455 (+ 56100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42336,"tablet-delete.queue_time_us":2473790}
I20260810 13:53:51.256139 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 293) took 2554 ms. Trace:
I20260810 13:53:51.256439 14273 rpcz_store.cc:276] 0810 13:53:48.701331 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.703742 (+ 2411us) service_pool.cc:224] Handling call
0810 13:53:51.255762 (+2552020us) ts_tablet_manager.cc:1151] Deleting tablet f4946f79b54c46b1a59edf169109ab47
0810 13:53:51.255805 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.256088 (+ 283us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2551530}
I20260810 13:53:51.257568 14273 tablet_replica.cc:333] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.258373 14273 raft_consensus.cc:2243] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.259164 14273 raft_consensus.cc:2272] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.261029 14273 ts_tablet_manager.cc:1916] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.261577 14389 ts_tablet_manager.cc:1916] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.264659 14763 raft_consensus.cc:493] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:51.265125 14763 raft_consensus.cc:515] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.267053 14763 leader_election.cc:290] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:51.289635 13638 tablet_bootstrap.cc:654] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:51.291011 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 88109.7us
I20260810 13:53:51.291594 14273 ts_tablet_manager.cc:1929] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:51.291985 14273 log.cc:1199] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/2c6cfbfc47b2484396fcb517d791aae2
I20260810 13:53:51.292707 14273 ts_tablet_manager.cc:1950] T 2c6cfbfc47b2484396fcb517d791aae2 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:53:51.300837 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8054f93e82de4c898987acb86f25e5d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:51.219199 13639 tablet_bootstrap.cc:654] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:51.265725 12952 leader_election.cc:343] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: b7dded9a7c2c4652b41131f0bc14a6b5
I20260810 13:53:51.268790 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83ddc3ea3e74b569385b289fe8cf469" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:51.310684 13167 leader_election.cc:343] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:51.318117 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 289) took 2618 ms. Trace:
I20260810 13:53:51.318434 14273 rpcz_store.cc:276] 0810 13:53:48.699909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.707098 (+ 7189us) service_pool.cc:224] Handling call
0810 13:53:51.257392 (+2550294us) ts_tablet_manager.cc:1151] Deleting tablet 2c6cfbfc47b2484396fcb517d791aae2
0810 13:53:51.257443 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.277785 (+ 20342us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.291460 (+ 13675us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.318053 (+ 26593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23262,"tablet-delete.queue_time_us":2549681}
I20260810 13:53:51.319695 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 291) took 2619 ms. Trace:
I20260810 13:53:51.319981 14273 rpcz_store.cc:276] 0810 13:53:48.700648 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:48.707842 (+ 7194us) service_pool.cc:224] Handling call
0810 13:53:51.319380 (+2611538us) ts_tablet_manager.cc:1151] Deleting tablet 17df06cad1404d96bda5822be6a6e995
0810 13:53:51.319423 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.319645 (+ 222us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2610801}
I20260810 13:53:51.320938 14273 tablet_replica.cc:333] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.321686 14273 raft_consensus.cc:2243] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.322113 14389 ts_tablet_manager.cc:1929] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:51.322521 14389 log.cc:1199] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/2327309017db4094907b3e405988f224
I20260810 13:53:51.323303 14389 ts_tablet_manager.cc:1950] T 2327309017db4094907b3e405988f224 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:51.325291 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 293) took 1596 ms. Trace:
I20260810 13:53:51.329224 14389 rpcz_store.cc:276] 0810 13:53:49.729124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.745693 (+ 16569us) service_pool.cc:224] Handling call
0810 13:53:51.124617 (+1378924us) ts_tablet_manager.cc:1151] Deleting tablet 2327309017db4094907b3e405988f224
0810 13:53:51.124861 (+ 244us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.293451 (+168590us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.321855 (+ 28404us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.325236 (+ 3381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119501,"tablet-delete.queue_time_us":1375027}
I20260810 13:53:51.330720 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 2327309017db4094907b3e405988f224 (table default.Table_72d6991df9c54bd9a1427cb6b1e98570 [id=924550c187ce43b4940231335048eefa]) successfully deleted
I20260810 13:53:51.331550 14389 tablet_replica.cc:333] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:51.332330 14389 raft_consensus.cc:2243] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 13:53:51.332502 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 98a59da23cfa4b5a9713b135d7fa4366 consensus state has no leader
I20260810 13:53:51.332969 14389 raft_consensus.cc:2272] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.339145 14273 raft_consensus.cc:2272] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.340826 14273 ts_tablet_manager.cc:1916] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.342075 14389 ts_tablet_manager.cc:1916] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.354394 13640 raft_consensus.cc:359] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.355106 13640 raft_consensus.cc:385] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:51.355376 13640 raft_consensus.cc:740] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:51.356058 13640 consensus_queue.cc:260] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.364472 13640 ts_tablet_manager.cc:1434] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.151s user 0.006s sys 0.000s
I20260810 13:53:51.365418 13640 tablet_bootstrap.cc:492] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:51.370584 14273 ts_tablet_manager.cc:1929] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:51.370976 14273 log.cc:1199] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/eaaa924290594d319b02526550416571
I20260810 13:53:51.371630 14273 ts_tablet_manager.cc:1950] T eaaa924290594d319b02526550416571 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:51.376829 14272 ts_tablet_manager.cc:1929] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:51.380249 14842 raft_consensus.cc:493] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:51.380889 14842 raft_consensus.cc:515] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.383876 14842 leader_election.cc:290] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:51.385385 14389 ts_tablet_manager.cc:1929] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:51.385936 14272 log.cc:1199] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/d9ada39233e9421d9870565c73f2ee16
I20260810 13:53:51.385913 14389 log.cc:1199] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/2d04860a72c64a5db966e2784c6dbbf0
I20260810 13:53:51.392019 14389 ts_tablet_manager.cc:1950] T 2d04860a72c64a5db966e2784c6dbbf0 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:51.393005 14272 ts_tablet_manager.cc:1950] T d9ada39233e9421d9870565c73f2ee16 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:51.394747 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 295) took 1583 ms. Trace:
I20260810 13:53:51.395224 14389 rpcz_store.cc:276] 0810 13:53:49.811755 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.812089 (+ 334us) service_pool.cc:224] Handling call
0810 13:53:51.331407 (+1519318us) ts_tablet_manager.cc:1151] Deleting tablet 2d04860a72c64a5db966e2784c6dbbf0
0810 13:53:51.331446 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.365462 (+ 34016us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.385264 (+ 19802us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.394657 (+ 9393us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1518607}
I20260810 13:53:51.395869 14272 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 292) took 1101 ms. Trace:
I20260810 13:53:51.396390 14272 rpcz_store.cc:276] 0810 13:53:50.294165 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:50.294482 (+ 317us) service_pool.cc:224] Handling call
0810 13:53:51.056278 (+761796us) ts_tablet_manager.cc:1151] Deleting tablet d9ada39233e9421d9870565c73f2ee16
0810 13:53:51.056322 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.327589 (+271267us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.376708 (+ 49119us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.395807 (+ 19099us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":761158}
I20260810 13:53:51.397087 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 2d04860a72c64a5db966e2784c6dbbf0 (table default.Table_81b4a7eba14c4cc4835272fbaf08f02a [id=0f2a8fd26a9043059d6b3d36c0ad03d1]) successfully deleted
I20260810 13:53:51.403363 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]) successfully deleted
I20260810 13:53:51.403811 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 296) took 1561 ms. Trace:
W20260810 13:53:51.405995 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 87653.3us
I20260810 13:53:51.406116 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 295) took 2113 ms. Trace:
I20260810 13:53:51.404289 14389 rpcz_store.cc:276] 0810 13:53:49.842060 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.842205 (+ 145us) service_pool.cc:224] Handling call
0810 13:53:51.403403 (+1561198us) ts_tablet_manager.cc:1151] Deleting tablet f19e7aa805bd417eae45fb43ac18a66d
0810 13:53:51.403446 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.403729 (+ 283us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1560608}
I20260810 13:53:51.406641 14273 rpcz_store.cc:276] 0810 13:53:49.293119 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.299303 (+ 6184us) service_pool.cc:224] Handling call
0810 13:53:51.320804 (+2021501us) ts_tablet_manager.cc:1151] Deleting tablet eaaa924290594d319b02526550416571
0810 13:53:51.320838 (+ 34us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.360539 (+ 39701us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.370472 (+ 9933us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.406055 (+ 35583us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16941,"tablet-delete.queue_time_us":2020964}
W20260810 13:53:51.407976 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet f19e7aa805bd417eae45fb43ac18a66d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f19e7aa805bd417eae45fb43ac18a66d already in progress: creating tablet
I20260810 13:53:51.408416 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 296) took 2102 ms. Trace:
I20260810 13:53:51.408823 14389 tablet_replica.cc:333] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:51.409601 14389 raft_consensus.cc:2243] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.408804 14273 rpcz_store.cc:276] 0810 13:53:49.305925 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.306377 (+ 452us) service_pool.cc:224] Handling call
0810 13:53:51.407961 (+2101584us) ts_tablet_manager.cc:1151] Deleting tablet e9840da46a92439f8c96bc3714650f17
0810 13:53:51.408008 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.408350 (+ 342us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2100966}
I20260810 13:53:51.410199 14389 raft_consensus.cc:2272] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.411083 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 297) took 2103 ms. Trace:
I20260810 13:53:51.415500 13164 leader_election.cc:304] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:51.415969 14273 rpcz_store.cc:276] 0810 13:53:49.307335 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.307819 (+ 484us) service_pool.cc:224] Handling call
0810 13:53:51.410766 (+2102947us) ts_tablet_manager.cc:1151] Deleting tablet db50d31d0d6c45faa1eb138357d532b3
0810 13:53:51.410806 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.411034 (+ 228us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2102088}
I20260810 13:53:51.416775 12951 leader_election.cc:304] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:53:51.417392 12951 raft_consensus.cc:2686] T f7afa380245248f5bac203b0905721c6 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:51.417709 14273 tablet_replica.cc:333] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.418469 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet c5f2e89d61854ee5bf6955b8244215eb (table default.Table_636572e9c1c24956bc53550f45390b1d [id=7ef508c9f0fc4ba99843e9a975526602]) successfully deleted
I20260810 13:53:51.420266 14763 raft_consensus.cc:2804] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:51.420732 14763 raft_consensus.cc:493] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:51.425299 14273 raft_consensus.cc:2243] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.421202 14763 raft_consensus.cc:3060] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:51.425753 14273 raft_consensus.cc:2272] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.425448 13639 tablet_bootstrap.cc:492] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:51.429446 13639 ts_tablet_manager.cc:1403] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.480s user 0.016s sys 0.000s
I20260810 13:53:51.431995 13639 raft_consensus.cc:359] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.445088 14389 ts_tablet_manager.cc:1916] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.451458 14273 ts_tablet_manager.cc:1916] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.457904 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet acaaa179b4fa4ca592674e24a4e54706 (table default.Table_bb7f1a0edf05477c9bef48a64c4b391a [id=44416790a2a54b08ae687611fc087cdd]) successfully deleted
W20260810 13:53:51.458995 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet b820c99b33264add8df5fd443981d0cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b820c99b33264add8df5fd443981d0cc already in progress: creating tablet
W20260810 13:53:51.459829 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 7a745bc711004993830b40ca1c93c63b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a745bc711004993830b40ca1c93c63b already in progress: creating tablet
W20260810 13:53:51.460618 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet ba05f4940220459f951adf3491f60b93 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba05f4940220459f951adf3491f60b93 already in progress: creating tablet
W20260810 13:53:51.461762 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 8fa729726a7f4603b0f5085a56cf89f6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8fa729726a7f4603b0f5085a56cf89f6 already in progress: creating tablet
I20260810 13:53:51.453481 14763 raft_consensus.cc:515] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.467959 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62023d553cd46cab920de44baa96eec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:51.468266 13640 tablet_bootstrap.cc:654] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:51.470443 13167 leader_election.cc:343] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:51.476946 14763 leader_election.cc:290] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:51.488891 14763 raft_consensus.cc:493] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:51.489306 14763 raft_consensus.cc:515] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.491166 14763 leader_election.cc:290] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:51.492723 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c43f7f8b7e4e56b5edbabe242c9dde" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:51.494081 13167 leader_election.cc:343] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:51.501704 14273 ts_tablet_manager.cc:1929] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:51.502100 14273 log.cc:1199] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/92ba87c833e5459884173b65fb5645b6
I20260810 13:53:51.502285 14389 ts_tablet_manager.cc:1929] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:51.506446 14273 ts_tablet_manager.cc:1950] T 92ba87c833e5459884173b65fb5645b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:51.507228 14389 log.cc:1199] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/d9ada39233e9421d9870565c73f2ee16
I20260810 13:53:51.508560 14389 ts_tablet_manager.cc:1950] T d9ada39233e9421d9870565c73f2ee16 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:51.512638 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 297) took 1181 ms. Trace:
I20260810 13:53:51.519304 14389 rpcz_store.cc:276] 0810 13:53:50.331113 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:50.331261 (+ 148us) service_pool.cc:224] Handling call
0810 13:53:51.408650 (+1077389us) ts_tablet_manager.cc:1151] Deleting tablet d9ada39233e9421d9870565c73f2ee16
0810 13:53:51.408707 (+ 57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.473104 (+ 64397us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.502096 (+ 28992us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.512548 (+ 10452us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1076790}
I20260810 13:53:51.508487 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 299) took 2195 ms. Trace:
I20260810 13:53:51.521713 14273 rpcz_store.cc:276] 0810 13:53:49.312571 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.312666 (+ 95us) service_pool.cc:224] Handling call
0810 13:53:51.417514 (+2104848us) ts_tablet_manager.cc:1151] Deleting tablet 92ba87c833e5459884173b65fb5645b6
0810 13:53:51.417553 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.459485 (+ 41932us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.501587 (+ 42102us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.508425 (+ 6838us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2104275}
I20260810 13:53:51.522881 14273 tablet_replica.cc:333] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.523675 14273 raft_consensus.cc:2243] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.523602 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]) successfully deleted
I20260810 13:53:51.524220 14273 raft_consensus.cc:2272] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:51.530277 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 918edf5d7b4f45009c5d476588399d0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 918edf5d7b4f45009c5d476588399d0c already in progress: creating tablet
I20260810 13:53:51.537628 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet d2f8801796064c39ba1c81c64d622d68 (table default.Table_b06142d593144274beace392faa4ec79 [id=beff34142f7b47628583cb5290552648]) successfully deleted
W20260810 13:53:51.538617 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet f4946f79b54c46b1a59edf169109ab47 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4946f79b54c46b1a59edf169109ab47 already in progress: creating tablet
I20260810 13:53:51.539677 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 2c6cfbfc47b2484396fcb517d791aae2 (table default.Table_84a5a2b5e80343c194da3ea9661f2a81 [id=d9297758ec4f42bda21e7490d69498cf]) successfully deleted
I20260810 13:53:51.541931 14273 ts_tablet_manager.cc:1916] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.545208 13638 tablet_bootstrap.cc:492] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:51.545688 13638 ts_tablet_manager.cc:1403] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.453s user 0.008s sys 0.005s
I20260810 13:53:51.560638 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ecd9d9a4dee74635934c5e080aaf28de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:51.562702 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecd9d9a4dee74635934c5e080aaf28de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:51.432585 13639 raft_consensus.cc:385] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:51.566609 13639 raft_consensus.cc:740] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:51.567431 13639 consensus_queue.cc:260] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.572986 13639 ts_tablet_manager.cc:1434] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.143s user 0.007s sys 0.000s
W20260810 13:53:51.574234 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 17df06cad1404d96bda5822be6a6e995 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 17df06cad1404d96bda5822be6a6e995 already in progress: creating tablet
W20260810 13:53:51.596521 12441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 84580.2us
I20260810 13:53:51.620247 14273 ts_tablet_manager.cc:1929] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:51.620601 14273 log.cc:1199] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/b7dded9a7c2c4652b41131f0bc14a6b5
I20260810 13:53:51.621285 14273 ts_tablet_manager.cc:1950] T b7dded9a7c2c4652b41131f0bc14a6b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:51.623127 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 300) took 2294 ms. Trace:
I20260810 13:53:51.623442 14273 rpcz_store.cc:276] 0810 13:53:49.329013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.329119 (+ 106us) service_pool.cc:224] Handling call
0810 13:53:51.522719 (+2193600us) ts_tablet_manager.cc:1151] Deleting tablet b7dded9a7c2c4652b41131f0bc14a6b5
0810 13:53:51.522760 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.568049 (+ 45289us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.620110 (+ 52061us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.623068 (+ 2958us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2176303}
I20260810 13:53:51.624461 14273 tablet_replica.cc:333] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.631946 13640 tablet_bootstrap.cc:492] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:51.632383 13640 ts_tablet_manager.cc:1403] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.267s user 0.019s sys 0.009s
I20260810 13:53:51.632879 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f62023d553cd46cab920de44baa96eec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:51.633430 13476 raft_consensus.cc:3060] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:51.634709 13640 raft_consensus.cc:359] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.635325 13640 raft_consensus.cc:385] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:51.635562 13640 raft_consensus.cc:740] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:51.637035 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c43f7f8b7e4e56b5edbabe242c9dde" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:51.637631 13257 raft_consensus.cc:2468] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:51.638661 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83ddc3ea3e74b569385b289fe8cf469" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:51.639199 13470 raft_consensus.cc:2468] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:51.639531 13476 raft_consensus.cc:2468] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:51.640147 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c43f7f8b7e4e56b5edbabe242c9dde" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:51.640726 13480 raft_consensus.cc:2468] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:51.636092 13640 consensus_queue.cc:260] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.648464 13640 ts_tablet_manager.cc:1434] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260810 13:53:51.649578 13640 tablet_bootstrap.cc:492] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:51.598691 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c43f7f8b7e4e56b5edbabe242c9dde" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:51.654994 13640 tablet_bootstrap.cc:654] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:51.661258 13639 tablet_bootstrap.cc:492] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:51.666625 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet eaaa924290594d319b02526550416571 (table default.Table_2560857e4f9f4c45988374f05f107f9c [id=b4f568587c6841999ef3750b3cd4044a]) successfully deleted
I20260810 13:53:51.592351 13638 raft_consensus.cc:359] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:51.668638 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet e9840da46a92439f8c96bc3714650f17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9840da46a92439f8c96bc3714650f17 already in progress: creating tablet
I20260810 13:53:51.669279 14273 raft_consensus.cc:2243] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.669994 14273 raft_consensus.cc:2272] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.685361 14273 ts_tablet_manager.cc:1916] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.686157 13638 raft_consensus.cc:385] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:53:51.687026 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet db50d31d0d6c45faa1eb138357d532b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db50d31d0d6c45faa1eb138357d532b3 already in progress: creating tablet
I20260810 13:53:51.687704 13638 raft_consensus.cc:740] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:51.688762 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 92ba87c833e5459884173b65fb5645b6 (table default.Table_57aa5df7d41e490da1c7f3cbbf615728 [id=8b0d7ace0c6f4b9592148341b6da7c50]) successfully deleted
I20260810 13:53:51.689816 13638 consensus_queue.cc:260] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.701076 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet b7dded9a7c2c4652b41131f0bc14a6b5 (table default.Table_f607f9e067574d68809ebee30bc17d75 [id=4e674333f87c408fa06b5852511ad168]) successfully deleted
W20260810 13:53:51.703101 12951 leader_election.cc:343] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: b7dded9a7c2c4652b41131f0bc14a6b5
I20260810 13:53:51.703491 12951 leader_election.cc:304] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:51.704531 14710 raft_consensus.cc:2749] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:51.702946 13164 leader_election.cc:304] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:51.705796 14763 raft_consensus.cc:2804] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:51.706117 14763 raft_consensus.cc:493] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:51.706190 13164 leader_election.cc:304] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:51.706489 14763 raft_consensus.cc:3060] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:51.707237 13164 leader_election.cc:304] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:51.708913 14856 raft_consensus.cc:2804] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:51.722873 13640 tablet_bootstrap.cc:492] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:51.724085 13640 ts_tablet_manager.cc:1403] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.075s user 0.004s sys 0.009s
I20260810 13:53:51.727941 13640 raft_consensus.cc:359] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.721038 14763 raft_consensus.cc:515] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.731598 13639 tablet_bootstrap.cc:654] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:51.740712 14871 raft_consensus.cc:2804] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:51.742518 14856 raft_consensus.cc:697] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:51.743549 14856 consensus_queue.cc:237] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.746518 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83ddc3ea3e74b569385b289fe8cf469" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:53:51.748414 13167 leader_election.cc:343] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:51.754341 13639 tablet_bootstrap.cc:492] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:51.754776 13639 ts_tablet_manager.cc:1403] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.094s user 0.009s sys 0.001s
I20260810 13:53:51.765926 13639 raft_consensus.cc:359] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.766395 13638 ts_tablet_manager.cc:1434] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.220s user 0.012s sys 0.007s
I20260810 13:53:51.766582 13639 raft_consensus.cc:385] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:51.766821 13639 raft_consensus.cc:740] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:51.772876 13639 consensus_queue.cc:260] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.778378 14871 raft_consensus.cc:493] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:51.778569 13639 ts_tablet_manager.cc:1434] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.024s user 0.006s sys 0.001s
I20260810 13:53:51.778970 13640 raft_consensus.cc:385] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:51.779419 13640 raft_consensus.cc:740] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:51.780241 13640 consensus_queue.cc:260] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:51.738761 13382 consensus_peers.cc:597] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35ba701a453546088933416d17e71127. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:51.783684 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ac680b589bb24167b9765450ff434f90" } new_table_name: "default.Table_313e0e31754047dea43eccf3a2e8b3c6" modify_external_catalogs: true
W20260810 13:53:51.784368 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 45759.3us
I20260810 13:53:51.785068 13382 leader_election.cc:304] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:51.785874 14842 raft_consensus.cc:2804] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:51.786280 14842 raft_consensus.cc:493] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:51.786607 14842 raft_consensus.cc:3060] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:51.793517 13639 tablet_bootstrap.cc:492] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:51.793998 14842 raft_consensus.cc:515] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.795892 14842 leader_election.cc:290] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:51.796527 14871 raft_consensus.cc:3060] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:51.801121 13639 tablet_bootstrap.cc:654] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:51.810065 13382 consensus_peers.cc:597] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35ba701a453546088933416d17e71127. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:53:51.812736 13382 consensus_peers.cc:597] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9ada39233e9421d9870565c73f2ee16. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:53:51.816473 13382 leader_election.cc:343] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:51.825426 13640 ts_tablet_manager.cc:1434] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.100s user 0.006s sys 0.000s
I20260810 13:53:51.830703 13640 tablet_bootstrap.cc:492] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:51.767445 14763 leader_election.cc:290] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:51.863364 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c43f7f8b7e4e56b5edbabe242c9dde" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:53:51.869978 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 918edf5d7b4f45009c5d476588399d0c (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 918edf5d7b4f45009c5d476588399d0c consensus state has no leader
I20260810 13:53:51.876677 13639 tablet_bootstrap.cc:492] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:51.877213 13639 ts_tablet_manager.cc:1403] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.084s user 0.017s sys 0.014s
W20260810 13:53:51.878412 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1c6686175347496093cb22ce8a3d4176 consensus state has no leader
I20260810 13:53:51.880874 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_78c6761fe1e748bf8bea32e7a13650f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:51.881146 13639 raft_consensus.cc:359] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.881749 13639 raft_consensus.cc:385] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:51.882041 13639 raft_consensus.cc:740] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:53:51.882866 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78c6761fe1e748bf8bea32e7a13650f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:51.882786 13639 consensus_queue.cc:260] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.893949 13639 ts_tablet_manager.cc:1434] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.016s user 0.003s sys 0.004s
I20260810 13:53:51.894889 13639 tablet_bootstrap.cc:492] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:51.896819 14842 raft_consensus.cc:493] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:51.897269 14842 raft_consensus.cc:515] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.899068 14842 leader_election.cc:290] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:51.900189 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83ddc3ea3e74b569385b289fe8cf469" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:51.900758 13480 raft_consensus.cc:3060] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:51.903182 13382 leader_election.cc:343] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:51.906000 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ff9e8a8ca845b89154ed0626d34c5c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:51.909701 13480 raft_consensus.cc:2468] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:51.915904 14273 ts_tablet_manager.cc:1929] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:51.916319 14273 log.cc:1199] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/cea93840561c4cb3b90d46e4aa70f542
I20260810 13:53:51.917119 14273 ts_tablet_manager.cc:1950] T cea93840561c4cb3b90d46e4aa70f542 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:51.919180 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 301) took 2589 ms. Trace:
I20260810 13:53:51.919569 14273 rpcz_store.cc:276] 0810 13:53:49.329843 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.375363 (+ 45520us) service_pool.cc:224] Handling call
0810 13:53:51.624320 (+2248957us) ts_tablet_manager.cc:1151] Deleting tablet cea93840561c4cb3b90d46e4aa70f542
0810 13:53:51.624364 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:51.771034 (+146670us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.915681 (+144647us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:51.919124 (+ 3443us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2248345}
I20260810 13:53:51.928529 12742 master_service.cc:960] ReplaceTablet: received request to replace tablet 5bab4d93f7dc4c88bbed9cb83961bb2e from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:51.913412 13639 tablet_bootstrap.cc:654] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:51.929757 13640 tablet_bootstrap.cc:654] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:51.939571 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet cea93840561c4cb3b90d46e4aa70f542 (table default.Table_948d3130a68a44d2aed5a39238172b01 [id=49ecdad0282345e3bf5124705a34e396]) successfully deleted
W20260810 13:53:51.940383 13382 leader_election.cc:343] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:51.942659 13049 raft_consensus.cc:3060] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:51.942869 13639 tablet_bootstrap.cc:492] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:51.943250 13639 ts_tablet_manager.cc:1403] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.002s
I20260810 13:53:51.945549 13639 raft_consensus.cc:359] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.946131 13639 raft_consensus.cc:385] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:51.946034 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:51.946372 13639 raft_consensus.cc:740] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:51.948515 13639 consensus_queue.cc:260] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:51.954844 13020 tablet_service.cc:1511] Processing CreateTablet for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (DEFAULT_TABLE table=default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:51.956041 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb1392a98aa4af199236e4b4b4ab3c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:51.957680 13639 ts_tablet_manager.cc:1434] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260810 13:53:51.966775 14273 tablet_replica.cc:333] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:51.967599 14273 raft_consensus.cc:2243] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:51.968454 14273 pending_rounds.cc:70] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: Trying to abort 1 pending ops.
I20260810 13:53:51.968709 14273 pending_rounds.cc:77] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971643085438976 op_type: NO_OP noop_request { }
I20260810 13:53:51.969043 14273 raft_consensus.cc:2889] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:51.969372 14273 raft_consensus.cc:2272] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:51.971665 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet f922c9ca51044dcda08b245010ab06b0
I20260810 13:53:51.974221 13639 tablet_bootstrap.cc:492] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:51.974740 12747 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 438) took 1441 ms. Trace:
I20260810 13:53:51.975912 13014 tablet_service.cc:1558] Processing DeleteTablet for tablet f922c9ca51044dcda08b245010ab06b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:50 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:51.978204 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet f922c9ca51044dcda08b245010ab06b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:50 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:51.981318 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:51.984337 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:51.986539 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:51.990657 14885 tablet.cc:1724] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:51.991911 12743 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:51.993482 14273 ts_tablet_manager.cc:1916] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:51.994640 14841 consensus_queue.cc:1048] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:51.999482 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
W20260810 13:53:51.986811 12745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 74) took 1719 ms (client timeout 1000 ms). Trace:
W20260810 13:53:52.000797 12745 rpcz_store.cc:269] 0810 13:53:50.268005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:50.275953 (+ 7948us) service_pool.cc:224] Handling call
0810 13:53:50.329921 (+ 53968us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:51.986739 (+1656818us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":548,"reported_tablets":1,"spinlock_wait_cycles":84862720}
I20260810 13:53:52.019032 13419 tablet_service.cc:1511] Processing CreateTablet for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (DEFAULT_TABLE table=default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.020570 13008 tablet_service.cc:1511] Processing CreateTablet for tablet c793dedc5e714fe6bd36e507695e82d0 (DEFAULT_TABLE table=default.Table_a6f746f49e7c466b8008dc01f2f390ca [id=94408f08eb8d48a385788825ce3a8309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.021617 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb1392a98aa4af199236e4b4b4ab3c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:51.990483 12750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 75) took 1796 ms (client timeout 1000 ms). Trace:
W20260810 13:53:52.022578 12750 rpcz_store.cc:269] 0810 13:53:50.194183 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:50.194319 (+ 136us) service_pool.cc:224] Handling call
0810 13:53:50.283945 (+ 89626us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:51.990410 (+1706465us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":175954688}
I20260810 13:53:52.023047 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c793dedc5e714fe6bd36e507695e82d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.025341 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264]). Expected version 1 got 0
I20260810 13:53:52.026316 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:52.030916 12744 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_5d1526181af947a2ae46e8e9e2718688 [id=9a3a9159f7634bc999c5c10834eb41d3] alter complete (version 3)
W20260810 13:53:52.031612 12744 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 74) took 1424 ms (client timeout 1000 ms). Trace:
W20260810 13:53:52.031940 12744 rpcz_store.cc:269] 0810 13:53:50.607182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:50.607994 (+ 812us) service_pool.cc:224] Handling call
0810 13:53:50.697288 (+ 89294us) spinlock_profiling.cc:243] Waited 87.8 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.031538 (+1334250us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:50.952925 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:50.953337 (+ 412us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:50.953362 (+ 25us) write_op.cc:435] Acquired schema lock
0810 13:53:50.953375 (+ 13us) tablet.cc:662] Decoding operations
0810 13:53:50.953642 (+ 267us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:50.953685 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:50.953710 (+ 25us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:50.953866 (+ 156us) tablet.cc:701] Row locks acquired
0810 13:53:50.953882 (+ 16us) write_op.cc:260] PREPARE: finished
0810 13:53:50.954006 (+ 124us) write_op.cc:270] Start()
0810 13:53:50.954091 (+ 85us) write_op.cc:276] Timestamp: P: 1786370030953937 usec, L: 0
0810 13:53:50.954108 (+ 17us) op_driver.cc:348] REPLICATION: starting
0810 13:53:51.031691 (+ 77583us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b5400010a98. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6f2fc964 00007fec6e512d19 00007fec6e4cea01 00007fec6e4ce6da 00007fec6e552d45 00007fec6e5531e9 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319
0810 13:53:51.031966 (+ 275us) log.cc:844] Serialized 356 byte log entry
0810 13:53:51.101874 (+ 69908us) op_driver.cc:464] REPLICATION: finished
0810 13:53:51.107846 (+ 5972us) write_op.cc:301] APPLY: starting
0810 13:53:51.107907 (+ 61us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:51.108012 (+ 105us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:51.108037 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:51.108213 (+ 176us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:51.108367 (+ 154us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:51.108429 (+ 62us) write_op.cc:312] APPLY: finished
0810 13:53:51.108610 (+ 181us) log.cc:844] Serialized 23 byte log entry
0810 13:53:51.109261 (+ 651us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:51.109325 (+ 64us) write_op.cc:454] Released schema lock
0810 13:53:51.109356 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:51.113148 (+ 3792us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:51.113172 (+ 24us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 13:53:51.322350 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:51.328720 (+ 6370us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:51.328745 (+ 25us) write_op.cc:435] Acquired schema lock
0810 13:53:51.328757 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:51.329000 (+ 243us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:51.329034 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:51.329056 (+ 22us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:51.329184 (+ 128us) tablet.cc:701] Row locks acquired
0810 13:53:51.329197 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:53:51.329304 (+ 107us) write_op.cc:270] Start()
0810 13:53:51.329391 (+ 87us) write_op.cc:276] Timestamp: P: 1786370031329236 usec, L: 0
0810 13:53:51.329406 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:51.337064 (+ 7658us) log.cc:844] Serialized 356 byte log entry
0810 13:53:51.375264 (+ 38200us) spinlock_profiling.cc:243] Waited 7.19 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e553208 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1 00007fec6e9e650d 00000000005bd8c4 00000000005bd6f9
0810 13:53:51.463307 (+ 88043us) op_driver.cc:464] REPLICATION: finished
0810 13:53:51.464252 (+ 945us) write_op.cc:301] APPLY: starting
0810 13:53:51.464318 (+ 66us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:51.464412 (+ 94us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:51.464440 (+ 28us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:51.464624 (+ 184us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:51.464786 (+ 162us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:51.464829 (+ 43us) write_op.cc:312] APPLY: finished
0810 13:53:51.465014 (+ 185us) log.cc:844] Serialized 23 byte log entry
0810 13:53:51.465164 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:51.465225 (+ 61us) write_op.cc:454] Released schema lock
0810 13:53:51.465257 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:51.465493 (+ 236us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:51.465523 (+ 30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":201855872,"child_traces":[["op",{"apply.queue_time_us":5806,"apply.run_cpu_time_us":1241,"apply.run_wall_time_us":5027,"mutex_wait_us":4212,"num_ops":1,"prepare.queue_time_us":242801,"prepare.run_cpu_time_us":4446,"prepare.run_wall_time_us":160225,"raft.queue_time_us":66,"raft.run_cpu_time_us":529,"raft.run_wall_time_us":529,"replication_time_us":147658,"spinlock_wait_cycles":110028672}],["op",{"apply.queue_time_us":781,"apply.run_cpu_time_us":1210,"apply.run_wall_time_us":1211,"num_ops":1,"prepare.queue_time_us":209664,"prepare.run_cpu_time_us":2523,"prepare.run_wall_time_us":53115,"raft.queue_time_us":9184,"raft.run_cpu_time_us":12,"raft.run_wall_time_us":13,"replication_time_us":133804,"spinlock_wait_cycles":16533888}]]}
I20260810 13:53:52.046406 14887 tablet.cc:1724] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:52.048190 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:52.048586 13014 tablet_service.cc:1558] Processing DeleteTablet for tablet b7dded9a7c2c4652b41131f0bc14a6b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:40 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:52.061633 14888 tablet_replica.cc:333] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:52.066927 14888 raft_consensus.cc:2243] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:51.975575 12747 rpcz_store.cc:276] 0810 13:53:50.533202 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:50.533311 (+ 109us) service_pool.cc:224] Handling call
0810 13:53:50.534796 (+ 1485us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:50.536889 (+ 2093us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:50.537258 (+ 369us) catalog_manager.cc:2850] Locking tablets
0810 13:53:51.939574 (+1402316us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:51.971256 (+ 31682us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:51.971465 (+ 209us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:51.971571 (+ 106us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:51.974666 (+ 3095us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:51.944896 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:51.945259 (+ 363us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:51.945280 (+ 21us) write_op.cc:435] Acquired schema lock
0810 13:53:51.945292 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:51.945595 (+ 303us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:51.945634 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:51.945657 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:51.945899 (+ 242us) tablet.cc:701] Row locks acquired
0810 13:53:51.945912 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:53:51.946013 (+ 101us) write_op.cc:270] Start()
0810 13:53:51.946091 (+ 78us) write_op.cc:276] Timestamp: P: 1786370031945946 usec, L: 0
0810 13:53:51.946106 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:51.946572 (+ 466us) log.cc:844] Serialized 756 byte log entry
0810 13:53:51.962457 (+ 15885us) op_driver.cc:464] REPLICATION: finished
0810 13:53:51.962831 (+ 374us) write_op.cc:301] APPLY: starting
0810 13:53:51.962892 (+ 61us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:51.963007 (+ 115us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:51.963109 (+ 102us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:51.963417 (+ 308us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:51.963577 (+ 160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:51.963632 (+ 55us) write_op.cc:312] APPLY: finished
0810 13:53:51.963819 (+ 187us) log.cc:844] Serialized 29 byte log entry
0810 13:53:51.963960 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:51.964033 (+ 73us) write_op.cc:454] Released schema lock
0810 13:53:51.964068 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:51.964309 (+ 241us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:51.964336 (+ 27us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":1435,"apply.run_wall_time_us":1436,"num_ops":2,"prepare.queue_time_us":3126,"prepare.run_cpu_time_us":1983,"prepare.run_wall_time_us":1984,"raft.queue_time_us":4146,"raft.run_cpu_time_us":753,"raft.run_wall_time_us":752,"replication_time_us":16239}]]}
I20260810 13:53:52.073928 14888 pending_rounds.cc:70] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:53:52.074203 14888 pending_rounds.cc:77] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971645719293952 op_type: NO_OP noop_request { }
I20260810 13:53:52.074587 14888 raft_consensus.cc:2889] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:52.074947 14888 raft_consensus.cc:2272] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:52.075743 13639 tablet_bootstrap.cc:654] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:52.076432 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet f922c9ca51044dcda08b245010ab06b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f922c9ca51044dcda08b245010ab06b0 already in progress: creating tablet
I20260810 13:53:52.080492 13164 leader_election.cc:304] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:52.082872 12743 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 75) took 799 ms (client timeout 1000 ms). Trace:
W20260810 13:53:52.083041 14889 consensus_queue.cc:1175] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "88ed04d733ec447583fc897e233dd4b3" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
W20260810 13:53:52.083226 12743 rpcz_store.cc:269] 0810 13:53:51.283631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:51.333187 (+ 49556us) service_pool.cc:224] Handling call
0810 13:53:52.082691 (+749504us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7}
I20260810 13:53:52.087431 13425 tablet_service.cc:1511] Processing CreateTablet for tablet c793dedc5e714fe6bd36e507695e82d0 (DEFAULT_TABLE table=default.Table_a6f746f49e7c466b8008dc01f2f390ca [id=94408f08eb8d48a385788825ce3a8309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.088661 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c793dedc5e714fe6bd36e507695e82d0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.092481 13382 consensus_peers.cc:597] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:52.095868 14888 ts_tablet_manager.cc:1916] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:52.111713 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 30d9e5103fe644f38d969c64182f7cbb (DEFAULT_TABLE table=default.Table_215968e7ab2540ab8a35960795941543 [id=9bac646089c94e54b68ff14ce2a50793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.112772 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d9e5103fe644f38d969c64182f7cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.116945 13223 tablet_service.cc:1511] Processing CreateTablet for tablet c793dedc5e714fe6bd36e507695e82d0 (DEFAULT_TABLE table=default.Table_a6f746f49e7c466b8008dc01f2f390ca [id=94408f08eb8d48a385788825ce3a8309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.117699 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet f922c9ca51044dcda08b245010ab06b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:50 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:52.119086 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c793dedc5e714fe6bd36e507695e82d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.119202 13229 tablet_service.cc:1558] Processing DeleteTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:52.119339 14844 raft_consensus.cc:493] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:52.119809 14844 raft_consensus.cc:515] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.121192 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet 2327309017db4094907b3e405988f224 with delete_type TABLET_DATA_DELETED (replaced by tablet 75b8030450554de3b97266f348329ea6) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:52.121918 14844 leader_election.cc:290] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:52.124184 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db9d7e82414cab8a69618effe89b40" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:52.124819 13042 raft_consensus.cc:2468] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:52.117743 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c43f7f8b7e4e56b5edbabe242c9dde" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:52.125604 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db9d7e82414cab8a69618effe89b40" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:52.126295 13227 tablet_service.cc:1511] Processing CreateTablet for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (DEFAULT_TABLE table=default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.126701 13382 leader_election.cc:304] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:52.127595 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebb1392a98aa4af199236e4b4b4ab3c5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.127569 13382 leader_election.cc:343] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:52.128583 14842 raft_consensus.cc:2804] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:52.128970 14842 raft_consensus.cc:493] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:52.129323 14842 raft_consensus.cc:3060] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:52.129765 13640 tablet_bootstrap.cc:492] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:52.130182 13640 ts_tablet_manager.cc:1403] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.300s user 0.014s sys 0.002s
I20260810 13:53:52.130175 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet f62023d553cd46cab920de44baa96eec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:52.131824 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 30d9e5103fe644f38d969c64182f7cbb (DEFAULT_TABLE table=default.Table_215968e7ab2540ab8a35960795941543 [id=9bac646089c94e54b68ff14ce2a50793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.133113 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d9e5103fe644f38d969c64182f7cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.135397 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ff9e8a8ca845b89154ed0626d34c5c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:52.136082 13265 raft_consensus.cc:2468] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:52.145936 13638 tablet_bootstrap.cc:492] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:52.154659 13638 tablet_bootstrap.cc:654] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:52.162392 13382 consensus_peers.cc:597] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d04860a72c64a5db966e2784c6dbbf0. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:53:52.163098 13382 consensus_peers.cc:597] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9ada39233e9421d9870565c73f2ee16. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:52.163908 13382 leader_election.cc:304] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:52.164626 14730 raft_consensus.cc:2804] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:52.164992 14730 raft_consensus.cc:493] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:52.165328 14730 raft_consensus.cc:3060] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:52.165071 14842 raft_consensus.cc:515] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.167913 14842 leader_election.cc:290] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:52.167835 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db9d7e82414cab8a69618effe89b40" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:52.168387 13042 raft_consensus.cc:3060] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:52.172305 14730 raft_consensus.cc:515] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.174366 14730 leader_election.cc:290] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:52.175030 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ff9e8a8ca845b89154ed0626d34c5c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:53:52.176565 13382 leader_election.cc:343] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:52.177702 13042 raft_consensus.cc:2468] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:52.178834 13382 leader_election.cc:304] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:52.180858 14842 raft_consensus.cc:2804] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:52.181310 14842 raft_consensus.cc:697] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:52.182073 14842 consensus_queue.cc:237] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.184155 13640 raft_consensus.cc:359] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.184763 13640 raft_consensus.cc:385] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:52.185078 13640 raft_consensus.cc:740] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:52.190476 13640 consensus_queue.cc:260] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.191999 13639 tablet_bootstrap.cc:492] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:52.192402 13639 ts_tablet_manager.cc:1403] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.227s user 0.010s sys 0.003s
I20260810 13:53:52.194667 13639 raft_consensus.cc:359] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.195243 13639 raft_consensus.cc:385] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:52.195488 13639 raft_consensus.cc:740] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:52.197649 13640 ts_tablet_manager.cc:1434] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.067s user 0.007s sys 0.000s
I20260810 13:53:52.200050 13421 tablet_service.cc:1558] Processing DeleteTablet for tablet f62023d553cd46cab920de44baa96eec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:52.203119 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 30d9e5103fe644f38d969c64182f7cbb (DEFAULT_TABLE table=default.Table_215968e7ab2540ab8a35960795941543 [id=9bac646089c94e54b68ff14ce2a50793]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.204202 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d9e5103fe644f38d969c64182f7cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.205050 13424 tablet_service.cc:1558] Processing DeleteTablet for tablet f7afa380245248f5bac203b0905721c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:52.209429 13008 tablet_service.cc:1511] Processing CreateTablet for tablet a43ea90fc236424489a4981c32087d81 (DEFAULT_TABLE table=default.Table_23f1932076424658b335360b8c388398 [id=4422409c30914eefa1029029111dbfd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.211406 13424 tablet_service.cc:1558] Processing DeleteTablet for tablet d2f8801796064c39ba1c81c64d622d68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:52.212054 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43ea90fc236424489a4981c32087d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.196189 13639 consensus_queue.cc:260] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.214002 13417 tablet_service.cc:1511] Processing CreateTablet for tablet a43ea90fc236424489a4981c32087d81 (DEFAULT_TABLE table=default.Table_23f1932076424658b335360b8c388398 [id=4422409c30914eefa1029029111dbfd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.215342 13639 ts_tablet_manager.cc:1434] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20260810 13:53:52.215432 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5cf3efa54b4344b04a87a87509d1f6 (DEFAULT_TABLE table=default.Table_e9bf94db05cb46279abaeba00681ab82 [id=a547ccb6c9c24877b0b8d81d52e1630a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.217069 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5cf3efa54b4344b04a87a87509d1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.219605 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 75b8030450554de3b97266f348329ea6 (DEFAULT_TABLE table=default.Table_72d6991df9c54bd9a1427cb6b1e98570 [id=924550c187ce43b4940231335048eefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.221546 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b8030450554de3b97266f348329ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.226724 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:52.227638 12740 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 76) took 1005 ms (client timeout 1000 ms). Trace:
W20260810 13:53:52.227965 12740 rpcz_store.cc:269] 0810 13:53:51.222710 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:51.222865 (+ 155us) service_pool.cc:224] Handling call
0810 13:53:51.245914 (+ 23049us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.227571 (+981657us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":38065408}
I20260810 13:53:52.234694 13424 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5cf3efa54b4344b04a87a87509d1f6 (DEFAULT_TABLE table=default.Table_e9bf94db05cb46279abaeba00681ab82 [id=a547ccb6c9c24877b0b8d81d52e1630a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.243857 13639 tablet_bootstrap.cc:492] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:52.252015 13639 tablet_bootstrap.cc:654] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:52.257131 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ff9e8a8ca845b89154ed0626d34c5c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:52.257663 14872 raft_consensus.cc:2804] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:52.257783 13268 raft_consensus.cc:3060] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:52.258205 14872 raft_consensus.cc:697] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:52.259141 14872 consensus_queue.cc:237] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.259871 14888 ts_tablet_manager.cc:1929] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:52.260236 14888 log.cc:1199] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/2d04860a72c64a5db966e2784c6dbbf0
I20260810 13:53:52.261065 14888 ts_tablet_manager.cc:1950] T 2d04860a72c64a5db966e2784c6dbbf0 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:52.262166 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4db9d7e82414cab8a69618effe89b40" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:52.262492 14389 tablet_replica.cc:333] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:52.264926 13210 tablet_service.cc:1511] Processing CreateTablet for tablet a43ea90fc236424489a4981c32087d81 (DEFAULT_TABLE table=default.Table_23f1932076424658b335360b8c388398 [id=4422409c30914eefa1029029111dbfd7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.266117 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43ea90fc236424489a4981c32087d81. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.270280 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet f922c9ca51044dcda08b245010ab06b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f922c9ca51044dcda08b245010ab06b0 already in progress: creating tablet
I20260810 13:53:52.271086 14888 tablet_replica.cc:333] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:52.271829 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 2d04860a72c64a5db966e2784c6dbbf0 (table default.Table_81b4a7eba14c4cc4835272fbaf08f02a [id=0f2a8fd26a9043059d6b3d36c0ad03d1]) successfully deleted
I20260810 13:53:52.271869 14888 raft_consensus.cc:2243] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:52.277642 14730 raft_consensus.cc:493] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:53:52.277765 13382 leader_election.cc:343] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:52.278123 14730 raft_consensus.cc:515] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.279698 13640 tablet_bootstrap.cc:492] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:52.272289 14888 raft_consensus.cc:2272] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:52.281042 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dea61b84b614ead8830873568f9b7c4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:52.282346 14888 ts_tablet_manager.cc:1916] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:52.287926 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5cf3efa54b4344b04a87a87509d1f6 (DEFAULT_TABLE table=default.Table_e9bf94db05cb46279abaeba00681ab82 [id=a547ccb6c9c24877b0b8d81d52e1630a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.290640 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5cf3efa54b4344b04a87a87509d1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.293490 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 75b8030450554de3b97266f348329ea6 (DEFAULT_TABLE table=default.Table_72d6991df9c54bd9a1427cb6b1e98570 [id=924550c187ce43b4940231335048eefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.295120 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b8030450554de3b97266f348329ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.295388 14871 raft_consensus.cc:515] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.296561 13257 raft_consensus.cc:2393] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:52.296896 14389 raft_consensus.cc:2243] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:52.299449 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dea61b84b614ead8830873568f9b7c4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:52.299710 14389 raft_consensus.cc:2272] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:52.309224 13640 tablet_bootstrap.cc:654] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:52.320371 13640 tablet_bootstrap.cc:492] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:52.320374 14888 ts_tablet_manager.cc:1929] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:52.320808 13640 ts_tablet_manager.cc:1403] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.041s user 0.012s sys 0.004s
I20260810 13:53:52.280763 14730 leader_election.cc:290] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:52.283735 13382 leader_election.cc:343] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:52.323503 13382 leader_election.cc:304] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:52.324522 13382 leader_election.cc:343] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:52.324941 13382 leader_election.cc:304] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:52.325548 14730 raft_consensus.cc:2749] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:53:52.326246 14730 raft_consensus.cc:2749] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:52.330834 13640 raft_consensus.cc:359] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.331457 13640 raft_consensus.cc:385] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:52.331699 13640 raft_consensus.cc:740] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:52.332397 13640 consensus_queue.cc:260] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.333001 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43ea90fc236424489a4981c32087d81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.334349 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5cf3efa54b4344b04a87a87509d1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.334825 13640 ts_tablet_manager.cc:1434] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20260810 13:53:52.335706 13640 tablet_bootstrap.cc:492] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:52.351729 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a2cd133674544036a9b6a207612749a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:52.352512 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5b59b711a1d0406b978d28c419f8e4a5" } new_table_name: "default.Table_96cdf642a68642ce9fe947569577b42a" modify_external_catalogs: true
W20260810 13:53:52.353271 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a2cd133674544036a9b6a207612749a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:52.356426 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b83389f8c6794e7bbfa97ae916d990cd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:52.357322 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8a8233c099eb45dba66c3d0f9bdbe18b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:52.357857 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b83389f8c6794e7bbfa97ae916d990cd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:52.358731 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a8233c099eb45dba66c3d0f9bdbe18b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:52.360116 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_eaf27dfbda4345929e86fdb05561b3e2" } new_table_name: "default.Table_51465ee8c49d4f90ab30de95dbda8bbc" modify_external_catalogs: true
I20260810 13:53:52.360535 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_131ccf6f50394a4facf6e622d5449b17"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:52.361896 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_131ccf6f50394a4facf6e622d5449b17 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:52.366578 12747 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:52.366685 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 288debea4aa045d1898483cde1d4d3b1 (DEFAULT_TABLE table=default.Table_a8f5484f0ff14287be783696e6d8525d [id=06f3859cd5e748a3800b66ecf0a93c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.375867 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288debea4aa045d1898483cde1d4d3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.376101 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 69ecda19e4f143c99654aff6058ad8bb
I20260810 13:53:52.377539 12749 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 426) took 2849 ms. Trace:
I20260810 13:53:52.380290 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet 69ecda19e4f143c99654aff6058ad8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:52.377827 12749 rpcz_store.cc:276] 0810 13:53:49.528223 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.528358 (+ 135us) service_pool.cc:224] Handling call
0810 13:53:49.529566 (+ 1208us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:49.531077 (+ 1511us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:49.531214 (+ 137us) catalog_manager.cc:2850] Locking tablets
0810 13:53:51.943200 (+2411986us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:52.375735 (+432535us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:52.375918 (+ 183us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:52.376015 (+ 97us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:52.377481 (+ 1466us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:51.947025 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:51.947582 (+ 557us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:51.947618 (+ 36us) write_op.cc:435] Acquired schema lock
0810 13:53:51.947638 (+ 20us) tablet.cc:662] Decoding operations
0810 13:53:51.948094 (+ 456us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:51.948146 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:51.948181 (+ 35us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:51.948429 (+ 248us) tablet.cc:701] Row locks acquired
0810 13:53:51.948443 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:51.948540 (+ 97us) write_op.cc:270] Start()
0810 13:53:51.948616 (+ 76us) write_op.cc:276] Timestamp: P: 1786370031948472 usec, L: 0
0810 13:53:51.948632 (+ 16us) op_driver.cc:348] REPLICATION: starting
0810 13:53:51.953308 (+ 4676us) log.cc:844] Serialized 756 byte log entry
0810 13:53:52.373095 (+419787us) op_driver.cc:464] REPLICATION: finished
0810 13:53:52.373490 (+ 395us) write_op.cc:301] APPLY: starting
0810 13:53:52.373547 (+ 57us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:52.373648 (+ 101us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:52.373734 (+ 86us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:52.373970 (+ 236us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:52.374109 (+ 139us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:52.374151 (+ 42us) write_op.cc:312] APPLY: finished
0810 13:53:52.374335 (+ 184us) log.cc:844] Serialized 29 byte log entry
0810 13:53:52.374499 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:52.374564 (+ 65us) write_op.cc:454] Released schema lock
0810 13:53:52.374595 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:52.374844 (+ 249us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:52.374877 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":250,"apply.run_cpu_time_us":1306,"apply.run_wall_time_us":1306,"num_ops":2,"prepare.queue_time_us":1850,"prepare.run_cpu_time_us":10136,"prepare.run_wall_time_us":66253,"raft.queue_time_us":6288,"raft.run_cpu_time_us":32,"raft.run_wall_time_us":33,"replication_time_us":424361,"thread_start_us":54055,"threads_started":1}]]}
I20260810 13:53:52.381459 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4ff1185d2848808cbd92760e595830 (DEFAULT_TABLE table=default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.384829 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4ff1185d2848808cbd92760e595830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.386680 13420 tablet_service.cc:1511] Processing CreateTablet for tablet fd22f04344954142922942fc4b7cb157 (DEFAULT_TABLE table=default.Table_5d92bfb4e8eb4ad58e5aac4da446b255 [id=08a605fcd00047e78a391b79e9fb8cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.387727 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd22f04344954142922942fc4b7cb157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.408710 13640 tablet_bootstrap.cc:654] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:52.417971 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 3db559714d84493ebaf7d3b51719d81c
I20260810 13:53:52.419486 12746 catalog_manager.cc:6807] ReplaceTablet: tablet 3db559714d84493ebaf7d3b51719d81c deleted and replaced by tablet bec54cb915a54949871181763ad956d5
I20260810 13:53:52.419898 12746 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:48758 (request call id 435) took 2095 ms. Trace:
I20260810 13:53:52.421659 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 3db559714d84493ebaf7d3b51719d81c with delete_type TABLET_DATA_DELETED (replaced by tablet bec54cb915a54949871181763ad956d5) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:52.437805 13448 tablet_service.cc:1511] Processing CreateTablet for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c (DEFAULT_TABLE table=default.Table_c8b2a7d2d3d346898424ac950b04204b [id=0d0b3c6ce19a47d4a86fbe06c02bc7b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.438850 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.420202 12746 rpcz_store.cc:276] 0810 13:53:50.324527 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:50.324659 (+ 132us) service_pool.cc:224] Handling call
0810 13:53:50.329883 (+ 5224us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703cad41 00007fec6df9cd37 00007fec6df9ccc2 00007fec6df9cbf1 00007fec6df9cb6c 00007fec6df9be22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.419838 (+2089955us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:52.013450 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:52.013968 (+ 518us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:52.014004 (+ 36us) write_op.cc:435] Acquired schema lock
0810 13:53:52.014023 (+ 19us) tablet.cc:662] Decoding operations
0810 13:53:52.014413 (+ 390us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:52.014462 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:52.014496 (+ 34us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:52.014936 (+ 440us) tablet.cc:701] Row locks acquired
0810 13:53:52.014957 (+ 21us) write_op.cc:260] PREPARE: finished
0810 13:53:52.015096 (+ 139us) write_op.cc:270] Start()
0810 13:53:52.015201 (+ 105us) write_op.cc:276] Timestamp: P: 1786370032015016 usec, L: 0
0810 13:53:52.015223 (+ 22us) op_driver.cc:348] REPLICATION: starting
0810 13:53:52.340442 (+325219us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b5400010a20. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e4d4900 00007fec6e55df22 00007fec6e553347 00007fec6e553184 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1
0810 13:53:52.349717 (+ 9275us) log.cc:844] Serialized 622 byte log entry
0810 13:53:52.413450 (+ 63733us) op_driver.cc:464] REPLICATION: finished
0810 13:53:52.413790 (+ 340us) write_op.cc:301] APPLY: starting
0810 13:53:52.413903 (+ 113us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:52.414116 (+ 213us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:52.414160 (+ 44us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:52.414972 (+ 812us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:52.415405 (+ 433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:52.415517 (+ 112us) write_op.cc:312] APPLY: finished
0810 13:53:52.415873 (+ 356us) log.cc:844] Serialized 29 byte log entry
0810 13:53:52.416743 (+ 870us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:52.416868 (+ 125us) write_op.cc:454] Released schema lock
0810 13:53:52.416926 (+ 58us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":9032448,"child_traces":[["op",{"apply.queue_time_us":117,"apply.run_cpu_time_us":2928,"apply.run_wall_time_us":8105,"mutex_wait_us":23559,"num_ops":2,"prepare.queue_time_us":70699,"prepare.run_cpu_time_us":5527,"prepare.run_wall_time_us":336552,"raft.queue_time_us":43044,"raft.run_cpu_time_us":801,"raft.run_wall_time_us":801,"replication_time_us":397924,"spinlock_wait_cycles":746685184}]]}
W20260810 13:53:52.466758 14880 log.cc:927] Time spent T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.176s user 0.000s sys 0.000s
I20260810 13:53:52.468566 14871 leader_election.cc:290] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:52.475191 14730 raft_consensus.cc:493] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:52.475874 14730 raft_consensus.cc:515] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.476765 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c43f7f8b7e4e56b5edbabe242c9dde" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:52.477656 13480 raft_consensus.cc:2393] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:52.479243 14730 leader_election.cc:290] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:52.483322 14730 consensus_queue.cc:1048] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:52.502388 13432 tablet_service.cc:1511] Processing CreateTablet for tablet d891e763a1854b6a8bda1071448fd8e0 (DEFAULT_TABLE table=default.Table_9067fca42e9747aa95a4c21c97b3bb7f [id=1baba71c9d394b66ba96870091d14173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.506711 13215 tablet_service.cc:1511] Processing CreateTablet for tablet 288debea4aa045d1898483cde1d4d3b1 (DEFAULT_TABLE table=default.Table_a8f5484f0ff14287be783696e6d8525d [id=06f3859cd5e748a3800b66ecf0a93c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.504560 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d891e763a1854b6a8bda1071448fd8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.510931 13268 raft_consensus.cc:2468] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:52.529132 13217 tablet_service.cc:1558] Processing DeleteTablet for tablet 69ecda19e4f143c99654aff6058ad8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:52.530987 13221 tablet_service.cc:1511] Processing CreateTablet for tablet fd22f04344954142922942fc4b7cb157 (DEFAULT_TABLE table=default.Table_5d92bfb4e8eb4ad58e5aac4da446b255 [id=08a605fcd00047e78a391b79e9fb8cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.533741 14869 raft_consensus.cc:493] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:52.534799 14869 raft_consensus.cc:515] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.535391 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4ff1185d2848808cbd92760e595830 (DEFAULT_TABLE table=default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.538002 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet 3db559714d84493ebaf7d3b51719d81c with delete_type TABLET_DATA_DELETED (replaced by tablet bec54cb915a54949871181763ad956d5) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:52.539328 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4946f79b54c46b1a59edf169109ab47" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:52.543507 14389 ts_tablet_manager.cc:1916] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:52.545820 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288debea4aa045d1898483cde1d4d3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.549943 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd22f04344954142922942fc4b7cb157. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.553236 13382 leader_election.cc:343] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:52.557032 13206 tablet_service.cc:1511] Processing CreateTablet for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c (DEFAULT_TABLE table=default.Table_c8b2a7d2d3d346898424ac950b04204b [id=0d0b3c6ce19a47d4a86fbe06c02bc7b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.560009 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.562419 13382 leader_election.cc:304] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:52.563472 14730 raft_consensus.cc:2804] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:52.564136 14730 raft_consensus.cc:697] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:52.565541 14730 consensus_queue.cc:237] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.586187 13434 tablet_service.cc:1511] Processing CreateTablet for tablet d7ffb0f96e744a4bb734aba7f3d82995 (DEFAULT_TABLE table=default.Table_579f9018ca714115bc18b1407243895e [id=a76911e4f6db4081b810faa3521fc694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.587270 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7ffb0f96e744a4bb734aba7f3d82995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.595326 14842 raft_consensus.cc:493] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:52.596063 14842 raft_consensus.cc:515] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.598248 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1023c03a20e448b4abaa7920a9ae09d9" } modify_external_catalogs: true
I20260810 13:53:52.599046 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1023c03a20e448b4abaa7920a9ae09d9" } modify_external_catalogs: true
I20260810 13:53:52.600349 14842 leader_election.cc:290] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:52.602728 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 5bab4d93f7dc4c88bbed9cb83961bb2e
I20260810 13:53:52.604380 12742 catalog_manager.cc:6807] ReplaceTablet: tablet 5bab4d93f7dc4c88bbed9cb83961bb2e deleted and replaced by tablet bd3119d63857480294dcb68ed0451bc0
I20260810 13:53:52.605998 12742 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:48758 (request call id 450) took 1079 ms. Trace:
I20260810 13:53:52.606185 13640 tablet_bootstrap.cc:492] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:52.606740 13640 ts_tablet_manager.cc:1403] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.271s user 0.008s sys 0.007s
I20260810 13:53:52.609190 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e with delete_type TABLET_DATA_DELETED (replaced by tablet bd3119d63857480294dcb68ed0451bc0) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:52.613538 14888 log.cc:1199] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/b7dded9a7c2c4652b41131f0bc14a6b5
I20260810 13:53:52.615051 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 288debea4aa045d1898483cde1d4d3b1 (DEFAULT_TABLE table=default.Table_a8f5484f0ff14287be783696e6d8525d [id=06f3859cd5e748a3800b66ecf0a93c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.612890 13640 raft_consensus.cc:359] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.618402 13640 raft_consensus.cc:385] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:52.618708 13640 raft_consensus.cc:740] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:52.618829 14710 raft_consensus.cc:493] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:52.621234 14710 raft_consensus.cc:515] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.623476 14710 leader_election.cc:290] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:52.623916 14710 raft_consensus.cc:493] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:52.623328 13640 consensus_queue.cc:260] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.626574 13640 ts_tablet_manager.cc:1434] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.020s user 0.005s sys 0.001s
I20260810 13:53:52.626820 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4ff1185d2848808cbd92760e595830 (DEFAULT_TABLE table=default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.627583 13640 tablet_bootstrap.cc:492] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:52.632006 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4946f79b54c46b1a59edf169109ab47" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:52.636459 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c80bc85fe25433ab2559ea0ada61978" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:52.637177 13040 raft_consensus.cc:2468] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:52.638600 13003 tablet_service.cc:1558] Processing DeleteTablet for tablet 69ecda19e4f143c99654aff6058ad8bb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:52.639597 13014 tablet_service.cc:1511] Processing CreateTablet for tablet fd22f04344954142922942fc4b7cb157 (DEFAULT_TABLE table=default.Table_5d92bfb4e8eb4ad58e5aac4da446b255 [id=08a605fcd00047e78a391b79e9fb8cfd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.639777 13003 tablet_service.cc:1511] Processing CreateTablet for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c (DEFAULT_TABLE table=default.Table_c8b2a7d2d3d346898424ac950b04204b [id=0d0b3c6ce19a47d4a86fbe06c02bc7b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.641315 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet 3db559714d84493ebaf7d3b51719d81c with delete_type TABLET_DATA_DELETED (replaced by tablet bec54cb915a54949871181763ad956d5) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:52.644290 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 288debea4aa045d1898483cde1d4d3b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.644965 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.645491 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd22f04344954142922942fc4b7cb157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.646152 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4ff1185d2848808cbd92760e595830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.624317 14710 raft_consensus.cc:515] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.649818 13049 raft_consensus.cc:3060] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:52.651924 14710 leader_election.cc:290] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:52.652530 14710 raft_consensus.cc:493] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:52.606323 12742 rpcz_store.cc:276] 0810 13:53:51.525555 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:51.928423 (+402868us) service_pool.cc:224] Handling call
0810 13:53:52.604660 (+676237us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:52.350093 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:52.350471 (+ 378us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:52.350495 (+ 24us) write_op.cc:435] Acquired schema lock
0810 13:53:52.350506 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:52.350784 (+ 278us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:52.350819 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:52.350840 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:52.351038 (+ 198us) tablet.cc:701] Row locks acquired
0810 13:53:52.351052 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:52.351160 (+ 108us) write_op.cc:270] Start()
0810 13:53:52.351238 (+ 78us) write_op.cc:276] Timestamp: P: 1786370032351101 usec, L: 0
0810 13:53:52.351253 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:52.351706 (+ 453us) log.cc:844] Serialized 622 byte log entry
0810 13:53:52.436543 (+ 84837us) op_driver.cc:464] REPLICATION: finished
0810 13:53:52.441560 (+ 5017us) write_op.cc:301] APPLY: starting
0810 13:53:52.441642 (+ 82us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:52.441783 (+ 141us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:52.441944 (+ 161us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:52.442542 (+ 598us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:52.442921 (+ 379us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:52.443015 (+ 94us) write_op.cc:312] APPLY: finished
0810 13:53:52.443370 (+ 355us) log.cc:844] Serialized 29 byte log entry
0810 13:53:52.601909 (+158539us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:52.602025 (+ 116us) write_op.cc:454] Released schema lock
0810 13:53:52.602070 (+ 45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":4745,"mutex_wait_us":157548,"num_ops":2,"prepare.queue_time_us":285385,"prepare.run_cpu_time_us":1899,"prepare.run_wall_time_us":43932,"raft.queue_time_us":42010,"raft.run_cpu_time_us":9,"raft.run_wall_time_us":9,"replication_time_us":85138}]]}
I20260810 13:53:52.668742 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 247fb8b09c12407d8535c07c5d0687fe (DEFAULT_TABLE table=default.Table_2711040d5d0d4fc2aeae4dd363d789a6 [id=7e13a586ab194007b460da7b3bfb022d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.669804 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247fb8b09c12407d8535c07c5d0687fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.673506 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 00a4341f5d274a9eb54cb030b47c9a91 (DEFAULT_TABLE table=default.Table_344892871be4435d92b2bc22d49a4e6a [id=e18db327e91e44b182d668355e4099f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.687105 13428 tablet_service.cc:1511] Processing CreateTablet for tablet 6406062bb0934eadae901502806178b5 (DEFAULT_TABLE table=default.Table_69d9d4a2261c401ca6f16490def91c0a [id=9b494f0580ad490ab882581f36e033b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.690883 12998 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:52.698391 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 00a4341f5d274a9eb54cb030b47c9a91 (DEFAULT_TABLE table=default.Table_344892871be4435d92b2bc22d49a4e6a [id=e18db327e91e44b182d668355e4099f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.691866 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet c4db9d7e82414cab8a69618effe89b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:52.693269 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c80bc85fe25433ab2559ea0ada61978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:52.693149 13011 tablet_service.cc:1511] Processing CreateTablet for tablet d891e763a1854b6a8bda1071448fd8e0 (DEFAULT_TABLE table=default.Table_9067fca42e9747aa95a4c21c97b3bb7f [id=1baba71c9d394b66ba96870091d14173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.694662 13021 tablet_service.cc:1511] Processing CreateTablet for tablet d7ffb0f96e744a4bb734aba7f3d82995 (DEFAULT_TABLE table=default.Table_579f9018ca714115bc18b1407243895e [id=a76911e4f6db4081b810faa3521fc694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.695915 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 6406062bb0934eadae901502806178b5 (DEFAULT_TABLE table=default.Table_69d9d4a2261c401ca6f16490def91c0a [id=9b494f0580ad490ab882581f36e033b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.699682 14710 raft_consensus.cc:515] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:52.696149 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 247fb8b09c12407d8535c07c5d0687fe (DEFAULT_TABLE table=default.Table_2711040d5d0d4fc2aeae4dd363d789a6 [id=7e13a586ab194007b460da7b3bfb022d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.697254 13009 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e with delete_type TABLET_DATA_DELETED (replaced by tablet bd3119d63857480294dcb68ed0451bc0) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:52.701766 14710 leader_election.cc:290] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:52.707664 13426 tablet_service.cc:1511] Processing CreateTablet for tablet 1c68d8171bf847eab37c505640b831fc (DEFAULT_TABLE table=default.Table_df8743b260984398bf1a3a7c1ee5c4a2 [id=f01c22584d5f4cb696573d09deec464e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.717348 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4ff1185d2848808cbd92760e595830. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.721349 13382 leader_election.cc:343] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 8c80bc85fe25433ab2559ea0ada61978
I20260810 13:53:52.723793 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 247fb8b09c12407d8535c07c5d0687fe (DEFAULT_TABLE table=default.Table_2711040d5d0d4fc2aeae4dd363d789a6 [id=7e13a586ab194007b460da7b3bfb022d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.725077 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e with delete_type TABLET_DATA_DELETED (replaced by tablet bd3119d63857480294dcb68ed0451bc0) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:52.725634 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 00a4341f5d274a9eb54cb030b47c9a91 (DEFAULT_TABLE table=default.Table_344892871be4435d92b2bc22d49a4e6a [id=e18db327e91e44b182d668355e4099f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.726334 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 1c68d8171bf847eab37c505640b831fc (DEFAULT_TABLE table=default.Table_df8743b260984398bf1a3a7c1ee5c4a2 [id=f01c22584d5f4cb696573d09deec464e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.729132 14273 ts_tablet_manager.cc:1929] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:52.729632 14273 log.cc:1199] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/35ba701a453546088933416d17e71127
I20260810 13:53:52.731287 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 75b8030450554de3b97266f348329ea6 (DEFAULT_TABLE table=default.Table_72d6991df9c54bd9a1427cb6b1e98570 [id=924550c187ce43b4940231335048eefa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.734613 13004 tablet_service.cc:1511] Processing CreateTablet for tablet 1c68d8171bf847eab37c505640b831fc (DEFAULT_TABLE table=default.Table_df8743b260984398bf1a3a7c1ee5c4a2 [id=f01c22584d5f4cb696573d09deec464e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.737251 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83ddc3ea3e74b569385b289fe8cf469" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:52.738184 13470 raft_consensus.cc:2393] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
W20260810 13:53:52.739817 13382 leader_election.cc:343] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:52.740288 13382 leader_election.cc:304] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:52.741196 14730 raft_consensus.cc:2749] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:52.743408 13382 leader_election.cc:304] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:53:52.744228 14730 raft_consensus.cc:2804] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:52.744535 14730 raft_consensus.cc:493] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:52.744923 14730 raft_consensus.cc:3060] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:52.749550 13208 tablet_service.cc:1511] Processing CreateTablet for tablet 6406062bb0934eadae901502806178b5 (DEFAULT_TABLE table=default.Table_69d9d4a2261c401ca6f16490def91c0a [id=9b494f0580ad490ab882581f36e033b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.755811 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a83ddc3ea3e74b569385b289fe8cf469" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:52.757177 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:52.761005 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2500b640931944079b9a58c7590ee717" } modify_external_catalogs: true
I20260810 13:53:52.761660 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2500b640931944079b9a58c7590ee717" } modify_external_catalogs: true
I20260810 13:53:52.765625 13217 tablet_service.cc:1511] Processing CreateTablet for tablet d7ffb0f96e744a4bb734aba7f3d82995 (DEFAULT_TABLE table=default.Table_579f9018ca714115bc18b1407243895e [id=a76911e4f6db4081b810faa3521fc694]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.773684 13231 tablet_service.cc:1511] Processing CreateTablet for tablet d891e763a1854b6a8bda1071448fd8e0 (DEFAULT_TABLE table=default.Table_9067fca42e9747aa95a4c21c97b3bb7f [id=1baba71c9d394b66ba96870091d14173]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.775756 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 53a99165463a43c78f4ccb6c5892f4b1 (DEFAULT_TABLE table=default.Table_0644d20557a146a193d56d2b30b4c726 [id=2cadac73aa8f46eaa3c948c964deef2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:52.790867 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
W20260810 13:53:52.807304 12952 leader_election.cc:343] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 8c80bc85fe25433ab2559ea0ada61978
I20260810 13:53:52.812285 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ff9e8a8ca845b89154ed0626d34c5c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:52.811642 14869 leader_election.cc:290] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:52.825039 14856 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.057s user 0.007s sys 0.011s
W20260810 13:53:52.825453 14856 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s user 0.007s sys 0.011s
W20260810 13:53:52.837570 14910 log.cc:927] Time spent T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.211s user 0.001s sys 0.000s
I20260810 13:53:52.840704 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a4341f5d274a9eb54cb030b47c9a91. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.841084 14908 log.cc:927] Time spent T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.127s user 0.001s sys 0.000s
I20260810 13:53:52.841285 14888 ts_tablet_manager.cc:1950] T b7dded9a7c2c4652b41131f0bc14a6b5 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:52.842152 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c68d8171bf847eab37c505640b831fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.845041 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6406062bb0934eadae901502806178b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.848057 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a4341f5d274a9eb54cb030b47c9a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.849004 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247fb8b09c12407d8535c07c5d0687fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.850353 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c68d8171bf847eab37c505640b831fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.851639 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6406062bb0934eadae901502806178b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.854190 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7ffb0f96e744a4bb734aba7f3d82995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.856645 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d891e763a1854b6a8bda1071448fd8e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.858135 14917 log.cc:927] Time spent T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.052s user 0.001s sys 0.000s
I20260810 13:53:52.858924 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a99165463a43c78f4ccb6c5892f4b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.869053 13022 consensus_meta.cc:287] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.636s user 0.007s sys 0.000s
I20260810 13:53:52.883057 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00a4341f5d274a9eb54cb030b47c9a91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.884441 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d891e763a1854b6a8bda1071448fd8e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.885880 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7ffb0f96e744a4bb734aba7f3d82995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.887183 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6406062bb0934eadae901502806178b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.888471 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 247fb8b09c12407d8535c07c5d0687fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:52.890551 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c68d8171bf847eab37c505640b831fc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.893215 14907 log.cc:927] Time spent T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.276s user 0.001s sys 0.000s
I20260810 13:53:52.894295 14888 tablet_replica.cc:333] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:52.895438 13640 tablet_bootstrap.cc:654] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:52.895372 14888 raft_consensus.cc:2243] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:52.895936 14888 raft_consensus.cc:2272] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:52.898311 14888 ts_tablet_manager.cc:1916] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:52.899698 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 674599456f9a49dc98d8d089c166ca89 (table default.Table_8b694afed3584daaa326e8817c01b2da [id=9eb780278810411cab5fa9af8e70e2d1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 674599456f9a49dc98d8d089c166ca89 consensus state has no leader
I20260810 13:53:52.939196 14888 ts_tablet_manager.cc:1929] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:52.939622 14888 log.cc:1199] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/c4db9d7e82414cab8a69618effe89b40
I20260810 13:53:52.940376 14888 ts_tablet_manager.cc:1950] T c4db9d7e82414cab8a69618effe89b40 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:52.950227 13639 tablet_bootstrap.cc:492] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:52.950193 14273 ts_tablet_manager.cc:1950] T 35ba701a453546088933416d17e71127 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:52.950608 13639 ts_tablet_manager.cc:1403] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.707s user 0.013s sys 0.008s
I20260810 13:53:52.951406 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75b8030450554de3b97266f348329ea6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:52.955847 13448 consensus_meta.cc:287] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.505s user 0.007s sys 0.000s
W20260810 13:53:52.972777 13420 consensus_meta.cc:287] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.577s user 0.002s sys 0.013s
I20260810 13:53:52.994588 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 302) took 3417 ms. Trace:
I20260810 13:53:52.998469 14273 rpcz_store.cc:276] 0810 13:53:49.577356 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.577522 (+ 166us) service_pool.cc:224] Handling call
0810 13:53:51.920598 (+2343076us) ts_tablet_manager.cc:1151] Deleting tablet 35ba701a453546088933416d17e71127
0810 13:53:51.920637 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:52.106324 (+185687us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:52.728992 (+622668us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:52.994521 (+265529us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2342008}
I20260810 13:53:53.002031 14273 tablet_replica.cc:333] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:53.003815 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 35ba701a453546088933416d17e71127 (table default.Table_e54429fe3e9c4a46849ec51775c7b98d [id=5fa0d1b7c3134c4c9e2f3a8ae8c5ff8a]) successfully deleted
I20260810 13:53:53.003989 14763 consensus_queue.cc:1048] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:53.027707 14888 tablet_replica.cc:333] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:53.028900 14888 raft_consensus.cc:2243] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:53.029410 14888 raft_consensus.cc:2272] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:53.029331 13639 raft_consensus.cc:359] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.030064 13639 raft_consensus.cc:385] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:53.030315 13639 raft_consensus.cc:740] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:53.031869 14888 ts_tablet_manager.cc:1916] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:53.037482 13639 consensus_queue.cc:260] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.047058 13639 ts_tablet_manager.cc:1434] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.096s user 0.006s sys 0.001s
I20260810 13:53:53.066574 13639 tablet_bootstrap.cc:492] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:53.101039 13639 tablet_bootstrap.cc:654] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:53.116513 13639 tablet_bootstrap.cc:492] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:53.117038 13639 ts_tablet_manager.cc:1403] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.051s user 0.009s sys 0.018s
I20260810 13:53:53.117332 14888 ts_tablet_manager.cc:1929] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:53.118093 14888 log.cc:1199] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/8c80bc85fe25433ab2559ea0ada61978
I20260810 13:53:53.119269 14888 ts_tablet_manager.cc:1950] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:53.121344 13639 raft_consensus.cc:359] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.122332 13639 raft_consensus.cc:385] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:53.122630 13639 raft_consensus.cc:740] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:53.123400 13639 consensus_queue.cc:260] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.130616 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 53a99165463a43c78f4ccb6c5892f4b1 (DEFAULT_TABLE table=default.Table_0644d20557a146a193d56d2b30b4c726 [id=2cadac73aa8f46eaa3c948c964deef2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.131850 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a99165463a43c78f4ccb6c5892f4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.132616 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet b7dded9a7c2c4652b41131f0bc14a6b5 (table default.Table_f607f9e067574d68809ebee30bc17d75 [id=4e674333f87c408fa06b5852511ad168]) successfully deleted
W20260810 13:53:53.133394 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 69ecda19e4f143c99654aff6058ad8bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69ecda19e4f143c99654aff6058ad8bb already in progress: creating tablet
W20260810 13:53:53.134135 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 3db559714d84493ebaf7d3b51719d81c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3db559714d84493ebaf7d3b51719d81c already in progress: creating tablet
W20260810 13:53:53.134806 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 2d04860a72c64a5db966e2784c6dbbf0 because the tablet was not found. No further retry: Not found: Tablet not found: 2d04860a72c64a5db966e2784c6dbbf0
I20260810 13:53:53.135637 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet c4db9d7e82414cab8a69618effe89b40 (table default.Table_a854e55f38e14aee8898f1cb29ba6b9b [id=7f6b178a7e0a44cdbc49adfea482738b]) successfully deleted
I20260810 13:53:53.149951 13639 ts_tablet_manager.cc:1434] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.033s user 0.008s sys 0.000s
I20260810 13:53:53.148635 14921 tablet.cc:1724] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:53:53.157752 13639 tablet_bootstrap.cc:492] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:53.166340 13206 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7bddc8e6374437a37aeb755389d91f (DEFAULT_TABLE table=default.Table_3ffb4babc30c4b76ae97168cb6dbdeee [id=66920d867573408d811d1fa6b877d355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.173460 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7bddc8e6374437a37aeb755389d91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.177582 13639 tablet_bootstrap.cc:654] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:53.192775 12739 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 454) took 1203 ms. Trace:
I20260810 13:53:53.193192 12739 rpcz_store.cc:276] 0810 13:53:51.989793 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.042919 (+ 53126us) service_pool.cc:224] Handling call
0810 13:53:52.351629 (+308710us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.353669 (+ 2040us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:53:52.355705 (+ 2036us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:53:53.192029 (+836324us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:53:53.192402 (+ 373us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:53:53.192705 (+ 303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:52.439577 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:52.439963 (+ 386us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:52.439990 (+ 27us) write_op.cc:435] Acquired schema lock
0810 13:53:52.440003 (+ 13us) tablet.cc:662] Decoding operations
0810 13:53:52.440268 (+ 265us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:52.440304 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:52.440324 (+ 20us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:52.440573 (+ 249us) tablet.cc:701] Row locks acquired
0810 13:53:52.440587 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:52.440721 (+ 134us) write_op.cc:270] Start()
0810 13:53:52.440801 (+ 80us) write_op.cc:276] Timestamp: P: 1786370032440631 usec, L: 0
0810 13:53:52.440816 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:52.441254 (+ 438us) log.cc:844] Serialized 433 byte log entry
0810 13:53:53.187564 (+746310us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.188161 (+ 597us) write_op.cc:301] APPLY: starting
0810 13:53:53.188295 (+ 134us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.188554 (+ 259us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.188750 (+ 196us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.189775 (+ 1025us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.190082 (+ 307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:53:53.190174 (+ 92us) write_op.cc:312] APPLY: finished
0810 13:53:53.190684 (+ 510us) log.cc:844] Serialized 29 byte log entry
0810 13:53:53.191522 (+ 838us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.191654 (+ 132us) write_op.cc:454] Released schema lock
0810 13:53:53.191738 (+ 84us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":707572992,"child_traces":[["op",{"apply.queue_time_us":359,"num_ops":2,"prepare.queue_time_us":76216,"prepare.run_cpu_time_us":2037,"prepare.run_wall_time_us":155530,"replication_time_us":746596}]]}
I20260810 13:53:53.202239 14924 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:53.203367 14924 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:53.209296 13639 tablet_bootstrap.cc:492] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:53.209905 13639 ts_tablet_manager.cc:1403] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.014s
I20260810 13:53:53.221097 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c43f7f8b7e4e56b5edbabe242c9dde" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:53.222458 13639 raft_consensus.cc:359] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.223364 13639 raft_consensus.cc:385] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:53.223646 13639 raft_consensus.cc:740] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:53.224381 13639 consensus_queue.cc:260] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.231276 13639 ts_tablet_manager.cc:1434] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.021s user 0.008s sys 0.003s
I20260810 13:53:53.232250 13639 tablet_bootstrap.cc:492] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:53:53.236785 13638 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.775s user 0.013s sys 0.008s
W20260810 13:53:53.238462 13638 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.776s user 0.013s sys 0.009s
I20260810 13:53:53.243361 14924 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:53.252545 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 511 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
W20260810 13:53:53.259897 12473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111) [suppressed 13 similar messages]
W20260810 13:53:53.320931 12473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 61296.6us
W20260810 13:53:53.331565 12473 leader_election.cc:336] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
I20260810 13:53:53.332301 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:53.333537 14924 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:53.355576 13638 tablet_bootstrap.cc:492] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:53.356307 13638 ts_tablet_manager.cc:1403] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 1.211s user 0.022s sys 0.017s
I20260810 13:53:53.007225 14730 raft_consensus.cc:515] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:53.237129 12954 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s user 0.008s sys 0.015s
I20260810 13:53:53.377285 14928 raft_consensus.cc:493] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:53.377828 14928 raft_consensus.cc:515] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:53.380448 13424 consensus_meta.cc:287] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.878s user 0.008s sys 0.004s
I20260810 13:53:53.380394 12951 leader_election.cc:304] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:53.384265 13417 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 318) took 1171 ms. Trace:
I20260810 13:53:53.386441 13424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 319) took 1164 ms. Trace:
I20260810 13:53:53.387094 13424 rpcz_store.cc:276] 0810 13:53:52.222021 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.230764 (+ 8743us) service_pool.cc:224] Handling call
0810 13:53:52.235467 (+ 4703us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.235556 (+ 89us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:52.501891 (+266335us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.385493 (+883602us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.386331 (+ 838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:53.384985 13417 rpcz_store.cc:276] 0810 13:53:52.213222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.213332 (+ 110us) service_pool.cc:224] Handling call
0810 13:53:52.214600 (+ 1268us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.214676 (+ 76us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:53.025000 (+810324us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.381714 (+356714us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.384168 (+ 2454us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":980}
I20260810 13:53:53.398005 14273 raft_consensus.cc:2243] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:53.407701 14911 raft_consensus.cc:3060] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:53.409124 13639 tablet_bootstrap.cc:654] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:53.413587 13640 tablet_bootstrap.cc:492] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:53.415751 13640 ts_tablet_manager.cc:1403] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.788s user 0.010s sys 0.015s
W20260810 13:53:53.436182 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf672d15f88c4f0dbdf2fdb6aefa1108 has no consensus state
I20260810 13:53:53.361598 12749 catalog_manager.cc:5719] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:53.436798 12743 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:48758 (request call id 455) took 1354 ms. Trace:
I20260810 13:53:53.359058 14763 consensus_queue.cc:1048] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:53:53.383319 13167 leader_election.cc:343] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:53.398193 13223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 307) took 1124 ms. Trace:
I20260810 13:53:53.419552 14389 ts_tablet_manager.cc:1929] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:53.445528 14389 log.cc:1199] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/35c43f7f8b7e4e56b5edbabe242c9dde
I20260810 13:53:53.425156 13227 tablet_service.cc:1511] Processing CreateTablet for tablet 98ce3cccca464b938fd45afe292b4ad8 (DEFAULT_TABLE table=default.Table_4f7895e8b4164093b5fa194d7f828d2a [id=f492b2e2f4cf4205a7d147ddad56af40]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:53.452960 12728 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111) [suppressed 5 similar messages]
I20260810 13:53:53.456300 14730 leader_election.cc:290] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:53.439738 12743 rpcz_store.cc:276] 0810 13:53:52.081963 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.084474 (+ 2511us) service_pool.cc:224] Handling call
0810 13:53:52.360016 (+275542us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c8846 00007fec6df85634 00007fec6df855c2 00007fec6df854f1 00007fec6df8546c 00007fec6df84722 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.360651 (+ 635us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:52.361287 (+ 636us) catalog_manager.cc:3751] Apply alter schema
0810 13:53:52.361754 (+ 467us) catalog_manager.cc:3783] Acquired catalog manager lock
0810 13:53:52.384868 (+ 23114us) catalog_manager.cc:3941] Updating metadata on disk
0810 13:53:53.435538 (+1050670us) catalog_manager.cc:3972] Committing alterations to in-memory state
0810 13:53:53.436723 (+ 1185us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:52.595458 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:52.595949 (+ 491us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:52.595975 (+ 26us) write_op.cc:435] Acquired schema lock
0810 13:53:52.595989 (+ 14us) tablet.cc:662] Decoding operations
0810 13:53:52.596319 (+ 330us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:52.596371 (+ 52us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:52.596397 (+ 26us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:52.596585 (+ 188us) tablet.cc:701] Row locks acquired
0810 13:53:52.596599 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:53.103945 (+507346us) write_op.cc:270] Start()
0810 13:53:53.104055 (+ 110us) write_op.cc:276] Timestamp: P: 1786370033101512 usec, L: 0
0810 13:53:53.104077 (+ 22us) op_driver.cc:348] REPLICATION: starting
0810 13:53:53.253350 (+149273us) log.cc:844] Serialized 405 byte log entry
0810 13:53:53.255589 (+ 2239us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e553208 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1 00007fec6e9e650d 00000000005bd8c4 00000000005bd6f9
0810 13:53:53.421119 (+165530us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.422170 (+ 1051us) write_op.cc:301] APPLY: starting
0810 13:53:53.422267 (+ 97us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.422515 (+ 248us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.422545 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.422795 (+ 250us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.432892 (+ 10097us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:53.432975 (+ 83us) write_op.cc:312] APPLY: finished
0810 13:53:53.433410 (+ 435us) log.cc:844] Serialized 23 byte log entry
0810 13:53:53.433750 (+ 340us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.433880 (+ 130us) write_op.cc:454] Released schema lock
0810 13:53:53.433942 (+ 62us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:53.434389 (+ 447us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.434440 (+ 51us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":631969152,"child_traces":[["op",{"apply.queue_time_us":791,"apply.run_cpu_time_us":2416,"apply.run_wall_time_us":12152,"num_ops":1,"prepare.queue_time_us":209428,"prepare.run_cpu_time_us":5135,"prepare.run_wall_time_us":661374,"raft.queue_time_us":142,"raft.run_cpu_time_us":1380,"raft.run_wall_time_us":14365,"replication_time_us":316917,"spinlock_wait_cycles":341998976}]]}
I20260810 13:53:53.460497 13229 tablet_service.cc:1511] Processing CreateTablet for tablet cb4dcad38c1a4269b4740a8e5247a867 (DEFAULT_TABLE table=default.Table_c42d109e12a9416384e73d68761d43d7 [id=c374f65e7c914fa1aafe16f714a51ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.465585 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ce3cccca464b938fd45afe292b4ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.469687 14389 ts_tablet_manager.cc:1950] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:53.444922 13167 leader_election.cc:304] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:53.470451 12744 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 453) took 1619 ms. Trace:
I20260810 13:53:53.470849 12744 rpcz_store.cc:276] 0810 13:53:51.851117 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.039024 (+187907us) service_pool.cc:224] Handling call
0810 13:53:52.357232 (+318208us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.359103 (+ 1871us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:53:52.426199 (+ 67096us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b5800000fe8. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6727a981 00007fec6739a9ce 00007fec702e7487 00007fec702a3aa4 00007fec702a13c7 00007fec702a4ece 00007fec703c81ff 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c
0810 13:53:52.428223 (+ 2024us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:53:53.469540 (+1041317us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:53:53.470036 (+ 496us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:53:53.470377 (+ 341us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:53.256926 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:53.257333 (+ 407us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:53.257365 (+ 32us) write_op.cc:435] Acquired schema lock
0810 13:53:53.257377 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:53.289043 (+ 31666us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:53.289082 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:53.289104 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:53.289374 (+ 270us) tablet.cc:701] Row locks acquired
0810 13:53:53.289387 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:53:53.289512 (+ 125us) write_op.cc:270] Start()
0810 13:53:53.289616 (+ 104us) write_op.cc:276] Timestamp: P: 1786370033289422 usec, L: 0
0810 13:53:53.289637 (+ 21us) op_driver.cc:348] REPLICATION: starting
0810 13:53:53.290323 (+ 686us) log.cc:844] Serialized 433 byte log entry
0810 13:53:53.465937 (+175614us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.467085 (+ 1148us) write_op.cc:301] APPLY: starting
0810 13:53:53.467183 (+ 98us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.467299 (+ 116us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.467405 (+ 106us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.468277 (+ 872us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.468518 (+ 241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:53:53.468600 (+ 82us) write_op.cc:312] APPLY: finished
0810 13:53:53.468896 (+ 296us) log.cc:844] Serialized 29 byte log entry
0810 13:53:53.469118 (+ 222us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.469221 (+ 103us) write_op.cc:454] Released schema lock
0810 13:53:53.469284 (+ 63us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":881066624,"child_traces":[["op",{"apply.queue_time_us":890,"apply.run_cpu_time_us":2508,"apply.run_wall_time_us":5954,"num_ops":2,"prepare.queue_time_us":823035,"prepare.run_cpu_time_us":2325,"prepare.run_wall_time_us":38308,"replication_time_us":176154}]]}
I20260810 13:53:53.480294 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 97015b4984c74a4682b6dedd47dc6650 (DEFAULT_TABLE table=default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.481415 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97015b4984c74a4682b6dedd47dc6650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.481493 12750 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 452) took 1807 ms. Trace:
I20260810 13:53:53.484225 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 302) took 1367 ms. Trace:
I20260810 13:53:53.484547 14389 rpcz_store.cc:276] 0810 13:53:52.116451 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.118850 (+ 2399us) service_pool.cc:224] Handling call
0810 13:53:52.262189 (+143339us) ts_tablet_manager.cc:1151] Deleting tablet 35c43f7f8b7e4e56b5edbabe242c9dde
0810 13:53:52.262231 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:52.299419 (+ 37188us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b5400093dd4. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f911eaac951 00007f911eb4b742 00007f911ef8bd2c 00007f911fbf341a 00007f911fc240e0 00007f911fc0a64d 00007f911fc0a5f9 00007f911fc0a589 00007f911fc0a551 00007f911fc0977d 00000000005bd8c4
0810 13:53:53.099102 (+799683us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.419405 (+320303us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.484148 (+ 64743us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76838272,"tablet-delete.queue_time_us":142486}
I20260810 13:53:53.486033 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 301) took 1370 ms. Trace:
I20260810 13:53:53.481889 12750 rpcz_store.cc:276] 0810 13:53:51.673879 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.024105 (+350226us) service_pool.cc:224] Handling call
0810 13:53:52.356324 (+332219us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.358241 (+ 1917us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:53:52.434223 (+ 75982us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:53:53.480724 (+1046501us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:53:53.481122 (+ 398us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:53:53.481425 (+ 303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:53.295439 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:53.295824 (+ 385us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:53.295848 (+ 24us) write_op.cc:435] Acquired schema lock
0810 13:53:53.295860 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:53.296154 (+ 294us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:53.296189 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:53.296210 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:53.296415 (+ 205us) tablet.cc:701] Row locks acquired
0810 13:53:53.296493 (+ 78us) write_op.cc:260] PREPARE: finished
0810 13:53:53.296611 (+ 118us) write_op.cc:270] Start()
0810 13:53:53.296716 (+ 105us) write_op.cc:276] Timestamp: P: 1786370033296522 usec, L: 0
0810 13:53:53.296738 (+ 22us) op_driver.cc:348] REPLICATION: starting
0810 13:53:53.297615 (+ 877us) log.cc:844] Serialized 433 byte log entry
0810 13:53:53.466405 (+168790us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.473508 (+ 7103us) write_op.cc:301] APPLY: starting
0810 13:53:53.473570 (+ 62us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.473729 (+ 159us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.473887 (+ 158us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.474465 (+ 578us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.474699 (+ 234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:53:53.474788 (+ 89us) write_op.cc:312] APPLY: finished
0810 13:53:53.475030 (+ 242us) log.cc:844] Serialized 29 byte log entry
0810 13:53:53.475215 (+ 185us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.475306 (+ 91us) write_op.cc:454] Released schema lock
0810 13:53:53.475357 (+ 51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":761540480,"child_traces":[["op",{"apply.queue_time_us":6891,"num_ops":2,"prepare.queue_time_us":860073,"prepare.run_cpu_time_us":2522,"prepare.run_wall_time_us":13870,"replication_time_us":169506,"threads_started":1}]]}
I20260810 13:53:53.486362 14389 rpcz_store.cc:276] 0810 13:53:52.116067 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.120846 (+ 4779us) service_pool.cc:224] Handling call
0810 13:53:53.485759 (+1364913us) ts_tablet_manager.cc:1151] Deleting tablet 2327309017db4094907b3e405988f224
0810 13:53:53.485802 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:53.485975 (+ 173us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1364098}
I20260810 13:53:53.487387 14389 tablet_replica.cc:333] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:53.488143 14389 raft_consensus.cc:2243] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
W20260810 13:53:53.478549 13167 raft_consensus.cc:2686] T 35c43f7f8b7e4e56b5edbabe242c9dde P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:53:53.489953 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 107459us
I20260810 13:53:53.445412 13223 rpcz_store.cc:276] 0810 13:53:52.274012 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.284306 (+ 10294us) service_pool.cc:224] Handling call
0810 13:53:52.294535 (+ 10229us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.294682 (+ 147us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:52.935198 (+640516us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.397654 (+462456us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.398096 (+ 442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:53.439265 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
W20260810 13:53:53.503356 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 50415.1us
W20260810 13:53:53.508944 13012 consensus_meta.cc:287] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.565s user 0.010s sys 0.005s
I20260810 13:53:53.512774 14389 pending_rounds.cc:70] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:53:53.513046 14389 pending_rounds.cc:77] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971650114699264 op_type: NO_OP noop_request { }
I20260810 13:53:53.513429 14389 raft_consensus.cc:2889] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:53.513790 14389 raft_consensus.cc:2272] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:53.515389 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7bddc8e6374437a37aeb755389d91f (DEFAULT_TABLE table=default.Table_3ffb4babc30c4b76ae97168cb6dbdeee [id=66920d867573408d811d1fa6b877d355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.517153 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 98ce3cccca464b938fd45afe292b4ad8 (DEFAULT_TABLE table=default.Table_4f7895e8b4164093b5fa194d7f828d2a [id=f492b2e2f4cf4205a7d147ddad56af40]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:53.518361 12728 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 -> Peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Couldn't send request to peer 2928f7d4503145b182d99007d240334d. Status: Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260810 13:53:53.521412 13638 raft_consensus.cc:359] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.521972 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:53.522256 13638 raft_consensus.cc:385] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:53.522853 13638 raft_consensus.cc:740] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:53.523190 13042 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.892s user 0.004s sys 0.022s
W20260810 13:53:53.523581 13042 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.893s user 0.004s sys 0.022s
I20260810 13:53:53.526033 13640 raft_consensus.cc:359] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.527053 13640 raft_consensus.cc:385] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:53.527433 13640 raft_consensus.cc:740] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:53.305595 13040 raft_consensus.cc:3060] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:53.408993 12954 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s user 0.008s sys 0.015s
I20260810 13:53:53.533017 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 35c43f7f8b7e4e56b5edbabe242c9dde (table default.Table_c75d32693a7f4df68c1f2c97bfaf15f5 [id=6fef18912c5c43519e5759644317fc3c]) successfully deleted
W20260810 13:53:53.533665 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 2327309017db4094907b3e405988f224 because the tablet was not found. No further retry: Not found: Tablet not found: 2327309017db4094907b3e405988f224
I20260810 13:53:53.532815 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ff9e8a8ca845b89154ed0626d34c5c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:53.535580 13037 raft_consensus.cc:2468] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:53.538873 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4dcad38c1a4269b4740a8e5247a867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.539083 12745 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:48758 (request call id 451) took 1997 ms. Trace:
I20260810 13:53:53.542346 12999 tablet_service.cc:1511] Processing CreateTablet for tablet cb4dcad38c1a4269b4740a8e5247a867 (DEFAULT_TABLE table=default.Table_c42d109e12a9416384e73d68761d43d7 [id=c374f65e7c914fa1aafe16f714a51ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.539439 12745 rpcz_store.cc:276] 0810 13:53:51.541212 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.003608 (+462396us) service_pool.cc:224] Handling call
0810 13:53:52.352418 (+348810us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c8846 00007fec6df85634 00007fec6df855c2 00007fec6df854f1 00007fec6df8546c 00007fec6df84722 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.353059 (+ 641us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:52.353699 (+ 640us) catalog_manager.cc:3751] Apply alter schema
0810 13:53:52.354221 (+ 522us) catalog_manager.cc:3783] Acquired catalog manager lock
0810 13:53:52.354447 (+ 226us) catalog_manager.cc:3941] Updating metadata on disk
0810 13:53:53.186802 (+832355us) catalog_manager.cc:3972] Committing alterations to in-memory state
0810 13:53:53.539017 (+352215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:52.394149 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:52.394534 (+ 385us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:52.394560 (+ 26us) write_op.cc:435] Acquired schema lock
0810 13:53:52.394573 (+ 13us) tablet.cc:662] Decoding operations
0810 13:53:52.394838 (+ 265us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:52.394873 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:52.394894 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:52.395042 (+ 148us) tablet.cc:701] Row locks acquired
0810 13:53:52.395056 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:52.395172 (+ 116us) write_op.cc:270] Start()
0810 13:53:52.395279 (+ 107us) write_op.cc:276] Timestamp: P: 1786370032395106 usec, L: 0
0810 13:53:52.395295 (+ 16us) op_driver.cc:348] REPLICATION: starting
0810 13:53:52.437488 (+ 42193us) log.cc:844] Serialized 405 byte log entry
0810 13:53:52.439259 (+ 1771us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e553208 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1 00007fec6e9e650d 00000000005bd8c4 00000000005bd6f9
0810 13:53:53.182501 (+743242us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.183123 (+ 622us) write_op.cc:301] APPLY: starting
0810 13:53:53.183243 (+ 120us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.183463 (+ 220us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.183511 (+ 48us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.183733 (+ 222us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.184024 (+ 291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:53.184087 (+ 63us) write_op.cc:312] APPLY: finished
0810 13:53:53.184479 (+ 392us) log.cc:844] Serialized 23 byte log entry
0810 13:53:53.185929 (+ 1450us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.186071 (+ 142us) write_op.cc:454] Released schema lock
0810 13:53:53.186136 (+ 65us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":800527232,"child_traces":[["op",{"apply.queue_time_us":215,"apply.run_cpu_time_us":2435,"apply.run_wall_time_us":3448,"num_ops":1,"prepare.queue_time_us":38683,"prepare.run_cpu_time_us":2917,"prepare.run_wall_time_us":45224,"replication_time_us":786979,"spinlock_wait_cycles":95712000}]]}
I20260810 13:53:53.551620 14928 leader_election.cc:290] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:53.559074 13224 consensus_meta.cc:287] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb: Time spent flushing consensus metadata: real 0.570s user 0.012s sys 0.002s
I20260810 13:53:53.560554 13224 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 306) took 1296 ms. Trace:
I20260810 13:53:53.565920 13008 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 302) took 1217 ms. Trace:
I20260810 13:53:53.566341 13008 rpcz_store.cc:276] 0810 13:53:52.348236 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.613507 (+265271us) service_pool.cc:224] Handling call
0810 13:53:52.616211 (+ 2704us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.616449 (+ 238us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:53.049408 (+432959us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.414849 (+365441us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.565849 (+151000us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71370}
I20260810 13:53:53.569903 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4dcad38c1a4269b4740a8e5247a867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.570271 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 8c80bc85fe25433ab2559ea0ada61978 (table default.Table_723061893666401a9728e4a49b584f5f [id=8aaef23848b848bebe6d6d9069d961fd]) successfully deleted
W20260810 13:53:53.570923 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bab4d93f7dc4c88bbed9cb83961bb2e already in progress: creating tablet
I20260810 13:53:53.573379 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7bddc8e6374437a37aeb755389d91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.573947 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 97015b4984c74a4682b6dedd47dc6650 (DEFAULT_TABLE table=default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.575150 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97015b4984c74a4682b6dedd47dc6650. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:53.575932 13428 consensus_meta.cc:287] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.521s user 0.005s sys 0.006s
I20260810 13:53:53.577241 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ce3cccca464b938fd45afe292b4ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.585458 14273 raft_consensus.cc:2272] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:53.528259 13640 consensus_queue.cc:260] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.595968 14911 raft_consensus.cc:2749] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:53.604735 14273 ts_tablet_manager.cc:1916] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:53.608560 13640 ts_tablet_manager.cc:1434] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.192s user 0.007s sys 0.000s
I20260810 13:53:53.618134 13640 tablet_bootstrap.cc:492] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:53.568948 13167 leader_election.cc:304] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:53.626302 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 57440.7us
I20260810 13:53:53.579653 13210 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 305) took 1165 ms. Trace:
I20260810 13:53:53.635749 12745 master_service.cc:960] ReplaceTablet: received request to replace tablet 61169145c539464fa9cf62eaaf8168e5 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:53.637326 12740 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 456) took 1508 ms. Trace:
I20260810 13:53:53.624235 13638 consensus_queue.cc:260] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.637624 12740 rpcz_store.cc:276] 0810 13:53:52.129107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.228783 (+ 99676us) service_pool.cc:224] Handling call
0810 13:53:52.360447 (+131664us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.362257 (+ 1810us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:53:52.429920 (+ 67663us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b5800000fe8. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6727a981 00007fec6739a9ce 00007fec702e7487 00007fec702a3aa4 00007fec702a13c7 00007fec702a4ece 00007fec703c81ff 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c
0810 13:53:52.431571 (+ 1651us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:53:53.636665 (+1205094us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:53:53.637019 (+ 354us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:53:53.637258 (+ 239us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:53.309466 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:53.309845 (+ 379us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:53.309875 (+ 30us) write_op.cc:435] Acquired schema lock
0810 13:53:53.309892 (+ 17us) tablet.cc:662] Decoding operations
0810 13:53:53.310177 (+ 285us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:53.310210 (+ 33us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:53.310242 (+ 32us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:53.310426 (+ 184us) tablet.cc:701] Row locks acquired
0810 13:53:53.310438 (+ 12us) write_op.cc:260] PREPARE: finished
0810 13:53:53.310545 (+ 107us) write_op.cc:270] Start()
0810 13:53:53.310631 (+ 86us) write_op.cc:276] Timestamp: P: 1786370033310457 usec, L: 0
0810 13:53:53.310647 (+ 16us) op_driver.cc:348] REPLICATION: starting
0810 13:53:53.357845 (+ 47198us) log.cc:844] Serialized 433 byte log entry
0810 13:53:53.365720 (+ 7875us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b5400010a20. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e4cea98 00007fec6e4ce6da 00007fec6e552d45 00007fec6e5531e9 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1
0810 13:53:53.423650 (+ 57930us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b58000500d0. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e4b181c 00007fec6e4b8133 00007fec6e4b80b9 00007fec6e4b8049 00007fec6e4b8011 00007fec6e4b71dd 00000000005bd8c4 00000000005bd6f9 00007fec673f1db5 00007fec673f4121
0810 13:53:53.633096 (+209446us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.633624 (+ 528us) write_op.cc:301] APPLY: starting
0810 13:53:53.633745 (+ 121us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.633937 (+ 192us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.633962 (+ 25us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.634747 (+ 785us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.635027 (+ 280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:53:53.635081 (+ 54us) write_op.cc:312] APPLY: finished
0810 13:53:53.635436 (+ 355us) log.cc:844] Serialized 29 byte log entry
0810 13:53:53.636209 (+ 773us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.636297 (+ 88us) write_op.cc:454] Released schema lock
0810 13:53:53.636393 (+ 96us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":453760768,"child_traces":[["op",{"apply.queue_time_us":240,"num_ops":2,"prepare.queue_time_us":873919,"prepare.run_cpu_time_us":9502,"prepare.run_wall_time_us":181945,"raft.queue_time_us":28077,"raft.run_cpu_time_us":2235,"raft.run_wall_time_us":29757,"replication_time_us":322287,"spinlock_wait_cycles":80618624,"thread_start_us":98252,"threads_started":1}]]}
I20260810 13:53:53.646970 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (DEFAULT_TABLE table=default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.648126 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc6395b50b2458fa2d3877eb7ec2ade. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:53.650722 14841 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.730s user 0.008s sys 0.009s
W20260810 13:53:53.651031 14841 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.730s user 0.008s sys 0.009s
I20260810 13:53:53.657042 13417 tablet_service.cc:1511] Processing CreateTablet for tablet 98ce3cccca464b938fd45afe292b4ad8 (DEFAULT_TABLE table=default.Table_4f7895e8b4164093b5fa194d7f828d2a [id=f492b2e2f4cf4205a7d147ddad56af40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.658373 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98ce3cccca464b938fd45afe292b4ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.660061 13236 tablet_service.cc:1511] Processing CreateTablet for tablet dd58cc128ce64f9abe1418b6093a1c2c (DEFAULT_TABLE table=default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.661060 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd58cc128ce64f9abe1418b6093a1c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.661629 13004 tablet_service.cc:1511] Processing CreateTablet for tablet 420ee600a4174916827aa7b64bbcd8d2 (DEFAULT_TABLE table=default.Table_86dcc5d091024407b7e167806ec593a3 [id=c07ecd00b44e49c9b0a32e8710373471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.663434 13426 tablet_service.cc:1511] Processing CreateTablet for tablet cb4dcad38c1a4269b4740a8e5247a867 (DEFAULT_TABLE table=default.Table_c42d109e12a9416384e73d68761d43d7 [id=c374f65e7c914fa1aafe16f714a51ca3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.664213 13424 tablet_service.cc:1511] Processing CreateTablet for tablet 7a7bddc8e6374437a37aeb755389d91f (DEFAULT_TABLE table=default.Table_3ffb4babc30c4b76ae97168cb6dbdeee [id=66920d867573408d811d1fa6b877d355]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.665352 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb4dcad38c1a4269b4740a8e5247a867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.647663 14763 raft_consensus.cc:2804] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:53:53.666255 13428 tablet_service.cc:1511] Processing CreateTablet for tablet 53a99165463a43c78f4ccb6c5892f4b1 (DEFAULT_TABLE table=default.Table_0644d20557a146a193d56d2b30b4c726 [id=2cadac73aa8f46eaa3c948c964deef2a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.667577 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a99165463a43c78f4ccb6c5892f4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.674008 13425 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 321) took 1348 ms. Trace:
I20260810 13:53:53.666976 14763 raft_consensus.cc:493] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:53.677248 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420ee600a4174916827aa7b64bbcd8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.674021 13011 tablet_service.cc:1511] Processing CreateTablet for tablet dd58cc128ce64f9abe1418b6093a1c2c (DEFAULT_TABLE table=default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.681082 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd58cc128ce64f9abe1418b6093a1c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.682727 14763 raft_consensus.cc:3060] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:53:53.682941 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_07c236dd619a4225bd511e9706e5a0e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:53.684378 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07c236dd619a4225bd511e9706e5a0e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:53.637020 13210 rpcz_store.cc:276] 0810 13:53:52.263284 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.264141 (+ 857us) service_pool.cc:224] Handling call
0810 13:53:52.265571 (+ 1430us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.265675 (+ 104us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:52.864383 (+598708us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.427860 (+563477us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.428624 (+ 764us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:53.691592 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_13af97840a5a4e1cb52df81dc991d50c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:53.693089 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13af97840a5a4e1cb52df81dc991d50c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:53.627254 13224 rpcz_store.cc:276] 0810 13:53:52.263680 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.268811 (+ 5131us) service_pool.cc:224] Handling call
0810 13:53:52.290099 (+ 21288us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.290217 (+ 118us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:52.868568 (+578351us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.559870 (+691302us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.560469 (+ 599us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:53.701576 13213 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 310) took 1178 ms. Trace:
I20260810 13:53:53.711166 14389 ts_tablet_manager.cc:1916] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:53.731850 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_70752dd9fddd4f3cb661f9559f919e2f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:53.733861 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70752dd9fddd4f3cb661f9559f919e2f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:53.736657 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (DEFAULT_TABLE table=default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.737787 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc6395b50b2458fa2d3877eb7ec2ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.739321 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ecd9d9a4dee74635934c5e080aaf28de" } new_table_name: "default.Table_b1334223999b4a9398587fee71103d62" modify_external_catalogs: true
I20260810 13:53:53.740352 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 307a6b609b674afbb684147005b66d87
I20260810 13:53:53.741969 12747 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 458) took 1156 ms. Trace:
I20260810 13:53:53.745836 12742 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_cca21ae655de4f49a5b7db97db5814ac [id=82f67714ca3b4e6aab8557bd0f53d264] alter complete (version 1)
I20260810 13:53:53.746409 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet 307a6b609b674afbb684147005b66d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:53.748497 12742 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 77) took 962 ms (client timeout 1000 ms). Trace:
W20260810 13:53:53.755867 12742 rpcz_store.cc:269] 0810 13:53:52.785966 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.786106 (+ 140us) service_pool.cc:224] Handling call
0810 13:53:53.748447 (+962341us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:53.683597 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:53.683916 (+ 319us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:53.683940 (+ 24us) write_op.cc:435] Acquired schema lock
0810 13:53:53.683953 (+ 13us) tablet.cc:662] Decoding operations
0810 13:53:53.684179 (+ 226us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:53.684213 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:53.684234 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:53.684377 (+ 143us) tablet.cc:701] Row locks acquired
0810 13:53:53.684390 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:53:53.684498 (+ 108us) write_op.cc:270] Start()
0810 13:53:53.684575 (+ 77us) write_op.cc:276] Timestamp: P: 1786370033684171 usec, L: 0
0810 13:53:53.684589 (+ 14us) op_driver.cc:348] REPLICATION: starting
0810 13:53:53.685074 (+ 485us) log.cc:844] Serialized 356 byte log entry
0810 13:53:53.737279 (+ 52205us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.740374 (+ 3095us) write_op.cc:301] APPLY: starting
0810 13:53:53.740442 (+ 68us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.740541 (+ 99us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.740651 (+ 110us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.744848 (+ 4197us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.744968 (+ 120us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:53.745026 (+ 58us) write_op.cc:312] APPLY: finished
0810 13:53:53.745218 (+ 192us) log.cc:844] Serialized 23 byte log entry
0810 13:53:53.745405 (+ 187us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.745467 (+ 62us) write_op.cc:454] Released schema lock
0810 13:53:53.745527 (+ 60us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:53.745814 (+ 287us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.745849 (+ 35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":2940,"apply.run_cpu_time_us":1356,"apply.run_wall_time_us":5360,"num_ops":1,"prepare.queue_time_us":889632,"prepare.run_cpu_time_us":1738,"prepare.run_wall_time_us":3859,"raft.queue_time_us":68,"raft.run_cpu_time_us":23,"raft.run_wall_time_us":24,"replication_time_us":52617}]]}
I20260810 13:53:53.742238 12747 rpcz_store.cc:276] 0810 13:53:52.585300 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.591381 (+ 6081us) service_pool.cc:224] Handling call
0810 13:53:52.760887 (+169506us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c84d6 00007fec6df80b34 00007fec6df80ac2 00007fec6df809f1 00007fec6df8096c 00007fec6df7fc22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.762178 (+ 1291us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:52.773621 (+ 11443us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:52.773789 (+ 168us) catalog_manager.cc:2850] Locking tablets
0810 13:53:52.774359 (+ 570us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:53.739991 (+965632us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:53.740182 (+ 191us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:53.740274 (+ 92us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:53.741914 (+ 1640us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:53.491563 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:53.492223 (+ 660us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:53.492257 (+ 34us) write_op.cc:435] Acquired schema lock
0810 13:53:53.492276 (+ 19us) tablet.cc:662] Decoding operations
0810 13:53:53.492676 (+ 400us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:53.494647 (+ 1971us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:53.494681 (+ 34us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:53.495062 (+ 381us) tablet.cc:701] Row locks acquired
0810 13:53:53.495082 (+ 20us) write_op.cc:260] PREPARE: finished
0810 13:53:53.495217 (+ 135us) write_op.cc:270] Start()
0810 13:53:53.495314 (+ 97us) write_op.cc:276] Timestamp: P: 1786370033494895 usec, L: 0
0810 13:53:53.495336 (+ 22us) op_driver.cc:348] REPLICATION: starting
0810 13:53:53.680418 (+185082us) log.cc:844] Serialized 765 byte log entry
0810 13:53:53.682026 (+ 1608us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e553208 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1 00007fec6e9e650d 00000000005bd8c4 00000000005bd6f9
0810 13:53:53.737053 (+ 55027us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.738079 (+ 1026us) write_op.cc:301] APPLY: starting
0810 13:53:53.738159 (+ 80us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.738294 (+ 135us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.738361 (+ 67us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.738753 (+ 392us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.739033 (+ 280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:53.739093 (+ 60us) write_op.cc:312] APPLY: finished
0810 13:53:53.739344 (+ 251us) log.cc:844] Serialized 29 byte log entry
0810 13:53:53.739572 (+ 228us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.739669 (+ 97us) write_op.cc:454] Released schema lock
0810 13:53:53.739707 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:53.740003 (+ 296us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.740069 (+ 66us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":387061120,"child_traces":[["op",{"apply.queue_time_us":868,"apply.run_cpu_time_us":1864,"apply.run_wall_time_us":1863,"num_ops":2,"prepare.queue_time_us":715231,"prepare.run_cpu_time_us":5613,"prepare.run_wall_time_us":191954,"raft.queue_time_us":4010,"raft.run_cpu_time_us":710,"raft.run_wall_time_us":711,"replication_time_us":241622,"spinlock_wait_cycles":424307072}]]}
I20260810 13:53:53.770538 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_71038e51b4474c5e9e8643d25c35a001" } new_table_name: "default.Table_ed026dd607ea4b2e8b1f22bee438879d" modify_external_catalogs: true
I20260810 13:53:53.773983 13639 tablet_bootstrap.cc:492] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:53.774407 13639 ts_tablet_manager.cc:1403] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.542s user 0.010s sys 0.014s
I20260810 13:53:53.779917 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 49bf6a1f14bb4513b1addc4141b71373 (DEFAULT_TABLE table=default.Table_d4a38708152b4705af7eaf9af6ddc436 [id=5edfc8942f7145adae70b892942fbd64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.781126 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49bf6a1f14bb4513b1addc4141b71373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.787982 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 420ee600a4174916827aa7b64bbcd8d2 (DEFAULT_TABLE table=default.Table_86dcc5d091024407b7e167806ec593a3 [id=c07ecd00b44e49c9b0a32e8710373471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.788977 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420ee600a4174916827aa7b64bbcd8d2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:53.790087 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 142206us
I20260810 13:53:53.805419 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 213e54b67ee94d299345a3d1eabc9ae6 (DEFAULT_TABLE table=default.Table_88dee97116de4d0dac8a7af552b06f14 [id=0b34e431b94a4d24ad26858d4630420f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.806556 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213e54b67ee94d299345a3d1eabc9ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.807183 13639 raft_consensus.cc:359] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.807828 13639 raft_consensus.cc:385] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:53.808054 13639 raft_consensus.cc:740] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:53.805419 13021 tablet_service.cc:1511] Processing CreateTablet for tablet b335455cc01947a3a4ca6c368fea7bad (DEFAULT_TABLE table=default.Table_a232694e27574131946f967d95a292f4 [id=fec6784b9d334a72907abaf252914033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.808820 14888 tablet_replica.cc:333] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:53.809531 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b335455cc01947a3a4ca6c368fea7bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.810249 14888 raft_consensus.cc:2243] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:53.811187 14888 raft_consensus.cc:2272] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:53.779673 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 063e3b74a9a248a1aa0c2de4b4b73a06
I20260810 13:53:53.787117 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 307a6b609b674afbb684147005b66d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:53.814270 12746 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 457) took 1511 ms. Trace:
I20260810 13:53:53.744791 13213 rpcz_store.cc:276] 0810 13:53:52.523175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.533022 (+ 9847us) service_pool.cc:224] Handling call
0810 13:53:52.564188 (+ 31166us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.712971 (+148783us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:53.231986 (+519015us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.667990 (+436004us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.701517 (+ 33527us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:53:53.785840 12739 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 76) took 947 ms (client timeout 1000 ms). Trace:
W20260810 13:53:53.820894 12739 rpcz_store.cc:269] 0810 13:53:52.838094 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:53.198010 (+359916us) service_pool.cc:224] Handling call
0810 13:53:53.246451 (+ 48441us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:53.785525 (+539074us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":106577280}
I20260810 13:53:53.814613 12746 rpcz_store.cc:276] 0810 13:53:52.302850 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.457894 (+155044us) service_pool.cc:224] Handling call
0810 13:53:52.597592 (+139698us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c84d6 00007fec6df80b34 00007fec6df80ac2 00007fec6df809f1 00007fec6df8096c 00007fec6df7fc22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:52.599735 (+ 2143us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:52.600603 (+ 868us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:52.600794 (+ 191us) catalog_manager.cc:2850] Locking tablets
0810 13:53:53.076035 (+475241us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:53.779317 (+703282us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:53.779513 (+ 196us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:53.779595 (+ 82us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:53.814195 (+ 34600us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:53.687550 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:53.687885 (+ 335us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:53.687907 (+ 22us) write_op.cc:435] Acquired schema lock
0810 13:53:53.687918 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:53.688236 (+ 318us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:53.688271 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:53.688294 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:53.688654 (+ 360us) tablet.cc:701] Row locks acquired
0810 13:53:53.688678 (+ 24us) write_op.cc:260] PREPARE: finished
0810 13:53:53.688823 (+ 145us) write_op.cc:270] Start()
0810 13:53:53.688912 (+ 89us) write_op.cc:276] Timestamp: P: 1786370033688493 usec, L: 0
0810 13:53:53.688937 (+ 25us) op_driver.cc:348] REPLICATION: starting
0810 13:53:53.689404 (+ 467us) log.cc:844] Serialized 725 byte log entry
0810 13:53:53.772976 (+ 83572us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.775710 (+ 2734us) write_op.cc:301] APPLY: starting
0810 13:53:53.775780 (+ 70us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.775984 (+ 204us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.776177 (+ 193us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.776594 (+ 417us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.776927 (+ 333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:53.776995 (+ 68us) write_op.cc:312] APPLY: finished
0810 13:53:53.777227 (+ 232us) log.cc:844] Serialized 29 byte log entry
0810 13:53:53.777429 (+ 202us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.777527 (+ 98us) write_op.cc:454] Released schema lock
0810 13:53:53.777582 (+ 55us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:53.777974 (+ 392us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.778003 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":318793600,"child_traces":[["op",{"apply.queue_time_us":2540,"apply.run_cpu_time_us":2178,"apply.run_wall_time_us":2178,"num_ops":2,"prepare.queue_time_us":609532,"prepare.run_cpu_time_us":2109,"prepare.run_wall_time_us":3266,"raft.queue_time_us":68,"raft.run_cpu_time_us":12,"raft.run_wall_time_us":13,"replication_time_us":83895}]]}
I20260810 13:53:53.825162 13003 tablet_service.cc:1558] Processing DeleteTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:53.828873 14911 raft_consensus.cc:493] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:53.829480 14911 raft_consensus.cc:515] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.833282 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 49bf6a1f14bb4513b1addc4141b71373 (DEFAULT_TABLE table=default.Table_d4a38708152b4705af7eaf9af6ddc436 [id=5edfc8942f7145adae70b892942fbd64]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.834216 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:53.836834 14911 leader_election.cc:290] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:53.837240 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 213e54b67ee94d299345a3d1eabc9ae6 (DEFAULT_TABLE table=default.Table_88dee97116de4d0dac8a7af552b06f14 [id=0b34e431b94a4d24ad26858d4630420f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.841480 13213 tablet_service.cc:1511] Processing CreateTablet for tablet b335455cc01947a3a4ca6c368fea7bad (DEFAULT_TABLE table=default.Table_a232694e27574131946f967d95a292f4 [id=fec6784b9d334a72907abaf252914033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.842522 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49bf6a1f14bb4513b1addc4141b71373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.843817 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dea61b84b614ead8830873568f9b7c4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:53.844429 13264 raft_consensus.cc:2468] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:53.822345 14763 raft_consensus.cc:515] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:53.846105 14888 ts_tablet_manager.cc:1916] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:53.849006 13639 consensus_queue.cc:260] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:53.863233 12749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 77) took 1540 ms (client timeout 1000 ms). Trace:
I20260810 13:53:53.887630 13639 ts_tablet_manager.cc:1434] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.113s user 0.005s sys 0.003s
I20260810 13:53:53.891639 13639 tablet_bootstrap.cc:492] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:53:53.863639 12749 rpcz_store.cc:269] 0810 13:53:52.322498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.386230 (+ 63732us) service_pool.cc:224] Handling call
0810 13:53:52.710785 (+324555us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:53.863152 (+1152367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:53.690938 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:53.691284 (+ 346us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:53.691316 (+ 32us) write_op.cc:435] Acquired schema lock
0810 13:53:53.691327 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:53.691547 (+ 220us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:53.691581 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:53.691601 (+ 20us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:53.691734 (+ 133us) tablet.cc:701] Row locks acquired
0810 13:53:53.691746 (+ 12us) write_op.cc:260] PREPARE: finished
0810 13:53:53.691839 (+ 93us) write_op.cc:270] Start()
0810 13:53:53.691912 (+ 73us) write_op.cc:276] Timestamp: P: 1786370033691515 usec, L: 0
0810 13:53:53.691928 (+ 16us) op_driver.cc:348] REPLICATION: starting
0810 13:53:53.692388 (+ 460us) log.cc:844] Serialized 527 byte log entry
0810 13:53:53.773390 (+ 81002us) op_driver.cc:464] REPLICATION: finished
0810 13:53:53.778302 (+ 4912us) write_op.cc:301] APPLY: starting
0810 13:53:53.778364 (+ 62us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:53.778473 (+ 109us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:53.778560 (+ 87us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:53.778806 (+ 246us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:53.778958 (+ 152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:53.779024 (+ 66us) write_op.cc:312] APPLY: finished
0810 13:53:53.779963 (+ 939us) log.cc:844] Serialized 23 byte log entry
0810 13:53:53.780103 (+ 140us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.780215 (+ 112us) write_op.cc:454] Released schema lock
0810 13:53:53.780267 (+ 52us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:53.780618 (+ 351us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:53.780673 (+ 55us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":17,"spinlock_wait_cycles":38205312,"child_traces":[["op",{"apply.queue_time_us":4754,"apply.run_cpu_time_us":1485,"apply.run_wall_time_us":2222,"num_ops":1,"prepare.queue_time_us":95945,"prepare.run_cpu_time_us":1691,"prepare.run_wall_time_us":2715,"raft.queue_time_us":71,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":11,"replication_time_us":81296}]]}
I20260810 13:53:53.903208 13022 tablet_service.cc:1511] Processing CreateTablet for tablet e7553445e6124227872c0f2306940225 (DEFAULT_TABLE table=default.Table_2c6e1c408acb44358898a1a4ff356bdd [id=909cf43e9f9e4d439f8f246cef081d56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.906821 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7553445e6124227872c0f2306940225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.904489 14389 ts_tablet_manager.cc:1929] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:53.909263 14389 log.cc:1199] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/f62023d553cd46cab920de44baa96eec
I20260810 13:53:53.712890 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a7bddc8e6374437a37aeb755389d91f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.913278 14389 ts_tablet_manager.cc:1950] T f62023d553cd46cab920de44baa96eec P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:53.880596 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6ac40be3cf9b4f9d8a8f29bec786be18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:53.918113 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:53.928620 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:53.950635 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 61169145c539464fa9cf62eaaf8168e5
I20260810 13:53:53.952570 12745 catalog_manager.cc:6807] ReplaceTablet: tablet 61169145c539464fa9cf62eaaf8168e5 deleted and replaced by tablet 73c03f98d7804d22acbba72da63c121b
I20260810 13:53:53.957118 13012 tablet_service.cc:1558] Processing DeleteTablet for tablet 61169145c539464fa9cf62eaaf8168e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73c03f98d7804d22acbba72da63c121b) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:53.968178 13442 tablet_service.cc:1511] Processing CreateTablet for tablet dd58cc128ce64f9abe1418b6093a1c2c (DEFAULT_TABLE table=default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.971542 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b335455cc01947a3a4ca6c368fea7bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.972860 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 420ee600a4174916827aa7b64bbcd8d2 (DEFAULT_TABLE table=default.Table_86dcc5d091024407b7e167806ec593a3 [id=c07ecd00b44e49c9b0a32e8710373471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.973969 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420ee600a4174916827aa7b64bbcd8d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.974545 13434 tablet_service.cc:1558] Processing DeleteTablet for tablet 307a6b609b674afbb684147005b66d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:53.977309 13639 tablet_bootstrap.cc:654] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:53.979067 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 303) took 1849 ms. Trace:
I20260810 13:53:53.979387 14389 rpcz_store.cc:276] 0810 13:53:52.129448 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.129994 (+ 546us) service_pool.cc:224] Handling call
0810 13:53:53.487232 (+1357238us) ts_tablet_manager.cc:1151] Deleting tablet f62023d553cd46cab920de44baa96eec
0810 13:53:53.487272 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:53.863775 (+376503us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.904369 (+ 40594us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.979003 (+ 74634us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1356685}
I20260810 13:53:53.986157 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (DEFAULT_TABLE table=default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:53.987335 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dc6395b50b2458fa2d3877eb7ec2ade. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.989750 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd58cc128ce64f9abe1418b6093a1c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:53.980656 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 309) took 1458 ms. Trace:
I20260810 13:53:53.992892 14389 rpcz_store.cc:276] 0810 13:53:52.522581 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.524955 (+ 2374us) service_pool.cc:224] Handling call
0810 13:53:53.980305 (+1455350us) ts_tablet_manager.cc:1151] Deleting tablet 69ecda19e4f143c99654aff6058ad8bb
0810 13:53:53.980345 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:53.980605 (+ 260us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1450321}
I20260810 13:53:53.985699 13638 ts_tablet_manager.cc:1434] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.544s user 0.005s sys 0.015s
I20260810 13:53:53.973747 14957 raft_consensus.cc:493] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:53:53.994031 13638 ts_tablet_manager.cc:1467] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: Tablet startup took 551ms
I20260810 13:53:53.985976 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:53.999884 13217 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 315) took 1277 ms. Trace:
I20260810 13:53:54.000216 13217 rpcz_store.cc:276] 0810 13:53:52.722175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.760051 (+ 37876us) service_pool.cc:224] Handling call
0810 13:53:52.766480 (+ 6429us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.766569 (+ 89us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:53.563731 (+797162us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.999392 (+435661us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.999826 (+ 434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:53.989264 13216 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 321) took 1265 ms. Trace:
I20260810 13:53:54.003492 13216 rpcz_store.cc:276] 0810 13:53:52.724176 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.747035 (+ 22859us) service_pool.cc:224] Handling call
0810 13:53:52.776544 (+ 29509us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.776638 (+ 94us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:53.554271 (+777633us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.963904 (+409633us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.989204 (+ 25300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:54.004768 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 49bf6a1f14bb4513b1addc4141b71373 (DEFAULT_TABLE table=default.Table_d4a38708152b4705af7eaf9af6ddc436 [id=5edfc8942f7145adae70b892942fbd64]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:53.995988 13638 ts_tablet_manager.cc:1469] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: Trace:
0810 13:53:33.671200 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:33.679784 (+ 8584us) service_pool.cc:224] Handling call
0810 13:53:33.687843 (+ 8059us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:33.687941 (+ 98us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:33.831217 (+143276us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:34.066839 (+235622us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:34.070118 (+ 3279us) inbound_call.cc:177] Queueing success response
0810 13:53:51.767127 (+17697009us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:53:53.458709 (+1691582us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:53:53.519618 (+ 60909us) tablet_replica.cc:261] Starting instrumentation
0810 13:53:53.520084 (+ 466us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":301901,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":220,"tablet-open.queue_time_us":17697061,"thread_start_us":221982,"threads_started":1}
I20260810 13:53:54.006141 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49bf6a1f14bb4513b1addc4141b71373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:54.006609 13638 tablet_bootstrap.cc:492] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:54.009244 13432 tablet_service.cc:1511] Processing CreateTablet for tablet 97015b4984c74a4682b6dedd47dc6650 (DEFAULT_TABLE table=default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:54.010416 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97015b4984c74a4682b6dedd47dc6650. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:54.015738 12744 master_service.cc:960] ReplaceTablet: received request to replace tablet 61fd4d043c354ad79d79c32498a469b4 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:54.016763 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 313) took 1492 ms. Trace:
I20260810 13:53:54.017155 14389 rpcz_store.cc:276] 0810 13:53:52.524599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.536943 (+ 12344us) service_pool.cc:224] Handling call
0810 13:53:53.994514 (+1457571us) ts_tablet_manager.cc:1151] Deleting tablet 3db559714d84493ebaf7d3b51719d81c
0810 13:53:53.994559 (+ 45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:54.016702 (+ 22143us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1455972}
W20260810 13:53:54.018491 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 223742us
I20260810 13:53:53.990501 14763 leader_election.cc:290] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:54.019665 14763 consensus_queue.cc:1048] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:54.022200 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 317) took 1299 ms. Trace:
I20260810 13:53:54.022718 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ff9e8a8ca845b89154ed0626d34c5c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:54.022622 14389 rpcz_store.cc:276] 0810 13:53:52.722810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.724835 (+ 2025us) service_pool.cc:224] Handling call
0810 13:53:54.018922 (+1294087us) ts_tablet_manager.cc:1151] Deleting tablet 5bab4d93f7dc4c88bbed9cb83961bb2e
0810 13:53:54.018968 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:54.022148 (+ 3180us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1292654}
I20260810 13:53:54.023324 13040 raft_consensus.cc:3060] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 2
I20260810 13:53:54.028928 14957 raft_consensus.cc:515] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.031243 13040 raft_consensus.cc:2468] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
W20260810 13:53:54.032580 13167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:53:54.034407 13167 consensus_peers.cc:597] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:53:54.034493 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1c6686175347496093cb22ce8a3d4176 consensus state has no leader
I20260810 13:53:54.034904 13167 leader_election.cc:304] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:54.035741 13216 tablet_service.cc:1558] Processing DeleteTablet for tablet 61169145c539464fa9cf62eaaf8168e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73c03f98d7804d22acbba72da63c121b) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:54.036304 14957 leader_election.cc:290] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:54.036600 14959 raft_consensus.cc:2804] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:53:54.037170 14959 raft_consensus.cc:697] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:53.909337 13425 rpcz_store.cc:276] 0810 13:53:52.325975 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.326821 (+ 846us) service_pool.cc:224] Handling call
0810 13:53:52.732053 (+405232us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.732160 (+ 107us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:53.536841 (+804681us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:53.673208 (+136367us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:53.673921 (+ 713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:53:54.037223 13227 tablet_service.cc:1511] Processing CreateTablet for tablet e7553445e6124227872c0f2306940225 (DEFAULT_TABLE table=default.Table_2c6e1c408acb44358898a1a4ff356bdd [id=909cf43e9f9e4d439f8f246cef081d56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:54.038407 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7553445e6124227872c0f2306940225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:54.038208 14959 consensus_queue.cc:237] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.049643 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213e54b67ee94d299345a3d1eabc9ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:54.050158 13425 tablet_service.cc:1511] Processing CreateTablet for tablet b335455cc01947a3a4ca6c368fea7bad (DEFAULT_TABLE table=default.Table_a232694e27574131946f967d95a292f4 [id=fec6784b9d334a72907abaf252914033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:54.051836 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b335455cc01947a3a4ca6c368fea7bad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:54.063508 13640 tablet_bootstrap.cc:654] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:54.024114 14389 tablet_replica.cc:333] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:54.067242 13639 tablet_bootstrap.cc:492] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:54.067662 13639 ts_tablet_manager.cc:1403] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.176s user 0.007s sys 0.002s
I20260810 13:53:54.078258 13639 raft_consensus.cc:359] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.094290 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:54.094987 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dea61b84b614ead8830873568f9b7c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:54.095582 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet c4db9d7e82414cab8a69618effe89b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:54.097046 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 213e54b67ee94d299345a3d1eabc9ae6 (DEFAULT_TABLE table=default.Table_88dee97116de4d0dac8a7af552b06f14 [id=0b34e431b94a4d24ad26858d4630420f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:54.098299 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 213e54b67ee94d299345a3d1eabc9ae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:54.099642 13419 tablet_service.cc:1511] Processing CreateTablet for tablet e7553445e6124227872c0f2306940225 (DEFAULT_TABLE table=default.Table_2c6e1c408acb44358898a1a4ff356bdd [id=909cf43e9f9e4d439f8f246cef081d56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:54.100970 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7553445e6124227872c0f2306940225. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:54.102203 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:54.107640 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 61169145c539464fa9cf62eaaf8168e5 with delete_type TABLET_DATA_DELETED (replaced by tablet 73c03f98d7804d22acbba72da63c121b) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:54.114537 12441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 322960us
I20260810 13:53:54.131466 14389 raft_consensus.cc:2243] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:54.132422 14389 raft_consensus.cc:2272] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:54.135138 14389 ts_tablet_manager.cc:1916] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:54.150645 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet 35ba701a453546088933416d17e71127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:54.128918 14842 consensus_queue.cc:1048] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260810 13:53:54.167245 13639 raft_consensus.cc:385] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.167627 13639 raft_consensus.cc:740] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:54.161051 13638 tablet_bootstrap.cc:654] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:54.098366 14888 ts_tablet_manager.cc:1929] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:54.115418 12952 leader_election.cc:304] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:53:54.170075 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 54776.8us
I20260810 13:53:54.170706 14911 raft_consensus.cc:2804] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:54.171075 14911 raft_consensus.cc:493] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:54.171384 14911 raft_consensus.cc:3060] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:54.178601 14911 raft_consensus.cc:515] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.182447 14911 leader_election.cc:290] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:54.183086 14888 log.cc:1199] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/307a6b609b674afbb684147005b66d87
I20260810 13:53:54.183961 14888 ts_tablet_manager.cc:1950] T 307a6b609b674afbb684147005b66d87 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:54.219867 13638 tablet_bootstrap.cc:492] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:54.220443 13638 ts_tablet_manager.cc:1403] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.214s user 0.011s sys 0.002s
I20260810 13:53:54.168479 13639 consensus_queue.cc:260] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.223467 13639 ts_tablet_manager.cc:1434] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.148s user 0.005s sys 0.001s
I20260810 13:53:54.077536 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet f62023d553cd46cab920de44baa96eec (table default.Table_65f3e467e91b454799305f55c1a236ef [id=e8338009e3ca44ae81d7b7b7d533713f]) successfully deleted
W20260810 13:53:54.233533 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 156019us
W20260810 13:53:54.234212 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 69ecda19e4f143c99654aff6058ad8bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69ecda19e4f143c99654aff6058ad8bb already in progress: creating tablet
W20260810 13:53:54.235889 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 3db559714d84493ebaf7d3b51719d81c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3db559714d84493ebaf7d3b51719d81c already in progress: creating tablet
W20260810 13:53:54.236584 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bab4d93f7dc4c88bbed9cb83961bb2e already in progress: creating tablet
I20260810 13:53:54.241087 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d245ed8e62804322bd2ec1f6572bc55b" } modify_external_catalogs: true
I20260810 13:53:54.241582 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d245ed8e62804322bd2ec1f6572bc55b" } modify_external_catalogs: true
I20260810 13:53:54.239408 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dea61b84b614ead8830873568f9b7c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:54.247905 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:54.248608 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet f62023d553cd46cab920de44baa96eec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:54.250511 14888 tablet_replica.cc:333] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:54.251686 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]) successfully deleted
W20260810 13:53:54.252424 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 063e3b74a9a248a1aa0c2de4b4b73a06 already in progress: creating tablet
W20260810 13:53:54.269088 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 61169145c539464fa9cf62eaaf8168e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61169145c539464fa9cf62eaaf8168e5 already in progress: creating tablet
I20260810 13:53:54.281095 14888 raft_consensus.cc:2243] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:54.281612 14888 raft_consensus.cc:2272] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:54.260263 13638 raft_consensus.cc:359] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.283542 13638 raft_consensus.cc:385] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.283867 13638 raft_consensus.cc:740] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:54.284511 14888 ts_tablet_manager.cc:1916] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:54.254745 13639 tablet_bootstrap.cc:492] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:54.291854 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c80bc85fe25433ab2559ea0ada61978" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:54.293530 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dea61b84b614ead8830873568f9b7c4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:54.294059 13470 raft_consensus.cc:2468] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:54.295490 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dea61b84b614ead8830873568f9b7c4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:54.296025 13470 raft_consensus.cc:3060] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:54.297219 13638 consensus_queue.cc:260] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.301445 13638 ts_tablet_manager.cc:1434] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.080s user 0.005s sys 0.001s
I20260810 13:53:54.304872 13470 raft_consensus.cc:2468] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:54.305985 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:54.308903 13638 tablet_bootstrap.cc:492] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:54.317672 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dea61b84b614ead8830873568f9b7c4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:54.318251 13264 raft_consensus.cc:3060] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:54.321456 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:54.322088 13040 raft_consensus.cc:2468] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:54.324025 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:54.325618 13261 raft_consensus.cc:3060] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:54.328903 13264 raft_consensus.cc:2468] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:54.330129 13639 tablet_bootstrap.cc:654] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:54.358402 14389 ts_tablet_manager.cc:1929] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:54.358791 14389 log.cc:1199] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/307a6b609b674afbb684147005b66d87
I20260810 13:53:54.359517 14389 ts_tablet_manager.cc:1950] T 307a6b609b674afbb684147005b66d87 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:54.367491 13638 tablet_bootstrap.cc:654] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:54.373144 13640 tablet_bootstrap.cc:492] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:54.373562 13640 ts_tablet_manager.cc:1403] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.756s user 0.009s sys 0.019s
I20260810 13:53:54.376039 13640 raft_consensus.cc:359] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.376755 13640 raft_consensus.cc:385] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.376997 13640 raft_consensus.cc:740] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:54.377682 13640 consensus_queue.cc:260] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.379509 14273 ts_tablet_manager.cc:1929] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:54.379849 14273 log.cc:1199] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/8c80bc85fe25433ab2559ea0ada61978
I20260810 13:53:54.382208 13640 ts_tablet_manager.cc:1434] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20260810 13:53:54.384985 14273 ts_tablet_manager.cc:1950] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:54.387091 13639 tablet_bootstrap.cc:492] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:54.387538 13639 ts_tablet_manager.cc:1403] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.133s user 0.008s sys 0.002s
I20260810 13:53:54.391047 12952 leader_election.cc:304] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:53:54.391695 12952 raft_consensus.cc:2686] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:54.392314 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a2cd133674544036a9b6a207612749a4" } modify_external_catalogs: true
I20260810 13:53:54.392915 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a2cd133674544036a9b6a207612749a4" } modify_external_catalogs: true
I20260810 13:53:54.392869 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_12828de8d2fe4b32bf5d775a9ad9019b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:54.394559 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_12828de8d2fe4b32bf5d775a9ad9019b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.396860 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]) successfully deleted
W20260810 13:53:54.397312 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7c57ca566cfe47f6a331bbbe5c344a89 has no consensus state
I20260810 13:53:54.397857 14389 tablet_replica.cc:333] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:54.398434 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d171e1a65676495882912f18dddff2ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:54.398924 14389 raft_consensus.cc:2243] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Raft consensus shutting down.
I20260810 13:53:54.399791 14389 pending_rounds.cc:70] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
W20260810 13:53:54.399858 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d171e1a65676495882912f18dddff2ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.400084 14389 pending_rounds.cc:77] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7316971659437547520 op_type: NO_OP noop_request { }
I20260810 13:53:54.401387 14389 raft_consensus.cc:2889] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:54.405194 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4f02931df6b0437a9cb7869b14b73084"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:54.406556 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f02931df6b0437a9cb7869b14b73084 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.433010 14911 raft_consensus.cc:493] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:54.433693 14911 raft_consensus.cc:515] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.436453 14911 leader_election.cc:290] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:54.445351 12952 leader_election.cc:343] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 35c43f7f8b7e4e56b5edbabe242c9dde
I20260810 13:53:54.390179 13639 raft_consensus.cc:359] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.449136 13639 raft_consensus.cc:385] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.449553 13639 raft_consensus.cc:740] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:54.469223 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:54.450489 13639 consensus_queue.cc:260] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.485867 14911 raft_consensus.cc:493] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:54.486364 14911 raft_consensus.cc:515] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.489557 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 303) took 4910 ms. Trace:
I20260810 13:53:54.489542 14911 leader_election.cc:290] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:54.471019 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:54.489910 14273 rpcz_store.cc:276] 0810 13:53:49.578931 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.579553 (+ 622us) service_pool.cc:224] Handling call
0810 13:53:53.001842 (+3422289us) ts_tablet_manager.cc:1151] Deleting tablet 8c80bc85fe25433ab2559ea0ada61978
0810 13:53:53.001895 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:53.585156 (+583261us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54000e1ad4. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb881f53951 00007fb881ff2742 00007fb882432d2c 00007fb88309a41a 00007fb8830cb0e0 00007fb8830b164d 00007fb8830b15f9 00007fb8830b1589 00007fb8830b1551 00007fb8830b077d 00000000005bd8c4
0810 13:53:53.828124 (+242968us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.379391 (+551267us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.489491 (+110100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840197376,"tablet-delete.queue_time_us":3421601}
I20260810 13:53:54.491097 14389 raft_consensus.cc:2272] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:54.491617 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 304) took 4661 ms. Trace:
I20260810 13:53:54.491930 14273 rpcz_store.cc:276] 0810 13:53:49.829817 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:49.834798 (+ 4981us) service_pool.cc:224] Handling call
0810 13:53:54.491216 (+4656418us) ts_tablet_manager.cc:1151] Deleting tablet f19e7aa805bd417eae45fb43ac18a66d
0810 13:53:54.491262 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:54.491563 (+ 301us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4655835}
I20260810 13:53:54.492806 13638 tablet_bootstrap.cc:492] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:54.492931 14273 tablet_replica.cc:333] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:54.493163 13640 tablet_bootstrap.cc:492] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:54.493289 13638 ts_tablet_manager.cc:1403] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.188s user 0.005s sys 0.005s
I20260810 13:53:54.493610 14273 raft_consensus.cc:2243] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:54.494221 14273 raft_consensus.cc:2272] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:54.497177 14273 ts_tablet_manager.cc:1916] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:54.499840 13639 ts_tablet_manager.cc:1434] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.112s user 0.001s sys 0.004s
I20260810 13:53:54.512670 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4946f79b54c46b1a59edf169109ab47" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:54.513662 13043 raft_consensus.cc:1240] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
W20260810 13:53:54.516130 12952 leader_election.cc:343] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:54.517539 14389 ts_tablet_manager.cc:1916] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:54.520926 12951 leader_election.cc:343] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: Tablet not RUNNING: STOPPED
I20260810 13:53:54.521443 12951 leader_election.cc:304] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:53:54.522154 12951 raft_consensus.cc:2686] T 8c80bc85fe25433ab2559ea0ada61978 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:53:54.524935 12951 leader_election.cc:304] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:54.535471 13639 tablet_bootstrap.cc:492] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:54.538448 13640 tablet_bootstrap.cc:654] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:54.538655 14273 ts_tablet_manager.cc:1929] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:54.538980 14273 log.cc:1199] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/d9ada39233e9421d9870565c73f2ee16
I20260810 13:53:54.539695 14273 ts_tablet_manager.cc:1950] T d9ada39233e9421d9870565c73f2ee16 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:54.539520 13638 raft_consensus.cc:359] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.540206 13638 raft_consensus.cc:385] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.540479 13638 raft_consensus.cc:740] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:54.542009 14911 raft_consensus.cc:2749] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:53:54.547377 13382 leader_election.cc:343] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 8c80bc85fe25433ab2559ea0ada61978
W20260810 13:53:54.548749 13382 leader_election.cc:343] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:54.548990 13638 consensus_queue.cc:260] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.563170 14939 consensus_queue.cc:1048] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:54.564488 13638 ts_tablet_manager.cc:1434] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.071s user 0.006s sys 0.000s
W20260810 13:53:54.577930 13382 leader_election.cc:343] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:54.585279 13638 tablet_bootstrap.cc:492] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:54.585080 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07ff9e8a8ca845b89154ed0626d34c5c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:54.585536 13639 tablet_bootstrap.cc:654] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:54.588156 14939 raft_consensus.cc:493] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:54.588968 14939 raft_consensus.cc:515] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.591368 14939 leader_election.cc:290] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:54.591861 13638 tablet_bootstrap.cc:654] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:54.598690 14888 ts_tablet_manager.cc:1929] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:54.599093 14888 log.cc:1199] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/4dea61b84b614ead8830873568f9b7c4
I20260810 13:53:54.599763 14888 ts_tablet_manager.cc:1950] T 4dea61b84b614ead8830873568f9b7c4 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:54.603272 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2064484b9e46478f9efb67e9f24d6dd5" } new_table_name: "default.Table_080235e72e36450ba5d17b341d2f2b2e" modify_external_catalogs: true
I20260810 13:53:54.610042 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d3cce811ecf44ac8922775c36db30fba" } new_table_name: "default.Table_774345b28c70458f95bf2fcd0e4f42cb" modify_external_catalogs: true
I20260810 13:53:54.616868 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 306) took 4286 ms. Trace:
I20260810 13:53:54.617293 14273 rpcz_store.cc:276] 0810 13:53:50.330636 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:50.331066 (+ 430us) service_pool.cc:224] Handling call
0810 13:53:54.492784 (+4161718us) ts_tablet_manager.cc:1151] Deleting tablet d9ada39233e9421d9870565c73f2ee16
0810 13:53:54.492820 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:54.519344 (+ 26524us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.538540 (+ 19196us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.616784 (+ 78244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61582,"tablet-delete.queue_time_us":4161077}
I20260810 13:53:54.621017 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 8c80bc85fe25433ab2559ea0ada61978 (table default.Table_723061893666401a9728e4a49b584f5f [id=8aaef23848b848bebe6d6d9069d961fd]) successfully deleted
W20260810 13:53:54.621639 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet f19e7aa805bd417eae45fb43ac18a66d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f19e7aa805bd417eae45fb43ac18a66d already in progress: creating tablet
W20260810 13:53:54.645078 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d36f17094e504d80a2443dc12855c744 consensus state has no leader
W20260810 13:53:54.646004 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3610bc4f8a0742fdb69347b40a04f078 has no consensus state
I20260810 13:53:54.649402 13640 tablet_bootstrap.cc:492] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:54.649977 13640 ts_tablet_manager.cc:1403] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.157s user 0.006s sys 0.011s
I20260810 13:53:54.655318 14888 tablet_replica.cc:333] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:54.656385 14888 raft_consensus.cc:2243] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:54.657353 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8eeb870902124e9696cfa7e98dfa0e88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:54.658746 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 309) took 2681 ms. Trace:
W20260810 13:53:54.659030 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8eeb870902124e9696cfa7e98dfa0e88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.659128 14273 rpcz_store.cc:276] 0810 13:53:51.977058 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:51.977834 (+ 776us) service_pool.cc:224] Handling call
0810 13:53:54.618416 (+2640582us) ts_tablet_manager.cc:1151] Deleting tablet f922c9ca51044dcda08b245010ab06b0
0810 13:53:54.618465 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:54.658661 (+ 40196us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2639493}
I20260810 13:53:54.660213 14273 tablet_replica.cc:333] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:54.660981 14273 raft_consensus.cc:2243] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:54.661787 14273 raft_consensus.cc:2272] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:54.661768 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8a99e35fd2274affb747df98a59aa265"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:54.664566 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a99e35fd2274affb747df98a59aa265 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.665474 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_066011dcc620407a8cd316bb975b735b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:54.667255 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_066011dcc620407a8cd316bb975b735b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.674968 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2c102382734913bffb5436e06fe0a1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:54.678731 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_acc827f97bb244f59d2eed071cc9bd55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:54.680073 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acc827f97bb244f59d2eed071cc9bd55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.690570 13640 raft_consensus.cc:359] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.691190 13640 raft_consensus.cc:385] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.691449 13640 raft_consensus.cc:740] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:54.692919 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35c43f7f8b7e4e56b5edbabe242c9dde" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:54.694195 13480 raft_consensus.cc:2393] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:54.697589 14273 ts_tablet_manager.cc:1916] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:54.701133 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4946f79b54c46b1a59edf169109ab47" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:54.701907 13480 raft_consensus.cc:2468] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:54.711047 13382 leader_election.cc:304] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:53:54.717331 14939 raft_consensus.cc:2804] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:54.718030 14939 raft_consensus.cc:493] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:54.718686 14939 raft_consensus.cc:3060] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:54.733605 13640 consensus_queue.cc:260] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.741565 12739 master_service.cc:960] ReplaceTablet: received request to replace tablet ef59f7013ab4489dadd9084d065533a8 from {username='slave'} at 127.0.0.1:48758
W20260810 13:53:54.740904 13382 leader_election.cc:343] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 8c80bc85fe25433ab2559ea0ada61978
I20260810 13:53:54.745656 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 4dea61b84b614ead8830873568f9b7c4 (table default.Table_6b195ecd5f17492f81064d6d53d8fde9 [id=e4c6b90e139246beac835146660eb0ad]) successfully deleted
I20260810 13:53:54.749127 14888 raft_consensus.cc:2272] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:54.743137 13640 ts_tablet_manager.cc:1434] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.093s user 0.006s sys 0.002s
I20260810 13:53:54.752300 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2c102382734913bffb5436e06fe0a1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:54.743294 13382 leader_election.cc:304] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:54.753593 13382 raft_consensus.cc:2686] T 8c80bc85fe25433ab2559ea0ada61978 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:53:54.755899 13382 consensus_peers.cc:597] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c4db9d7e82414cab8a69618effe89b40. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:54.746992 14939 raft_consensus.cc:515] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.759895 13640 tablet_bootstrap.cc:492] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:54.760449 14939 leader_election.cc:290] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:54.765269 13640 tablet_bootstrap.cc:654] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:54.768244 14888 ts_tablet_manager.cc:1916] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:54.768507 13382 leader_election.cc:343] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:54.768918 13382 leader_election.cc:304] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:54.770174 14273 ts_tablet_manager.cc:1929] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:54.770548 14273 log.cc:1199] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/2d04860a72c64a5db966e2784c6dbbf0
I20260810 13:53:54.771304 14273 ts_tablet_manager.cc:1950] T 2d04860a72c64a5db966e2784c6dbbf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:54.772455 14956 raft_consensus.cc:2749] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:54.773044 14956 consensus_queue.cc:1059] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:54.774036 14956 raft_consensus.cc:3055] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:53:54.774344 14956 raft_consensus.cc:740] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:54.775134 14956 consensus_queue.cc:260] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.771404 13639 tablet_bootstrap.cc:492] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:54.776813 14956 raft_consensus.cc:3060] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:53:54.778662 13639 ts_tablet_manager.cc:1403] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.243s user 0.010s sys 0.001s
I20260810 13:53:54.788393 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 310) took 2802 ms. Trace:
I20260810 13:53:54.788810 14273 rpcz_store.cc:276] 0810 13:53:51.986005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:51.986179 (+ 174us) service_pool.cc:224] Handling call
0810 13:53:54.660051 (+2673872us) ts_tablet_manager.cc:1151] Deleting tablet 2d04860a72c64a5db966e2784c6dbbf0
0810 13:53:54.660097 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:54.763332 (+103235us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.770052 (+ 6720us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.788327 (+ 18275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14521,"tablet-delete.queue_time_us":2672949}
I20260810 13:53:54.790014 14273 tablet_replica.cc:333] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:54.790758 14273 raft_consensus.cc:2243] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:54.791146 14273 pending_rounds.cc:70] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: Trying to abort 1 pending ops.
I20260810 13:53:54.791446 14273 pending_rounds.cc:77] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971650114699264 op_type: NO_OP noop_request { }
I20260810 13:53:54.791852 14273 raft_consensus.cc:2889] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:54.792223 14273 raft_consensus.cc:2272] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:54.793955 14273 ts_tablet_manager.cc:1916] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:53:54.795400 13382 leader_election.cc:343] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:54.797216 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet d9ada39233e9421d9870565c73f2ee16 (table default.Table_845b7e0e51384b20b1eac181c1e04ddf [id=8b40d86ec18340c195bbf61f215c729d]) successfully deleted
W20260810 13:53:54.798022 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet f922c9ca51044dcda08b245010ab06b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f922c9ca51044dcda08b245010ab06b0 already in progress: creating tablet
I20260810 13:53:54.800319 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 2d04860a72c64a5db966e2784c6dbbf0 (table default.Table_81b4a7eba14c4cc4835272fbaf08f02a [id=0f2a8fd26a9043059d6b3d36c0ad03d1]) successfully deleted
I20260810 13:53:54.800482 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:54.806303 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:54.806979 13049 raft_consensus.cc:3060] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:54.812103 14389 ts_tablet_manager.cc:1929] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260810 13:53:54.814649 13049 raft_consensus.cc:2468] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:54.821197 13639 raft_consensus.cc:359] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.821926 13639 raft_consensus.cc:385] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.821844 12951 leader_election.cc:304] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:54.822247 13639 raft_consensus.cc:740] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:54.831321 14389 log.cc:1199] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/07ff9e8a8ca845b89154ed0626d34c5c
I20260810 13:53:54.837385 14389 ts_tablet_manager.cc:1950] T 07ff9e8a8ca845b89154ed0626d34c5c P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
W20260810 13:53:54.841485 13382 leader_election.cc:343] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:54.841905 13382 leader_election.cc:304] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:54.842804 12951 leader_election.cc:304] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:53:54.843094 14939 raft_consensus.cc:2749] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:54.839644 13639 consensus_queue.cc:260] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.845392 15023 tablet.cc:1724] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260810 13:53:54.848428 13382 leader_election.cc:343] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:54.849821 13638 tablet_bootstrap.cc:492] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:54.850322 13638 ts_tablet_manager.cc:1403] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.265s user 0.010s sys 0.000s
I20260810 13:53:54.850916 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 333) took 1032 ms. Trace:
I20260810 13:53:54.859057 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_70752dd9fddd4f3cb661f9559f919e2f" } new_table_name: "default.Table_3aad155393f44ed3b89b9ac05910d12f" modify_external_catalogs: true
I20260810 13:53:54.863281 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_07c236dd619a4225bd511e9706e5a0e1" } new_table_name: "default.Table_b4cf164b5bd14203bc5fefcc974c263e" modify_external_catalogs: true
I20260810 13:53:54.872820 13640 tablet_bootstrap.cc:492] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:54.873240 13640 ts_tablet_manager.cc:1403] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.114s user 0.008s sys 0.004s
W20260810 13:53:54.884301 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d647bf5c1ba42f48186661310065448 has no consensus state
I20260810 13:53:54.895161 13640 raft_consensus.cc:359] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.895908 13640 raft_consensus.cc:385] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.898118 13640 raft_consensus.cc:740] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:54.901501 13640 consensus_queue.cc:260] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:54.902231 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2def1317e7bc4c5eae5c93264da6d3c9 has no consensus state
I20260810 13:53:54.906702 13640 ts_tablet_manager.cc:1434] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.033s user 0.004s sys 0.003s
I20260810 13:53:54.907819 13640 tablet_bootstrap.cc:492] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:54.908859 13639 ts_tablet_manager.cc:1434] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.128s user 0.007s sys 0.000s
I20260810 13:53:54.873880 13638 raft_consensus.cc:359] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.909741 13638 raft_consensus.cc:385] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.910305 13638 raft_consensus.cc:740] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:54.911444 13638 consensus_queue.cc:260] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.860826 14911 raft_consensus.cc:3060] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:54.928808 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d8ab37a103a5426b81dcf295239ec9af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:54.930049 14273 ts_tablet_manager.cc:1929] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260810 13:53:54.930656 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8ab37a103a5426b81dcf295239ec9af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.910387 15024 tablet.cc:1724] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:54.936137 13638 ts_tablet_manager.cc:1434] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.086s user 0.008s sys 0.000s
I20260810 13:53:54.936914 14273 log.cc:1199] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/f62023d553cd46cab920de44baa96eec
I20260810 13:53:54.937821 14273 ts_tablet_manager.cc:1950] T f62023d553cd46cab920de44baa96eec P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:54.940176 14389 rpcz_store.cc:276] 0810 13:53:53.818610 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:53.834039 (+ 15429us) service_pool.cc:224] Handling call
0810 13:53:54.397669 (+563630us) ts_tablet_manager.cc:1151] Deleting tablet 07ff9e8a8ca845b89154ed0626d34c5c
0810 13:53:54.397715 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:54.580906 (+183191us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.811969 (+231063us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.850856 (+ 38887us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":563045}
I20260810 13:53:54.942399 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 07ff9e8a8ca845b89154ed0626d34c5c (table default.Table_9656a7ccd188461fa55387c96150bb80 [id=1531ea1f96db44c8918e0d74570c0ffd]) successfully deleted
I20260810 13:53:54.942765 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 313) took 2743 ms. Trace:
I20260810 13:53:54.936314 15023 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 339) took 1280 ms. Trace:
I20260810 13:53:54.944042 15023 rpcz_store.cc:276] 0810 13:53:53.656172 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:53.713870 (+ 57698us) service_pool.cc:224] Handling call
0810 13:53:54.936245 (+1222375us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:53.715123 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:53.715724 (+ 601us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:53.715785 (+ 61us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:53.715883 (+ 98us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:53.716037 (+ 154us) alter_schema_op.cc:128] START. Timestamp: 1786370033714782
0810 13:53:53.716066 (+ 29us) op_driver.cc:348] REPLICATION: starting
0810 13:53:53.716738 (+ 672us) log.cc:844] Serialized 173 byte log entry
0810 13:53:54.829564 (+1112826us) op_driver.cc:464] REPLICATION: finished
0810 13:53:54.845273 (+ 15709us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:53:54.847592 (+ 2319us) log.cc:844] Serialized 5 byte log entry
0810 13:53:54.919964 (+ 72372us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.935120 (+ 15156us) log.cc:844] Serialized 14 byte log entry
0810 13:53:54.936003 (+ 883us) alter_schema_op.cc:73] Released schema lock
0810 13:53:54.936056 (+ 53us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":15435,"prepare.queue_time_us":128,"prepare.run_cpu_time_us":25552,"prepare.run_wall_time_us":476231,"replication_time_us":1113206,"thread_start_us":417841,"threads_started":2,"wal-append.queue_time_us":263167}]]}
I20260810 13:53:54.948436 13638 tablet_bootstrap.cc:492] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:54.953128 15029 tablet.cc:1724] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:54.956527 14911 raft_consensus.cc:2749] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:54.943043 14273 rpcz_store.cc:276] 0810 13:53:52.199702 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.199916 (+ 214us) service_pool.cc:224] Handling call
0810 13:53:54.789867 (+2589951us) ts_tablet_manager.cc:1151] Deleting tablet f62023d553cd46cab920de44baa96eec
0810 13:53:54.789908 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:54.871011 (+ 81103us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.929898 (+ 58887us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:54.942712 (+ 12814us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2589400}
I20260810 13:53:54.960651 14273 tablet_replica.cc:333] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:54.961256 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet f62023d553cd46cab920de44baa96eec (table default.Table_65f3e467e91b454799305f55c1a236ef [id=e8338009e3ca44ae81d7b7b7d533713f]) successfully deleted
I20260810 13:53:54.969694 14273 raft_consensus.cc:2243] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:54.970233 14273 raft_consensus.cc:2272] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:54.974849 14273 ts_tablet_manager.cc:1916] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:54.978826 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8394a311b0bd4203bbb0ec788da4e245"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:54.980171 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 334) took 1096 ms. Trace:
W20260810 13:53:54.980399 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8394a311b0bd4203bbb0ec788da4e245 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.980486 14389 rpcz_store.cc:276] 0810 13:53:53.883491 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:53.901946 (+ 18455us) service_pool.cc:224] Handling call
0810 13:53:54.944064 (+1042118us) ts_tablet_manager.cc:1151] Deleting tablet 063e3b74a9a248a1aa0c2de4b4b73a06
0810 13:53:54.979863 (+ 35799us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:54.980111 (+ 248us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":945647}
W20260810 13:53:54.981704 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 063e3b74a9a248a1aa0c2de4b4b73a06 already in progress: creating tablet
I20260810 13:53:54.939229 15028 tablet.cc:1724] T a67cf93d78254f15a1b89c99048110c8 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:54.962170 14991 raft_consensus.cc:493] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:54.986316 14991 raft_consensus.cc:515] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.956981 13640 tablet_bootstrap.cc:654] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:54.988485 14991 leader_election.cc:290] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:54.991644 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_7cbcdca887724284a33c681c9574ea82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:54.993119 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cbcdca887724284a33c681c9574ea82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.995870 13640 tablet_bootstrap.cc:492] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:54.989077 14991 raft_consensus.cc:2804] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:54.996475 13640 ts_tablet_manager.cc:1403] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.089s user 0.016s sys 0.001s
I20260810 13:53:54.997615 14991 raft_consensus.cc:493] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:54.998050 14991 raft_consensus.cc:3060] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:54.999051 13640 raft_consensus.cc:359] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:54.999657 13640 raft_consensus.cc:385] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:54.999913 13640 raft_consensus.cc:740] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.000674 13640 consensus_queue.cc:260] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.002991 13640 ts_tablet_manager.cc:1434] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260810 13:53:55.003907 13640 tablet_bootstrap.cc:492] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:54.982779 13639 tablet_bootstrap.cc:492] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:55.010052 13640 tablet_bootstrap.cc:654] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.015257 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d9a82635a9fc49d9943077eb2387dddb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:55.016846 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9a82635a9fc49d9943077eb2387dddb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:54.985298 14888 ts_tablet_manager.cc:1929] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:55.024928 14888 log.cc:1199] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/07ff9e8a8ca845b89154ed0626d34c5c
I20260810 13:53:55.025695 14888 ts_tablet_manager.cc:1950] T 07ff9e8a8ca845b89154ed0626d34c5c P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:55.028081 14888 tablet_replica.cc:333] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:55.054836 13640 tablet_bootstrap.cc:492] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
W20260810 13:53:55.055160 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 8d647bf5c1ba42f48186661310065448 (table default.Table_b4cf164b5bd14203bc5fefcc974c263e [id=9ec5220333d6496b83c73d11150e444c], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8d647bf5c1ba42f48186661310065448 has no consensus state
I20260810 13:53:55.055230 13640 ts_tablet_manager.cc:1403] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.052s user 0.020s sys 0.012s
I20260810 13:53:55.056957 14273 ts_tablet_manager.cc:1929] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:55.057395 14273 log.cc:1199] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/f7afa380245248f5bac203b0905721c6
I20260810 13:53:55.058926 13640 raft_consensus.cc:359] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.059365 14888 raft_consensus.cc:2243] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:55.058190 14273 ts_tablet_manager.cc:1950] T f7afa380245248f5bac203b0905721c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:55.059902 14888 raft_consensus.cc:2272] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:55.061866 14888 ts_tablet_manager.cc:1916] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:55.032919 14991 raft_consensus.cc:515] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.066830 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:55.067780 13264 raft_consensus.cc:2468] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:55.059602 13640 raft_consensus.cc:385] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.069836 13640 raft_consensus.cc:740] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.070250 12952 leader_election.cc:304] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:55.070668 13640 consensus_queue.cc:260] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.071538 15030 raft_consensus.cc:2804] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:55.072126 15030 raft_consensus.cc:493] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:55.072901 15030 raft_consensus.cc:3060] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.073339 14389 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 336) took 1039 ms. Trace:
I20260810 13:53:55.073998 13640 ts_tablet_manager.cc:1434] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.019s user 0.008s sys 0.001s
I20260810 13:53:55.073570 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4946f79b54c46b1a59edf169109ab47" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:55.075201 14389 rpcz_store.cc:276] 0810 13:53:54.033624 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.035529 (+ 1905us) service_pool.cc:224] Handling call
0810 13:53:54.982398 (+946869us) ts_tablet_manager.cc:1151] Deleting tablet 61169145c539464fa9cf62eaaf8168e5
0810 13:53:55.066466 (+ 84068us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.073271 (+ 6805us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":946207}
W20260810 13:53:55.076067 12952 leader_election.cc:343] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.080547 13640 tablet_bootstrap.cc:492] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:55.081559 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 315) took 2878 ms. Trace:
W20260810 13:53:55.084887 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 61169145c539464fa9cf62eaaf8168e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61169145c539464fa9cf62eaaf8168e5 already in progress: creating tablet
I20260810 13:53:55.085469 14273 rpcz_store.cc:276] 0810 13:53:52.203457 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.204921 (+ 1464us) service_pool.cc:224] Handling call
0810 13:53:54.960483 (+2755562us) ts_tablet_manager.cc:1151] Deleting tablet f7afa380245248f5bac203b0905721c6
0810 13:53:54.960527 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.032770 (+ 72243us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.056843 (+ 24073us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.080053 (+ 23210us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d521 00007fb87ae4db52 00007fb883dbb1d9 00007fb882fd34e8 00007fb88309a562 00007fb8830cb0e0 00007fb8830b164d 00007fb8830b15f9 00007fb8830b1589 00007fb8830b1551
0810 13:53:55.081507 (+ 1454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37677952,"tablet-delete.queue_time_us":2755006}
I20260810 13:53:55.039391 13639 tablet_bootstrap.cc:654] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:55.050098 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 207363us
I20260810 13:53:55.087608 13382 leader_election.cc:304] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:53:55.088248 14956 raft_consensus.cc:493] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.089040 14842 raft_consensus.cc:2804] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:55.089526 14842 raft_consensus.cc:697] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:53:55.089448 14956 raft_consensus.cc:515] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.090514 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ee819fc496fe4a48bf43d70ba6a6cbde" } new_table_name: "default.Table_2e79b198186741b39955b48b1832908a" modify_external_catalogs: true
I20260810 13:53:55.090582 14842 consensus_queue.cc:237] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.091564 14956 leader_election.cc:290] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:55.095568 13638 tablet_bootstrap.cc:654] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.098311 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 07ff9e8a8ca845b89154ed0626d34c5c (table default.Table_9656a7ccd188461fa55387c96150bb80 [id=1531ea1f96db44c8918e0d74570c0ffd]) successfully deleted
I20260810 13:53:55.100811 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:55.099161 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:55.108016 13640 tablet_bootstrap.cc:654] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:55.110710 13382 leader_election.cc:343] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.111917 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:55.112703 13480 raft_consensus.cc:2468] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:55.113458 14991 leader_election.cc:290] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:55.116164 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4946f79b54c46b1a59edf169109ab47" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
W20260810 13:53:55.115231 13382 leader_election.cc:343] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.118603 13382 leader_election.cc:304] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:55.119017 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 has no consensus state
I20260810 13:53:55.117169 13480 raft_consensus.cc:3060] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.122104 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 316) took 2911 ms. Trace:
I20260810 13:53:55.122509 14273 rpcz_store.cc:276] 0810 13:53:52.211145 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.211246 (+ 101us) service_pool.cc:224] Handling call
0810 13:53:55.121821 (+2910575us) ts_tablet_manager.cc:1151] Deleting tablet d2f8801796064c39ba1c81c64d622d68
0810 13:53:55.121873 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.122039 (+ 166us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2910024}
I20260810 13:53:55.123759 14273 tablet_replica.cc:333] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:55.124982 14956 raft_consensus.cc:2749] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:55.128283 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c33560b05b334449b71faa0da12cab88" } new_table_name: "default.Table_94f6cc658a01407194e9d5858f48d615" modify_external_catalogs: true
I20260810 13:53:55.126360 14273 raft_consensus.cc:2243] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:55.133909 14273 raft_consensus.cc:2272] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:55.135989 14273 ts_tablet_manager.cc:1916] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:55.144971 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet f7afa380245248f5bac203b0905721c6 (table default.Table_cf87937d4ae348878fccadff2eca2c6b [id=7db25ca91e1a4ed1b9645002bee461ca]) successfully deleted
W20260810 13:53:55.146096 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet d2f8801796064c39ba1c81c64d622d68 because the tablet was not found. No further retry: Not found: Tablet not found: d2f8801796064c39ba1c81c64d622d68
W20260810 13:53:55.166512 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 62600.8us
I20260810 13:53:55.151547 13480 raft_consensus.cc:2468] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:55.159248 13640 tablet_bootstrap.cc:492] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:55.173959 13640 ts_tablet_manager.cc:1403] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.094s user 0.013s sys 0.005s
I20260810 13:53:55.179090 13640 raft_consensus.cc:359] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:55.181747 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3a1b35d369474ba9bee379089796bd3c consensus state has no leader
I20260810 13:53:55.183377 13640 raft_consensus.cc:385] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.183678 13640 raft_consensus.cc:740] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.183604 12951 leader_election.cc:304] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:53:55.185859 14991 raft_consensus.cc:2804] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:55.185899 13640 consensus_queue.cc:260] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.192916 13640 ts_tablet_manager.cc:1434] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.018s user 0.003s sys 0.005s
I20260810 13:53:55.193346 14991 raft_consensus.cc:697] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:55.195127 14991 consensus_queue.cc:237] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.196311 13640 tablet_bootstrap.cc:492] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:55.201121 13638 tablet_bootstrap.cc:492] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:55.201620 13638 ts_tablet_manager.cc:1403] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.264s user 0.007s sys 0.006s
I20260810 13:53:55.205770 13640 tablet_bootstrap.cc:654] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.218614 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_32a20912aef145aabc1b19b2b796c682"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:55.224717 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_eaa42749fbe84eeb91655d963d5a34ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:55.230283 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eaa42749fbe84eeb91655d963d5a34ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:55.221385 13638 raft_consensus.cc:359] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.236608 13638 raft_consensus.cc:385] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.240217 13638 raft_consensus.cc:740] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.245325 14273 ts_tablet_manager.cc:1929] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:55.248881 14273 log.cc:1199] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/35c43f7f8b7e4e56b5edbabe242c9dde
W20260810 13:53:55.249351 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32a20912aef145aabc1b19b2b796c682 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:55.249912 14273 ts_tablet_manager.cc:1950] T 35c43f7f8b7e4e56b5edbabe242c9dde P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:55.246739 13638 consensus_queue.cc:260] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.261296 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 320) took 3035 ms. Trace:
I20260810 13:53:55.261777 14273 rpcz_store.cc:276] 0810 13:53:52.225906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.226598 (+ 692us) service_pool.cc:224] Handling call
0810 13:53:55.123599 (+2897001us) ts_tablet_manager.cc:1151] Deleting tablet 35c43f7f8b7e4e56b5edbabe242c9dde
0810 13:53:55.123643 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.237253 (+113610us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.245169 (+ 7916us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.261234 (+ 16065us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2896454}
I20260810 13:53:55.262482 15040 tablet.cc:1724] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:53:55.265055 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 323) took 2885 ms. Trace:
I20260810 13:53:55.268318 13639 tablet_bootstrap.cc:492] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:55.265903 14273 rpcz_store.cc:276] 0810 13:53:52.379664 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.380150 (+ 486us) service_pool.cc:224] Handling call
0810 13:53:55.263985 (+2883835us) ts_tablet_manager.cc:1151] Deleting tablet 69ecda19e4f143c99654aff6058ad8bb
0810 13:53:55.264061 (+ 76us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.264917 (+ 856us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2883238}
I20260810 13:53:55.268839 13639 ts_tablet_manager.cc:1403] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.286s user 0.014s sys 0.001s
I20260810 13:53:55.206712 15042 tablet.cc:1724] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:53:55.273269 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 326) took 2851 ms. Trace:
I20260810 13:53:55.274294 14273 rpcz_store.cc:276] 0810 13:53:52.421392 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.421527 (+ 135us) service_pool.cc:224] Handling call
0810 13:53:55.270881 (+2849354us) ts_tablet_manager.cc:1151] Deleting tablet 3db559714d84493ebaf7d3b51719d81c
0810 13:53:55.271177 (+ 296us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.272968 (+ 1791us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2848504}
I20260810 13:53:55.279072 14956 raft_consensus.cc:493] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.279510 14956 raft_consensus.cc:515] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.281585 14956 leader_election.cc:290] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:55.282896 13638 ts_tablet_manager.cc:1434] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.081s user 0.010s sys 0.000s
I20260810 13:53:55.283402 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:55.283864 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:55.283994 13638 tablet_bootstrap.cc:492] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:53:55.284859 13382 leader_election.cc:343] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:55.286150 13382 leader_election.cc:343] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.286700 13382 leader_election.cc:304] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.287999 14956 raft_consensus.cc:2749] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:55.293015 15030 raft_consensus.cc:515] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.285997 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 330) took 2676 ms. Trace:
I20260810 13:53:55.300664 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:55.301270 13480 raft_consensus.cc:3060] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.299041 14273 rpcz_store.cc:276] 0810 13:53:52.608858 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.608995 (+ 137us) service_pool.cc:224] Handling call
0810 13:53:55.281001 (+2672006us) ts_tablet_manager.cc:1151] Deleting tablet 5bab4d93f7dc4c88bbed9cb83961bb2e
0810 13:53:55.281227 (+ 226us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.285583 (+ 4356us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2670977}
I20260810 13:53:55.272274 13639 raft_consensus.cc:359] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.316023 13480 raft_consensus.cc:2468] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:55.316795 13639 raft_consensus.cc:385] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.318092 14273 tablet_replica.cc:333] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:55.317437 12951 leader_election.cc:304] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:55.318302 14956 raft_consensus.cc:493] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.318881 14273 raft_consensus.cc:2243] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:55.318728 14956 raft_consensus.cc:515] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.319368 14273 raft_consensus.cc:2272] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:55.319089 13639 raft_consensus.cc:740] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.325726 14956 leader_election.cc:290] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:55.327793 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:55.329851 13382 leader_election.cc:343] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.331755 14273 ts_tablet_manager.cc:1916] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:55.263384 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 35c43f7f8b7e4e56b5edbabe242c9dde (table default.Table_c75d32693a7f4df68c1f2c97bfaf15f5 [id=6fef18912c5c43519e5759644317fc3c]) successfully deleted
W20260810 13:53:55.347038 12717 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 83681.8us
W20260810 13:53:55.349421 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 69ecda19e4f143c99654aff6058ad8bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69ecda19e4f143c99654aff6058ad8bb already in progress: creating tablet
W20260810 13:53:55.350086 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 3db559714d84493ebaf7d3b51719d81c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3db559714d84493ebaf7d3b51719d81c already in progress: creating tablet
W20260810 13:53:55.350960 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 5bab4d93f7dc4c88bbed9cb83961bb2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bab4d93f7dc4c88bbed9cb83961bb2e already in progress: creating tablet
I20260810 13:53:55.362656 13640 tablet_bootstrap.cc:492] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:55.363133 13640 ts_tablet_manager.cc:1403] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.169s user 0.033s sys 0.014s
I20260810 13:53:55.363431 13638 tablet_bootstrap.cc:654] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.367846 13640 raft_consensus.cc:359] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.368548 13640 raft_consensus.cc:385] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.368845 13640 raft_consensus.cc:740] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.369587 13640 consensus_queue.cc:260] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.374306 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:55.375752 13382 leader_election.cc:343] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.375784 15027 raft_consensus.cc:2804] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:55.376294 15027 raft_consensus.cc:697] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:55.376174 13382 leader_election.cc:304] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.377990 14956 raft_consensus.cc:2749] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:55.353158 13639 consensus_queue.cc:260] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.380637 13640 ts_tablet_manager.cc:1434] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260810 13:53:55.383659 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d4ada59acb684b27b742fb4abba2fccf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:55.385697 13640 tablet_bootstrap.cc:492] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:55.391274 13639 ts_tablet_manager.cc:1434] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.122s user 0.007s sys 0.000s
I20260810 13:53:55.392946 13640 tablet_bootstrap.cc:654] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.396914 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2ca2243ef2fe4479bb1edec0046866b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:55.377122 15027 consensus_queue.cc:237] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.400164 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:55.400712 13269 raft_consensus.cc:3060] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.398957 15030 leader_election.cc:290] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:55.411000 13269 raft_consensus.cc:2468] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:55.418431 13638 tablet_bootstrap.cc:492] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:55.418942 13638 ts_tablet_manager.cc:1403] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.135s user 0.011s sys 0.001s
I20260810 13:53:55.422652 13638 raft_consensus.cc:359] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.432792 13638 raft_consensus.cc:385] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.433141 13638 raft_consensus.cc:740] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.434005 13638 consensus_queue.cc:260] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.440378 13638 ts_tablet_manager.cc:1434] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260810 13:53:55.444308 13638 tablet_bootstrap.cc:492] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:55.450413 13638 tablet_bootstrap.cc:654] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.379347 14888 ts_tablet_manager.cc:1929] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:55.459954 14888 log.cc:1199] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/f62023d553cd46cab920de44baa96eec
I20260810 13:53:55.460706 14888 ts_tablet_manager.cc:1950] T f62023d553cd46cab920de44baa96eec P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:55.485072 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ca2243ef2fe4479bb1edec0046866b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:55.488903 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4ada59acb684b27b742fb4abba2fccf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:55.509055 13639 tablet_bootstrap.cc:492] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:55.511427 14888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 335) took 1263 ms. Trace:
I20260810 13:53:55.511785 14888 rpcz_store.cc:276] 0810 13:53:54.248337 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.248495 (+ 158us) service_pool.cc:224] Handling call
0810 13:53:55.027934 (+779439us) ts_tablet_manager.cc:1151] Deleting tablet f62023d553cd46cab920de44baa96eec
0810 13:53:55.027975 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.224056 (+196081us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.379224 (+155168us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.511369 (+132145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":777735}
I20260810 13:53:55.513167 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet f62023d553cd46cab920de44baa96eec (table default.Table_65f3e467e91b454799305f55c1a236ef [id=e8338009e3ca44ae81d7b7b7d533713f]) successfully deleted
I20260810 13:53:55.514600 13638 tablet_bootstrap.cc:492] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:55.517794 13638 ts_tablet_manager.cc:1403] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.074s user 0.011s sys 0.000s
I20260810 13:53:55.520143 15034 raft_consensus.cc:493] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.528606 14273 ts_tablet_manager.cc:1929] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:53:55.533756 15034 raft_consensus.cc:515] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.534611 14273 log.cc:1199] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/307a6b609b674afbb684147005b66d87
I20260810 13:53:55.536574 14273 ts_tablet_manager.cc:1950] T 307a6b609b674afbb684147005b66d87 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:55.538367 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063e3b74a9a248a1aa0c2de4b4b73a06" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:55.540128 13639 tablet_bootstrap.cc:654] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.540271 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063e3b74a9a248a1aa0c2de4b4b73a06" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:55.536626 15034 leader_election.cc:290] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:55.542892 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b4cf164b5bd14203bc5fefcc974c263e" } new_table_name: "default.Table_4a0d9399ab4c468fab4289955631b20f" modify_external_catalogs: true
W20260810 13:53:55.544080 13382 leader_election.cc:343] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:55.544976 13382 leader_election.cc:343] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.545315 13382 leader_election.cc:304] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.546391 13640 tablet_bootstrap.cc:492] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:55.546976 13640 ts_tablet_manager.cc:1403] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.164s user 0.016s sys 0.011s
I20260810 13:53:55.548983 14956 raft_consensus.cc:2749] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:55.556779 13638 raft_consensus.cc:359] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.557507 13638 raft_consensus.cc:385] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.557749 13638 raft_consensus.cc:740] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.561600 13638 consensus_queue.cc:260] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.572800 13640 raft_consensus.cc:359] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.576795 13640 raft_consensus.cc:385] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.576958 14961 raft_consensus.cc:493] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.577404 14961 raft_consensus.cc:515] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.579362 14961 leader_election.cc:290] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:55.580960 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:55.582208 13167 leader_election.cc:343] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.573748 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 343) took 1600 ms. Trace:
I20260810 13:53:55.582154 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:55.582886 13640 raft_consensus.cc:740] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.583030 13480 raft_consensus.cc:2468] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:53:55.584276 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d647bf5c1ba42f48186661310065448 has no consensus state
I20260810 13:53:55.583968 14273 rpcz_store.cc:276] 0810 13:53:53.973233 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:53.974403 (+ 1170us) service_pool.cc:224] Handling call
0810 13:53:55.317939 (+1343536us) ts_tablet_manager.cc:1151] Deleting tablet 307a6b609b674afbb684147005b66d87
0810 13:53:55.317982 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.395004 (+ 77022us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.528329 (+133325us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.573613 (+ 45284us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1342943}
I20260810 13:53:55.584909 13640 consensus_queue.cc:260] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.585786 14273 tablet_replica.cc:333] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:55.586874 14273 raft_consensus.cc:2243] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:55.587335 14273 raft_consensus.cc:2272] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:55.588316 13164 leader_election.cc:304] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.589391 14961 raft_consensus.cc:2804] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:55.589720 14961 raft_consensus.cc:493] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:55.590046 14961 raft_consensus.cc:3060] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.597759 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 307a6b609b674afbb684147005b66d87 (table default.Table_2500b640931944079b9a58c7590ee717 [id=91c351539b734ae7bc1aaf17075075f9]) successfully deleted
I20260810 13:53:55.599798 13640 ts_tablet_manager.cc:1434] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.052s user 0.006s sys 0.000s
I20260810 13:53:55.601709 14961 raft_consensus.cc:515] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.608148 13638 ts_tablet_manager.cc:1434] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.090s user 0.007s sys 0.000s
I20260810 13:53:55.610759 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:53:55.616070 13167 leader_election.cc:343] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.616498 13640 tablet_bootstrap.cc:492] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:55.601872 14273 ts_tablet_manager.cc:1916] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:55.617185 13638 tablet_bootstrap.cc:492] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:55.621917 15037 raft_consensus.cc:493] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.622354 15037 raft_consensus.cc:515] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.624339 15037 leader_election.cc:290] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:55.626034 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:55.626135 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:55.626698 13480 raft_consensus.cc:2468] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:53:55.627624 13167 leader_election.cc:343] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.628464 13164 leader_election.cc:304] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.628727 13639 tablet_bootstrap.cc:492] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:55.629184 13639 ts_tablet_manager.cc:1403] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.120s user 0.020s sys 0.005s
I20260810 13:53:55.629522 15037 raft_consensus.cc:2804] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:55.629884 15037 raft_consensus.cc:493] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:55.630257 15037 raft_consensus.cc:3060] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.635100 13639 raft_consensus.cc:359] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.635686 13639 raft_consensus.cc:385] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.635929 13639 raft_consensus.cc:740] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.637550 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:55.638113 13480 raft_consensus.cc:3060] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.643970 13639 consensus_queue.cc:260] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.650586 13640 tablet_bootstrap.cc:654] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.663511 14961 leader_election.cc:290] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:55.665576 14961 raft_consensus.cc:493] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.662129 13639 ts_tablet_manager.cc:1434] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.033s user 0.005s sys 0.000s
I20260810 13:53:55.669291 13480 raft_consensus.cc:2468] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:55.670156 14961 raft_consensus.cc:515] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.678208 13164 leader_election.cc:304] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.679201 13639 tablet_bootstrap.cc:492] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:55.683283 14842 raft_consensus.cc:493] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.683727 14842 raft_consensus.cc:515] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.685792 14842 leader_election.cc:290] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:55.687884 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:55.690995 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:55.691717 13640 tablet_bootstrap.cc:492] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:55.692157 13640 ts_tablet_manager.cc:1403] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.007s
W20260810 13:53:55.692210 13382 leader_election.cc:343] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:55.693507 13382 leader_election.cc:343] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.693900 13382 leader_election.cc:304] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.694590 14842 raft_consensus.cc:2749] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:55.699894 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:55.684640 13639 tablet_bootstrap.cc:654] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.700663 13049 raft_consensus.cc:2393] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:55.695132 13640 raft_consensus.cc:359] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.682658 15056 raft_consensus.cc:2804] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:55.702114 13640 raft_consensus.cc:385] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.702381 13640 raft_consensus.cc:740] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.704223 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:55.710687 14273 ts_tablet_manager.cc:1929] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:55.711077 14273 log.cc:1199] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/063e3b74a9a248a1aa0c2de4b4b73a06
I20260810 13:53:55.711711 14273 ts_tablet_manager.cc:1950] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:55.712957 13640 consensus_queue.cc:260] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.705770 13164 leader_election.cc:304] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.718340 15062 raft_consensus.cc:3060] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.696669 15037 raft_consensus.cc:515] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.731088 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:53:55.732569 13167 leader_election.cc:343] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.734877 13640 ts_tablet_manager.cc:1434] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.042s user 0.006s sys 0.001s
I20260810 13:53:55.735797 14961 leader_election.cc:290] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:55.738731 13638 tablet_bootstrap.cc:654] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.744191 15037 leader_election.cc:290] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:55.745385 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:55.745985 13480 raft_consensus.cc:3060] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.746863 13640 tablet_bootstrap.cc:492] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:55.753142 15056 raft_consensus.cc:697] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:55.757303 15056 consensus_queue.cc:237] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.762859 12742 catalog_manager.cc:5719] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } }
I20260810 13:53:55.763938 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:55.766920 13640 tablet_bootstrap.cc:654] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.776510 13227 tablet_service.cc:1511] Processing CreateTablet for tablet 1330bcef6f234943b6b935b54aa3edfd (DEFAULT_TABLE table=default.Table_a2cd133674544036a9b6a207612749a4 [id=babb86d296f746c88acc54eb2b69f504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:55.777679 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1330bcef6f234943b6b935b54aa3edfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:55.777438 14842 raft_consensus.cc:493] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.778040 14842 raft_consensus.cc:515] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.781764 13480 raft_consensus.cc:2468] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:55.764585 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:55.786016 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 347) took 1692 ms. Trace:
I20260810 13:53:55.786434 14273 rpcz_store.cc:276] 0810 13:53:54.093903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.094055 (+ 152us) service_pool.cc:224] Handling call
0810 13:53:55.585545 (+1491490us) ts_tablet_manager.cc:1151] Deleting tablet 063e3b74a9a248a1aa0c2de4b4b73a06
0810 13:53:55.585626 (+ 81us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.663127 (+ 77501us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.710553 (+ 47426us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.785943 (+ 75390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16778,"tablet-delete.queue_time_us":1490746}
I20260810 13:53:55.787668 14273 tablet_replica.cc:333] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:55.788347 14273 raft_consensus.cc:2243] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:55.789661 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 063e3b74a9a248a1aa0c2de4b4b73a06 (table default.Table_1023c03a20e448b4abaa7920a9ae09d9 [id=e1f370bc63c248378875a3361c4e28e3]) successfully deleted
I20260810 13:53:55.789973 13164 leader_election.cc:304] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.791419 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b84bd35b02f4a1faf15ac9bc21e6146" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:55.792490 15063 raft_consensus.cc:2804] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:55.792951 15063 raft_consensus.cc:697] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:55.793071 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b84bd35b02f4a1faf15ac9bc21e6146" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:55.793707 15063 consensus_queue.cc:237] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.796432 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 1d78892783474b329e31bf2df7d2952c
W20260810 13:53:55.797775 13382 leader_election.cc:343] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:55.798404 13382 leader_election.cc:343] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:55.798380 12746 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 469) took 1758 ms. Trace:
I20260810 13:53:55.798720 13382 leader_election.cc:304] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:55.780529 14842 leader_election.cc:290] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:55.799456 15034 raft_consensus.cc:2749] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:55.801690 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d78892783474b329e31bf2df7d2952c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:54 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:55.802031 13213 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d78892783474b329e31bf2df7d2952c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:54 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:55.802956 13639 tablet_bootstrap.cc:492] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:55.803375 13639 ts_tablet_manager.cc:1403] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.124s user 0.012s sys 0.006s
I20260810 13:53:55.803308 14273 raft_consensus.cc:2272] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:55.803988 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 1d78892783474b329e31bf2df7d2952c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d78892783474b329e31bf2df7d2952c already in progress: creating tablet
I20260810 13:53:55.805289 14273 ts_tablet_manager.cc:1916] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:55.805835 13639 raft_consensus.cc:359] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.806421 13639 raft_consensus.cc:385] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.806671 13639 raft_consensus.cc:740] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.807303 13639 consensus_queue.cc:260] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.813211 13424 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d78892783474b329e31bf2df7d2952c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:54 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:55.798765 12746 rpcz_store.cc:276] 0810 13:53:54.039769 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.039931 (+ 162us) service_pool.cc:224] Handling call
0810 13:53:54.240979 (+201048us) spinlock_profiling.cc:243] Waited 98 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c84d6 00007fec6df80b34 00007fec6df80ac2 00007fec6df809f1 00007fec6df8096c 00007fec6df7fc22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:54.241931 (+ 952us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:54.243012 (+ 1081us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:54.243148 (+ 136us) catalog_manager.cc:2850] Locking tablets
0810 13:53:55.752529 (+1509381us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:55.795924 (+ 43395us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:55.796180 (+ 256us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:55.796312 (+ 132us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:55.798303 (+ 1991us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:55.754652 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:55.755113 (+ 461us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:55.755141 (+ 28us) write_op.cc:435] Acquired schema lock
0810 13:53:55.755156 (+ 15us) tablet.cc:662] Decoding operations
0810 13:53:55.755474 (+ 318us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:55.755512 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:55.755541 (+ 29us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:55.755823 (+ 282us) tablet.cc:701] Row locks acquired
0810 13:53:55.755838 (+ 15us) write_op.cc:260] PREPARE: finished
0810 13:53:55.755946 (+ 108us) write_op.cc:270] Start()
0810 13:53:55.756029 (+ 83us) write_op.cc:276] Timestamp: P: 1786370035752391 usec, L: 0
0810 13:53:55.756047 (+ 18us) op_driver.cc:348] REPLICATION: starting
0810 13:53:55.756520 (+ 473us) log.cc:844] Serialized 756 byte log entry
0810 13:53:55.789256 (+ 32736us) op_driver.cc:464] REPLICATION: finished
0810 13:53:55.791588 (+ 2332us) write_op.cc:301] APPLY: starting
0810 13:53:55.791636 (+ 48us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:55.791730 (+ 94us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:55.791830 (+ 100us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:55.792044 (+ 214us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:55.792176 (+ 132us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:55.792219 (+ 43us) write_op.cc:312] APPLY: finished
0810 13:53:55.794619 (+ 2400us) log.cc:844] Serialized 29 byte log entry
0810 13:53:55.794737 (+ 118us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:55.794811 (+ 74us) write_op.cc:454] Released schema lock
0810 13:53:55.794841 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":225512704,"child_traces":[["op",{"apply.queue_time_us":2218,"apply.run_cpu_time_us":1245,"apply.run_wall_time_us":13888,"num_ops":2,"prepare.queue_time_us":215,"prepare.run_cpu_time_us":2099,"prepare.run_wall_time_us":3426,"replication_time_us":33140,"threads_started":1}]]}
I20260810 13:53:55.815972 13639 ts_tablet_manager.cc:1434] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260810 13:53:55.816879 13639 tablet_bootstrap.cc:492] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:55.819922 13640 tablet_bootstrap.cc:492] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:55.820590 13640 ts_tablet_manager.cc:1403] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.074s user 0.010s sys 0.001s
I20260810 13:53:55.823444 13640 raft_consensus.cc:359] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.824127 13640 raft_consensus.cc:385] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.824405 13640 raft_consensus.cc:740] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.832105 13639 tablet_bootstrap.cc:654] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.833470 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d4b862f23534424d922dc35969230ef6" } new_table_name: "default.Table_c29041511caa4b378bfc1284cfc550be" modify_external_catalogs: true
I20260810 13:53:55.839546 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 1330bcef6f234943b6b935b54aa3edfd
I20260810 13:53:55.840991 12745 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 466) took 1870 ms. Trace:
I20260810 13:53:55.841369 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 1330bcef6f234943b6b935b54aa3edfd (DEFAULT_TABLE table=default.Table_a2cd133674544036a9b6a207612749a4 [id=babb86d296f746c88acc54eb2b69f504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:55.842358 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1330bcef6f234943b6b935b54aa3edfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:55.841269 12745 rpcz_store.cc:276] 0810 13:53:53.970948 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:53.983283 (+ 12335us) service_pool.cc:224] Handling call
0810 13:53:54.392197 (+408914us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c84d6 00007fec6df80b34 00007fec6df80ac2 00007fec6df809f1 00007fec6df8096c 00007fec6df7fc22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:54.393387 (+ 1190us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:54.393943 (+ 556us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:54.394071 (+ 128us) catalog_manager.cc:2850] Locking tablets
0810 13:53:55.746088 (+1352017us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:55.794339 (+ 48251us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:55.839373 (+ 45034us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:55.839463 (+ 90us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:55.840934 (+ 1471us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:55.747884 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:55.748370 (+ 486us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:55.748404 (+ 34us) write_op.cc:435] Acquired schema lock
0810 13:53:55.748424 (+ 20us) tablet.cc:662] Decoding operations
0810 13:53:55.748882 (+ 458us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:55.748938 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:55.748971 (+ 33us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:55.749572 (+ 601us) tablet.cc:701] Row locks acquired
0810 13:53:55.749594 (+ 22us) write_op.cc:260] PREPARE: finished
0810 13:53:55.749729 (+ 135us) write_op.cc:270] Start()
0810 13:53:55.749822 (+ 93us) write_op.cc:276] Timestamp: P: 1786370035746168 usec, L: 0
0810 13:53:55.749840 (+ 18us) op_driver.cc:348] REPLICATION: starting
0810 13:53:55.750347 (+ 507us) log.cc:844] Serialized 725 byte log entry
0810 13:53:55.789037 (+ 38690us) op_driver.cc:464] REPLICATION: finished
0810 13:53:55.790057 (+ 1020us) write_op.cc:301] APPLY: starting
0810 13:53:55.790108 (+ 51us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:55.790215 (+ 107us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:55.790298 (+ 83us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:55.790517 (+ 219us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:55.790655 (+ 138us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:55.790694 (+ 39us) write_op.cc:312] APPLY: finished
0810 13:53:55.790864 (+ 170us) log.cc:844] Serialized 29 byte log entry
0810 13:53:55.791005 (+ 141us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:55.791075 (+ 70us) write_op.cc:454] Released schema lock
0810 13:53:55.791108 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:55.791317 (+ 209us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:55.791339 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":938589952,"child_traces":[["op",{"apply.queue_time_us":874,"apply.run_cpu_time_us":1229,"apply.run_wall_time_us":1229,"num_ops":2,"prepare.queue_time_us":121,"prepare.run_cpu_time_us":2464,"prepare.run_wall_time_us":3751,"replication_time_us":39111}]]}
I20260810 13:53:55.847493 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet 1330bcef6f234943b6b935b54aa3edfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:54 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:55.849313 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 1330bcef6f234943b6b935b54aa3edfd because the tablet was not found. No further retry: Not found: Tablet not found: 1330bcef6f234943b6b935b54aa3edfd
I20260810 13:53:55.851156 12999 tablet_service.cc:1511] Processing CreateTablet for tablet a008d393fcdf441eb17dbe0c1fa2393f (DEFAULT_TABLE table=default.Table_78c6761fe1e748bf8bea32e7a13650f3 [id=d855b11b57bd447a9285b0945f28219d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:55.852190 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a008d393fcdf441eb17dbe0c1fa2393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:55.860327 13424 tablet_service.cc:1511] Processing CreateTablet for tablet 1330bcef6f234943b6b935b54aa3edfd (DEFAULT_TABLE table=default.Table_a2cd133674544036a9b6a207612749a4 [id=babb86d296f746c88acc54eb2b69f504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:55.861680 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1330bcef6f234943b6b935b54aa3edfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:55.867933 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_3abcbf71e2004a07888fe131143e8e76"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:55.869248 13421 tablet_service.cc:1558] Processing DeleteTablet for tablet 1330bcef6f234943b6b935b54aa3edfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:54 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:55.869521 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3abcbf71e2004a07888fe131143e8e76 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:55.872592 13639 tablet_bootstrap.cc:492] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:55.873039 13639 ts_tablet_manager.cc:1403] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.000s
I20260810 13:53:55.873889 13421 tablet_service.cc:1511] Processing CreateTablet for tablet a008d393fcdf441eb17dbe0c1fa2393f (DEFAULT_TABLE table=default.Table_78c6761fe1e748bf8bea32e7a13650f3 [id=d855b11b57bd447a9285b0945f28219d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:55.874954 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a008d393fcdf441eb17dbe0c1fa2393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:55.880903 13640 consensus_queue.cc:260] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.885013 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 1330bcef6f234943b6b935b54aa3edfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:54 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:55.886240 15063 raft_consensus.cc:493] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:55.899598 15063 raft_consensus.cc:515] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.902415 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2c102382734913bffb5436e06fe0a1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:55.903039 13049 raft_consensus.cc:2468] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:55.903376 15062 raft_consensus.cc:2749] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:55.904874 13167 leader_election.cc:304] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:55.906507 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (DEFAULT_TABLE table=default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:55.907112 15063 leader_election.cc:290] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:55.907622 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c57ca566cfe47f6a331bbbe5c344a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:55.907577 15063 raft_consensus.cc:2804] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:55.907903 13640 ts_tablet_manager.cc:1434] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.087s user 0.007s sys 0.000s
I20260810 13:53:55.907922 15063 raft_consensus.cc:493] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:55.908226 15063 raft_consensus.cc:3060] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:55.909922 13213 tablet_service.cc:1511] Processing CreateTablet for tablet a008d393fcdf441eb17dbe0c1fa2393f (DEFAULT_TABLE table=default.Table_78c6761fe1e748bf8bea32e7a13650f3 [id=d855b11b57bd447a9285b0945f28219d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:55.910960 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a008d393fcdf441eb17dbe0c1fa2393f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:55.911191 13639 raft_consensus.cc:359] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.911846 13639 raft_consensus.cc:385] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.912110 13639 raft_consensus.cc:740] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.912854 13639 consensus_queue.cc:260] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.914568 13638 tablet_bootstrap.cc:492] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:55.915045 13638 ts_tablet_manager.cc:1403] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.298s user 0.012s sys 0.018s
I20260810 13:53:55.917657 13638 raft_consensus.cc:359] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.918704 13638 raft_consensus.cc:385] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:55.918982 13638 raft_consensus.cc:740] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:55.928157 14273 ts_tablet_manager.cc:1929] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:55.928221 13638 consensus_queue.cc:260] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:55.933162 15034 consensus_queue.cc:1048] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:55.935899 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2c102382734913bffb5436e06fe0a1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:55.936587 13480 raft_consensus.cc:2468] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:53:55.939129 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 1d78892783474b329e31bf2df7d2952c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d78892783474b329e31bf2df7d2952c already in progress: creating tablet
W20260810 13:53:55.939791 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 1330bcef6f234943b6b935b54aa3edfd because the tablet was not found. No further retry: Not found: Tablet not found: 1330bcef6f234943b6b935b54aa3edfd
I20260810 13:53:55.944437 13638 ts_tablet_manager.cc:1434] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.029s user 0.003s sys 0.003s
I20260810 13:53:55.946300 13639 ts_tablet_manager.cc:1434] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.054s user 0.005s sys 0.000s
I20260810 13:53:55.950981 13640 tablet_bootstrap.cc:492] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:55.957302 12739 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ef59f7013ab4489dadd9084d065533a8
I20260810 13:53:55.958668 12739 catalog_manager.cc:6807] ReplaceTablet: tablet ef59f7013ab4489dadd9084d065533a8 deleted and replaced by tablet 57fc6408d6664e9887b150d1cb934a8d
I20260810 13:53:55.958987 12739 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:48758 (request call id 478) took 1217 ms. Trace:
I20260810 13:53:55.959308 13640 tablet_bootstrap.cc:654] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.959250 12739 rpcz_store.cc:276] 0810 13:53:54.741287 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.741449 (+ 162us) service_pool.cc:224] Handling call
0810 13:53:54.789348 (+ 47899us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703cad41 00007fec6df9cd37 00007fec6df9ccc2 00007fec6df9cbf1 00007fec6df9cb6c 00007fec6df9be22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:55.958934 (+1169586us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:55.784013 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:55.784509 (+ 496us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:55.784534 (+ 25us) write_op.cc:435] Acquired schema lock
0810 13:53:55.784545 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:55.784855 (+ 310us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:55.785010 (+ 155us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:55.785039 (+ 29us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:55.785236 (+ 197us) tablet.cc:701] Row locks acquired
0810 13:53:55.785251 (+ 15us) write_op.cc:260] PREPARE: finished
0810 13:53:55.785354 (+ 103us) write_op.cc:270] Start()
0810 13:53:55.785427 (+ 73us) write_op.cc:276] Timestamp: P: 1786370035781799 usec, L: 0
0810 13:53:55.785441 (+ 14us) op_driver.cc:348] REPLICATION: starting
0810 13:53:55.785930 (+ 489us) log.cc:844] Serialized 622 byte log entry
0810 13:53:55.872752 (+ 86822us) op_driver.cc:464] REPLICATION: finished
0810 13:53:55.888774 (+ 16022us) write_op.cc:301] APPLY: starting
0810 13:53:55.888825 (+ 51us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:55.888927 (+ 102us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:55.889436 (+ 509us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:55.889771 (+ 335us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:55.889963 (+ 192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:55.890004 (+ 41us) write_op.cc:312] APPLY: finished
0810 13:53:55.890170 (+ 166us) log.cc:844] Serialized 29 byte log entry
0810 13:53:55.890316 (+ 146us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:55.890385 (+ 69us) write_op.cc:454] Released schema lock
0810 13:53:55.890419 (+ 34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":107307264,"child_traces":[["op",{"apply.queue_time_us":15794,"num_ops":2,"prepare.queue_time_us":6073,"prepare.run_cpu_time_us":2044,"prepare.run_wall_time_us":33978,"raft.queue_time_us":976,"raft.run_cpu_time_us":15,"raft.run_wall_time_us":15,"replication_time_us":87186}]]}
I20260810 13:53:55.928562 14273 log.cc:1199] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/4dea61b84b614ead8830873568f9b7c4
I20260810 13:53:55.965903 14273 ts_tablet_manager.cc:1950] T 4dea61b84b614ead8830873568f9b7c4 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:55.969568 13639 tablet_bootstrap.cc:492] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:55.968490 13638 tablet_bootstrap.cc:492] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:55.975837 13638 tablet_bootstrap.cc:654] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:55.990440 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 348) took 1896 ms. Trace:
I20260810 13:53:55.990788 14273 rpcz_store.cc:276] 0810 13:53:54.094317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.094874 (+ 557us) service_pool.cc:224] Handling call
0810 13:53:55.787494 (+1692620us) ts_tablet_manager.cc:1151] Deleting tablet 4dea61b84b614ead8830873568f9b7c4
0810 13:53:55.787549 (+ 55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:55.841587 (+ 54038us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.928039 (+ 86452us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:55.990375 (+ 62336us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1692134}
I20260810 13:53:55.992096 14273 tablet_replica.cc:333] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:55.993328 14273 raft_consensus.cc:2243] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:55.994510 14273 raft_consensus.cc:2272] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:48.873976 14244 server_base.cc:1061] running on GCE node
W20260810 13:53:56.003760 14713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 13:53:48.591174 14702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 13:53:55.974610 15063 raft_consensus.cc:515] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.009050 14244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 13:53:56.012868 13638 tablet_bootstrap.cc:492] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:56.013475 13638 ts_tablet_manager.cc:1403] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.004s
I20260810 13:53:56.020011 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2c102382734913bffb5436e06fe0a1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:56.020630 13040 raft_consensus.cc:3060] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:56.022099 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac2c102382734913bffb5436e06fe0a1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:56.022703 13480 raft_consensus.cc:3060] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:56.023679 13640 tablet_bootstrap.cc:492] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:56.024071 13640 ts_tablet_manager.cc:1403] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.073s user 0.004s sys 0.012s
I20260810 13:53:56.024978 14273 ts_tablet_manager.cc:1916] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:56.027765 13639 tablet_bootstrap.cc:654] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.030354 13480 raft_consensus.cc:2468] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:56.031550 13164 leader_election.cc:304] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:53:56.032666 15062 raft_consensus.cc:2804] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:56.033393 15062 raft_consensus.cc:697] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:56.034327 15062 consensus_queue.cc:237] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.037417 13640 raft_consensus.cc:359] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.038156 13640 raft_consensus.cc:385] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.038435 13640 raft_consensus.cc:740] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.039203 13640 consensus_queue.cc:260] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.051052 13040 raft_consensus.cc:2468] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:56.057286 15063 leader_election.cc:290] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:56.060508 14244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 13:53:56.062119 14244 hybrid_clock.cc:648] HybridClock initialized: now 1786370036062021 us; error 95 us; skew 500 ppm
I20260810 13:53:56.064304 14244 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260810 13:53:56.064400 13640 ts_tablet_manager.cc:1434] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.040s user 0.002s sys 0.006s
I20260810 13:53:56.065397 13640 tablet_bootstrap.cc:492] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:56.068152 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 4dea61b84b614ead8830873568f9b7c4 (table default.Table_6b195ecd5f17492f81064d6d53d8fde9 [id=e4c6b90e139246beac835146660eb0ad]) successfully deleted
W20260810 13:53:56.071450 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f922c9ca51044dcda08b245010ab06b0 (table default.Table_61ea331d19cb4393a84ea7b467d1d733 [id=4f643df81e154985a45b424943fa9379], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f922c9ca51044dcda08b245010ab06b0 consensus state has no leader
I20260810 13:53:56.078161 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (DEFAULT_TABLE table=default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.079159 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c57ca566cfe47f6a331bbbe5c344a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.091686 13421 tablet_service.cc:1558] Processing DeleteTablet for tablet ef59f7013ab4489dadd9084d065533a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57fc6408d6664e9887b150d1cb934a8d) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:56.092929 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (DEFAULT_TABLE table=default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.094023 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c57ca566cfe47f6a331bbbe5c344a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.095057 15027 consensus_queue.cc:1048] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:56.096454 13639 tablet_bootstrap.cc:492] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:56.096886 13639 ts_tablet_manager.cc:1403] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.128s user 0.006s sys 0.007s
I20260810 13:53:56.099133 13640 tablet_bootstrap.cc:654] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.099310 13639 raft_consensus.cc:359] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.099937 13639 raft_consensus.cc:385] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.100185 13639 raft_consensus.cc:740] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.106704 14956 consensus_queue.cc:1048] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:56.110728 13639 consensus_queue.cc:260] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.112787 13639 ts_tablet_manager.cc:1434] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260810 13:53:56.113662 13639 tablet_bootstrap.cc:492] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:56.122171 13213 tablet_service.cc:1558] Processing DeleteTablet for tablet ef59f7013ab4489dadd9084d065533a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57fc6408d6664e9887b150d1cb934a8d) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:56.123564 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet ef59f7013ab4489dadd9084d065533a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57fc6408d6664e9887b150d1cb934a8d) from {username='slave'} at 127.0.0.1:50548
W20260810 13:53:56.130900 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ef59f7013ab4489dadd9084d065533a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef59f7013ab4489dadd9084d065533a8 already in progress: creating tablet
I20260810 13:53:56.131001 14273 ts_tablet_manager.cc:1929] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:56.131374 14273 log.cc:1199] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/c4db9d7e82414cab8a69618effe89b40
I20260810 13:53:56.132112 14273 ts_tablet_manager.cc:1950] T c4db9d7e82414cab8a69618effe89b40 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:53:56.134028 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ef59f7013ab4489dadd9084d065533a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef59f7013ab4489dadd9084d065533a8 already in progress: creating tablet
I20260810 13:53:56.144431 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 349) took 2049 ms. Trace:
I20260810 13:53:56.151640 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 41b258122c6e4de982cd95ec04ffc3ae (DEFAULT_TABLE table=default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 [id=f6ba2bd3294c4b49a617aee9388a1248]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.152626 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b258122c6e4de982cd95ec04ffc3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.154800 14273 rpcz_store.cc:276] 0810 13:53:54.094747 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.095443 (+ 696us) service_pool.cc:224] Handling call
0810 13:53:55.991865 (+1896422us) ts_tablet_manager.cc:1151] Deleting tablet c4db9d7e82414cab8a69618effe89b40
0810 13:53:55.991943 (+ 78us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:56.059371 (+ 67428us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:56.130868 (+ 71497us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:56.144364 (+ 13496us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1895813}
I20260810 13:53:56.155910 14273 tablet_replica.cc:333] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:56.156635 14273 raft_consensus.cc:2243] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:56.157166 14273 pending_rounds.cc:70] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Trying to abort 1 pending ops.
I20260810 13:53:56.157387 14273 pending_rounds.cc:77] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971653539971072 op_type: NO_OP noop_request { }
I20260810 13:53:56.157747 14273 raft_consensus.cc:2889] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:53:56.157748 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 41b258122c6e4de982cd95ec04ffc3ae (DEFAULT_TABLE table=default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 [id=f6ba2bd3294c4b49a617aee9388a1248]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.159209 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b258122c6e4de982cd95ec04ffc3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.170226 14273 raft_consensus.cc:2272] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:56.171947 13640 tablet_bootstrap.cc:492] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:56.172348 13640 ts_tablet_manager.cc:1403] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.107s user 0.013s sys 0.006s
I20260810 13:53:56.172430 14273 ts_tablet_manager.cc:1916] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:56.174430 13227 tablet_service.cc:1511] Processing CreateTablet for tablet 7a490fcb16164f968335f069129b3d71 (DEFAULT_TABLE table=default.Table_7515aaeccfe14052b6fd5de21c880a9b [id=e84d542e0e9d4fb188063d945e191b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.175483 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a490fcb16164f968335f069129b3d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.185668 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 82fde417598648968b4013c54f0bc854 (DEFAULT_TABLE table=default.Table_8054f93e82de4c898987acb86f25e5d0 [id=0685b3b0945a493db836d29e5993e447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.186074 13639 tablet_bootstrap.cc:654] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.186008 13640 raft_consensus.cc:359] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.186612 13640 raft_consensus.cc:385] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.186862 13640 raft_consensus.cc:740] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.187463 13640 consensus_queue.cc:260] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.191804 12999 tablet_service.cc:1511] Processing CreateTablet for tablet 82fde417598648968b4013c54f0bc854 (DEFAULT_TABLE table=default.Table_8054f93e82de4c898987acb86f25e5d0 [id=0685b3b0945a493db836d29e5993e447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.195247 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 82fde417598648968b4013c54f0bc854 (DEFAULT_TABLE table=default.Table_8054f93e82de4c898987acb86f25e5d0 [id=0685b3b0945a493db836d29e5993e447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.196302 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fde417598648968b4013c54f0bc854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.196082 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet c4db9d7e82414cab8a69618effe89b40 (table default.Table_a854e55f38e14aee8898f1cb29ba6b9b [id=7f6b178a7e0a44cdbc49adfea482738b]) successfully deleted
I20260810 13:53:56.197234 14244 webserver.cc:533] Webserver started at http://127.12.36.61:36613/ using document root <none> and password file <none>
I20260810 13:53:56.063337 13638 raft_consensus.cc:359] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.199177 14244 fs_manager.cc:362] Metadata directory not provided
I20260810 13:53:56.199549 14244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 13:53:56.201437 13424 tablet_service.cc:1511] Processing CreateTablet for tablet 41b258122c6e4de982cd95ec04ffc3ae (DEFAULT_TABLE table=default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 [id=f6ba2bd3294c4b49a617aee9388a1248]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.202498 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41b258122c6e4de982cd95ec04ffc3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.210170 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e9c73c2f54b54ea485cdcadc15b0a420"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:56.214227 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9c73c2f54b54ea485cdcadc15b0a420 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:56.216193 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 61fd4d043c354ad79d79c32498a469b4
I20260810 13:53:56.218153 12744 catalog_manager.cc:6807] ReplaceTablet: tablet 61fd4d043c354ad79d79c32498a469b4 deleted and replaced by tablet 97127b08237c4d2e81f9966db12d3fdb
I20260810 13:53:56.218745 12744 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:48758 (request call id 467) took 2203 ms. Trace:
I20260810 13:53:56.221413 13640 ts_tablet_manager.cc:1434] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.049s user 0.008s sys 0.000s
I20260810 13:53:56.222365 13640 tablet_bootstrap.cc:492] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:56.219254 12744 rpcz_store.cc:276] 0810 13:53:54.015360 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.015605 (+ 245us) service_pool.cc:224] Handling call
0810 13:53:54.404568 (+388963us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703cad41 00007fec6df9cd37 00007fec6df9ccc2 00007fec6df9cbf1 00007fec6df9cb6c 00007fec6df9be22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:56.218646 (+1814078us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:55.818116 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:55.818506 (+ 390us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:55.818530 (+ 24us) write_op.cc:435] Acquired schema lock
0810 13:53:55.818544 (+ 14us) tablet.cc:662] Decoding operations
0810 13:53:55.818893 (+ 349us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:55.818930 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:55.818953 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:55.819147 (+ 194us) tablet.cc:701] Row locks acquired
0810 13:53:55.819162 (+ 15us) write_op.cc:260] PREPARE: finished
0810 13:53:55.819273 (+ 111us) write_op.cc:270] Start()
0810 13:53:55.819356 (+ 83us) write_op.cc:276] Timestamp: P: 1786370035815711 usec, L: 0
0810 13:53:55.819371 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:55.827191 (+ 7820us) log.cc:844] Serialized 622 byte log entry
0810 13:53:55.829801 (+ 2610us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e553208 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1 00007fec6e9e650d 00000000005bd8c4 00000000005bd6f9
0810 13:53:56.209798 (+379997us) op_driver.cc:464] REPLICATION: finished
0810 13:53:56.210948 (+ 1150us) write_op.cc:301] APPLY: starting
0810 13:53:56.211066 (+ 118us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:56.211283 (+ 217us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:56.211329 (+ 46us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:56.212087 (+ 758us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:56.212470 (+ 383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:56.212553 (+ 83us) write_op.cc:312] APPLY: finished
0810 13:53:56.213033 (+ 480us) log.cc:844] Serialized 29 byte log entry
0810 13:53:56.213336 (+ 303us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:56.213489 (+ 153us) write_op.cc:454] Released schema lock
0810 13:53:56.213564 (+ 75us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:56.220194 (+ 6630us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:56.220233 (+ 39us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":874676992,"child_traces":[["op",{"apply.queue_time_us":777,"apply.run_cpu_time_us":2967,"apply.run_wall_time_us":9252,"num_ops":2,"prepare.queue_time_us":38460,"prepare.run_cpu_time_us":3357,"prepare.run_wall_time_us":11959,"raft.queue_time_us":2823,"raft.run_cpu_time_us":18,"raft.run_wall_time_us":18,"replication_time_us":390180,"spinlock_wait_cycles":16803072}]]}
I20260810 13:53:56.204437 13639 tablet_bootstrap.cc:492] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:56.253113 13639 ts_tablet_manager.cc:1403] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.140s user 0.008s sys 0.003s
I20260810 13:53:56.240518 13640 tablet_bootstrap.cc:654] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.256107 13639 raft_consensus.cc:359] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.256981 13639 raft_consensus.cc:385] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.257238 13639 raft_consensus.cc:740] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.257948 13639 consensus_queue.cc:260] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.258908 14244 fs_manager.cc:714] Time spent opening directory manager: real 0.030s user 0.006s sys 0.000s
I20260810 13:53:56.259797 13639 ts_tablet_manager.cc:1434] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260810 13:53:56.260795 13639 tablet_bootstrap.cc:492] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:56.260633 14956 raft_consensus.cc:493] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.262099 14956 raft_consensus.cc:515] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.262766 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fde417598648968b4013c54f0bc854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.263160 15027 raft_consensus.cc:493] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.263595 15027 raft_consensus.cc:515] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.267403 15027 leader_election.cc:290] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.270529 14273 ts_tablet_manager.cc:1929] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:56.272169 13640 tablet_bootstrap.cc:492] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:56.285650 13640 ts_tablet_manager.cc:1403] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.063s user 0.006s sys 0.004s
I20260810 13:53:56.287899 13640 raft_consensus.cc:359] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.288501 13640 raft_consensus.cc:385] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.288777 13640 raft_consensus.cc:740] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.288899 14273 log.cc:1199] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/07ff9e8a8ca845b89154ed0626d34c5c
I20260810 13:53:56.289422 13640 consensus_queue.cc:260] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.290162 14273 ts_tablet_manager.cc:1950] T 07ff9e8a8ca845b89154ed0626d34c5c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:53:56.292538 14956 leader_election.cc:290] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.294328 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 61fd4d043c354ad79d79c32498a469b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 97127b08237c4d2e81f9966db12d3fdb) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:56.297552 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:56.298193 14888 tablet_replica.cc:333] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:56.299101 14888 raft_consensus.cc:2243] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:56.299523 14888 raft_consensus.cc:2272] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:56.302390 14888 ts_tablet_manager.cc:1916] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:56.305572 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 7a490fcb16164f968335f069129b3d71 (DEFAULT_TABLE table=default.Table_7515aaeccfe14052b6fd5de21c880a9b [id=e84d542e0e9d4fb188063d945e191b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.309994 13640 ts_tablet_manager.cc:1434] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260810 13:53:56.310798 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 351) took 2215 ms. Trace:
I20260810 13:53:56.310997 13640 tablet_bootstrap.cc:492] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:56.311124 14273 rpcz_store.cc:276] 0810 13:53:54.095356 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.102082 (+ 6726us) service_pool.cc:224] Handling call
0810 13:53:56.155754 (+2053672us) ts_tablet_manager.cc:1151] Deleting tablet 07ff9e8a8ca845b89154ed0626d34c5c
0810 13:53:56.155804 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:56.228530 (+ 72726us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:56.270365 (+ 41835us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:56.310718 (+ 40353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18217,"tablet-delete.queue_time_us":2051253}
I20260810 13:53:56.312493 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 354) took 2205 ms. Trace:
I20260810 13:53:56.313977 15118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 13:53:56.315761 14244 fs_manager.cc:730] Time spent opening block manager: real 0.025s user 0.001s sys 0.002s
I20260810 13:53:56.316193 14244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data,/tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
uuid: "2928f7d4503145b182d99007d240334d"
format_stamp: "Formatted at 2026-08-10 13:53:14 on dist-test-slave-s11t"
I20260810 13:53:56.319739 14273 rpcz_store.cc:276] 0810 13:53:54.107414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.107520 (+ 106us) service_pool.cc:224] Handling call
0810 13:53:56.312063 (+2204543us) ts_tablet_manager.cc:1151] Deleting tablet 61169145c539464fa9cf62eaaf8168e5
0810 13:53:56.312125 (+ 62us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:56.312444 (+ 319us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2204032}
I20260810 13:53:56.319636 14244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260810 13:53:56.231578 12742 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 79) took 1997 ms (client timeout 1000 ms). Trace:
I20260810 13:53:56.233247 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:56.321969 14273 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 350) took 2227 ms. Trace:
I20260810 13:53:56.322259 14273 rpcz_store.cc:276] 0810 13:53:54.095053 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.104385 (+ 9332us) service_pool.cc:224] Handling call
0810 13:53:56.321668 (+2217283us) ts_tablet_manager.cc:1151] Deleting tablet 35ba701a453546088933416d17e71127
0810 13:53:56.321729 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:56.321922 (+ 193us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2170525}
I20260810 13:53:56.322701 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
W20260810 13:53:56.327294 12750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 77) took 2077 ms (client timeout 1000 ms). Trace:
I20260810 13:53:56.328500 13640 tablet_bootstrap.cc:654] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.330778 15034 raft_consensus.cc:493] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:53:56.331166 12750 rpcz_store.cc:269] 0810 13:53:54.249869 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.249974 (+ 105us) service_pool.cc:224] Handling call
0810 13:53:54.412098 (+162124us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:56.327220 (+1915122us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":337064832}
I20260810 13:53:56.331254 15034 raft_consensus.cc:515] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.330147 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:56.333016 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:56.333431 15034 leader_election.cc:290] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.333979 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:56.335103 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:53:56.335729 15027 raft_consensus.cc:493] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.336232 15027 raft_consensus.cc:515] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.349004 15034 raft_consensus.cc:493] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.349462 13640 tablet_bootstrap.cc:492] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:56.349968 13640 ts_tablet_manager.cc:1403] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.039s user 0.010s sys 0.000s
I20260810 13:53:56.349483 15034 raft_consensus.cc:515] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.351718 15034 leader_election.cc:290] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.353080 13640 raft_consensus.cc:359] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.353729 13640 raft_consensus.cc:385] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.353987 13640 raft_consensus.cc:740] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.357286 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:56.363157 15027 leader_election.cc:290] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.363519 13640 consensus_queue.cc:260] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.364823 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:56.367969 13640 ts_tablet_manager.cc:1434] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
W20260810 13:53:56.337014 12742 rpcz_store.cc:269] 0810 13:53:54.233737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.234012 (+ 275us) service_pool.cc:224] Handling call
0810 13:53:54.409520 (+175508us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:56.231325 (+1821805us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:55.830196 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:55.830578 (+ 382us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:55.830603 (+ 25us) write_op.cc:435] Acquired schema lock
0810 13:53:55.830617 (+ 14us) tablet.cc:662] Decoding operations
0810 13:53:55.830865 (+ 248us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:55.830895 (+ 30us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:55.830916 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:55.831046 (+ 130us) tablet.cc:701] Row locks acquired
0810 13:53:55.831066 (+ 20us) write_op.cc:260] PREPARE: finished
0810 13:53:55.831170 (+ 104us) write_op.cc:270] Start()
0810 13:53:55.831243 (+ 73us) write_op.cc:276] Timestamp: P: 1786370035827610 usec, L: 0
0810 13:53:55.831258 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:55.831677 (+ 419us) log.cc:844] Serialized 527 byte log entry
0810 13:53:56.210357 (+378680us) op_driver.cc:464] REPLICATION: finished
0810 13:53:56.220519 (+ 10162us) write_op.cc:301] APPLY: starting
0810 13:53:56.220583 (+ 64us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:56.220696 (+ 113us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:56.220780 (+ 84us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:56.220975 (+ 195us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:56.221104 (+ 129us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:56.221150 (+ 46us) write_op.cc:312] APPLY: finished
0810 13:53:56.221333 (+ 183us) log.cc:844] Serialized 23 byte log entry
0810 13:53:56.222032 (+ 699us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:56.222097 (+ 65us) write_op.cc:454] Released schema lock
0810 13:53:56.222126 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:56.235048 (+ 12922us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:56.235090 (+ 42us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"spinlock_wait_cycles":373467008,"child_traces":[["op",{"apply.queue_time_us":10008,"apply.run_cpu_time_us":1311,"apply.run_wall_time_us":14104,"num_ops":1,"prepare.queue_time_us":43756,"prepare.run_cpu_time_us":1800,"prepare.run_wall_time_us":47692,"raft.queue_time_us":86,"raft.run_cpu_time_us":12,"raft.run_wall_time_us":13,"replication_time_us":378960}]]}
I20260810 13:53:56.369050 13640 tablet_bootstrap.cc:492] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:56.372037 15034 raft_consensus.cc:493] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.372499 15034 raft_consensus.cc:515] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.374524 15034 leader_election.cc:290] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.381752 13639 tablet_bootstrap.cc:654] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.387615 15027 raft_consensus.cc:493] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.388175 15027 raft_consensus.cc:515] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.389005 13640 tablet_bootstrap.cc:654] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.296418 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 61fd4d043c354ad79d79c32498a469b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 97127b08237c4d2e81f9966db12d3fdb) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:56.398857 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 613d7ddce24b45c886139bf68c3c9a4d (DEFAULT_TABLE table=default.Table_22e32aea1f65480bb9ff9718ea6f6abb [id=86fc73b8720844e5b72ec9d679d7dc1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.442796 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613d7ddce24b45c886139bf68c3c9a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.401201 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063e3b74a9a248a1aa0c2de4b4b73a06" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:56.401726 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:56.465379 15127 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:53:56.465932 15127 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:56.470705 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fde417598648968b4013c54f0bc854. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.443624 13638 raft_consensus.cc:385] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.450490 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:56.482223 13638 raft_consensus.cc:740] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.418113 13639 tablet_bootstrap.cc:492] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:56.483721 15127 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:53:56.483829 13639 ts_tablet_manager.cc:1403] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.223s user 0.009s sys 0.001s
I20260810 13:53:56.486539 13639 raft_consensus.cc:359] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.487188 13639 raft_consensus.cc:385] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.487443 13639 raft_consensus.cc:740] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.488040 13639 consensus_queue.cc:260] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.490485 13639 ts_tablet_manager.cc:1434] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 13:53:56.491521 13639 tablet_bootstrap.cc:492] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:56.438408 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a490fcb16164f968335f069129b3d71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:56.457866 12952 leader_election.cc:343] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:56.477383 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 61fd4d043c354ad79d79c32498a469b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61fd4d043c354ad79d79c32498a469b4 already in progress: creating tablet
W20260810 13:53:56.517297 13130 tablet.cc:2406] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:53:56.367779 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_96cdf642a68642ce9fe947569577b42a [id=667ccf7ba20c49b2be82e167aa212ecd]). Expected version 3 got 2
I20260810 13:53:56.530575 15122 raft_consensus.cc:493] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.531157 15122 raft_consensus.cc:515] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.569602 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4e37b80b7645c2a14f3ab0c5e919d2" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:56.603011 13640 tablet_bootstrap.cc:492] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:56.603911 13640 ts_tablet_manager.cc:1403] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.235s user 0.030s sys 0.060s
I20260810 13:53:56.606427 13640 raft_consensus.cc:359] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.607089 13640 raft_consensus.cc:385] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.607350 13640 raft_consensus.cc:740] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.607980 13640 consensus_queue.cc:260] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.623062 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:56.623893 12743 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:53:56.629678 13640 ts_tablet_manager.cc:1434] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
W20260810 13:53:56.632489 12473 leader_election.cc:336] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2928f7d4503145b182d99007d240334d (127.12.36.61:35861): Network error: Client connection negotiation failed: client connection to 127.12.36.61:35861: connect: Connection refused (error 111)
I20260810 13:53:56.638001 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b84bd35b02f4a1faf15ac9bc21e6146" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:56.646551 13640 tablet_bootstrap.cc:492] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:56.652213 13640 tablet_bootstrap.cc:654] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.654465 13638 consensus_queue.cc:260] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.609325 15140 consensus_queue.cc:1048] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:56.646533 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 07ff9e8a8ca845b89154ed0626d34c5c (table default.Table_9656a7ccd188461fa55387c96150bb80 [id=1531ea1f96db44c8918e0d74570c0ffd]) successfully deleted
I20260810 13:53:56.660960 12999 tablet_service.cc:1511] Processing CreateTablet for tablet 613d7ddce24b45c886139bf68c3c9a4d (DEFAULT_TABLE table=default.Table_22e32aea1f65480bb9ff9718ea6f6abb [id=86fc73b8720844e5b72ec9d679d7dc1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.662616 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613d7ddce24b45c886139bf68c3c9a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.664932 13640 tablet_bootstrap.cc:492] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:56.665500 13640 ts_tablet_manager.cc:1403] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.000s
I20260810 13:53:56.672665 13640 raft_consensus.cc:359] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.674345 13640 raft_consensus.cc:385] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.674607 13640 raft_consensus.cc:740] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.675225 13640 consensus_queue.cc:260] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.678530 15122 leader_election.cc:290] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.681407 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 556 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:53:56.684983 15140 raft_consensus.cc:493] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.685721 15140 raft_consensus.cc:515] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.688608 15140 leader_election.cc:290] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.690747 13640 ts_tablet_manager.cc:1434] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260810 13:53:56.613674 15027 leader_election.cc:290] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.707850 13640 tablet_bootstrap.cc:492] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:56.714780 13640 tablet_bootstrap.cc:654] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.714704 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:56.715754 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:53:56.716619 12740 catalog_manager.cc:5719] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:53:56.656814 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43def9358894b2aa001a7db56706589" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:56.670715 13227 tablet_service.cc:1511] Processing CreateTablet for tablet b7a45cb763a84c7aa557fde815a92c07 (DEFAULT_TABLE table=default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f [id=cb722d559fe647018b6c959f6a93a037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.723147 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a45cb763a84c7aa557fde815a92c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.672501 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 82848ef8dc904879854929de47db1e50 (DEFAULT_TABLE table=default.Table_229c64c5f5804f6c8a3047ec7858322b [id=f8aaac66943a4d9d8d2bf15d12a18009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.725878 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82848ef8dc904879854929de47db1e50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.673565 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 3610bc4f8a0742fdb69347b40a04f078 (DEFAULT_TABLE table=default.Table_080235e72e36450ba5d17b341d2f2b2e [id=c9bacbddd4e24bdcad1b94ee64a34387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.673892 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 1a0f39d7fa7e4cac9dda6ec101229efd (DEFAULT_TABLE table=default.Table_131ccf6f50394a4facf6e622d5449b17 [id=b559d903254d433989a2deb00eb27361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.733465 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0f39d7fa7e4cac9dda6ec101229efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.738129 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3610bc4f8a0742fdb69347b40a04f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.674790 13216 tablet_service.cc:1511] Processing CreateTablet for tablet c1510cd3523646eba9333f7e6d85a5e8 (DEFAULT_TABLE table=default.Table_c39a51586fe847b990c6d2c59e2280ff [id=44428a121dc24f5ba5e5d74158f9f4d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.745069 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1510cd3523646eba9333f7e6d85a5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.752926 14244 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260810 13:53:56.755897 13640 tablet_bootstrap.cc:492] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:56.756356 13640 ts_tablet_manager.cc:1403] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.049s user 0.019s sys 0.023s
I20260810 13:53:56.759529 13640 raft_consensus.cc:359] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.760143 13640 raft_consensus.cc:385] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:56.760396 13640 raft_consensus.cc:740] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:56.761004 13640 consensus_queue.cc:260] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.763372 13640 ts_tablet_manager.cc:1434] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 13:53:56.773192 14244 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 13:53:56.774127 14244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 13:53:56.778322 13640 tablet_bootstrap.cc:492] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:56.783912 13269 raft_consensus.cc:2468] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:56.794565 13638 ts_tablet_manager.cc:1434] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.781s user 0.009s sys 0.000s
I20260810 13:53:56.807719 14956 raft_consensus.cc:493] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.808444 14956 raft_consensus.cc:515] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.809458 12952 leader_election.cc:304] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:56.810286 15027 raft_consensus.cc:2804] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:56.810799 14956 leader_election.cc:290] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.810819 15027 raft_consensus.cc:493] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:56.811197 15027 raft_consensus.cc:3060] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:56.814003 12999 tablet_service.cc:1511] Processing CreateTablet for tablet b7a45cb763a84c7aa557fde815a92c07 (DEFAULT_TABLE table=default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f [id=cb722d559fe647018b6c959f6a93a037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.815119 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a45cb763a84c7aa557fde815a92c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.816843 13639 tablet_bootstrap.cc:700] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: Time spent opening tablet: real 0.150s user 0.001s sys 0.000s
I20260810 13:53:56.817098 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 3610bc4f8a0742fdb69347b40a04f078 (DEFAULT_TABLE table=default.Table_080235e72e36450ba5d17b341d2f2b2e [id=c9bacbddd4e24bdcad1b94ee64a34387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.817463 13639 tablet_bootstrap.cc:654] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.818056 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3610bc4f8a0742fdb69347b40a04f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.819602 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 82848ef8dc904879854929de47db1e50 (DEFAULT_TABLE table=default.Table_229c64c5f5804f6c8a3047ec7858322b [id=f8aaac66943a4d9d8d2bf15d12a18009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.820632 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82848ef8dc904879854929de47db1e50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.822317 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 1a0f39d7fa7e4cac9dda6ec101229efd (DEFAULT_TABLE table=default.Table_131ccf6f50394a4facf6e622d5449b17 [id=b559d903254d433989a2deb00eb27361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.823350 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0f39d7fa7e4cac9dda6ec101229efd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:56.830281 13558 tablet.cc:2406] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:53:56.830749 14956 raft_consensus.cc:493] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.831264 14956 raft_consensus.cc:515] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.832288 12471 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:53:56.833375 15127 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:56.833581 14956 leader_election.cc:290] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.836328 13011 tablet_service.cc:1511] Processing CreateTablet for tablet c1510cd3523646eba9333f7e6d85a5e8 (DEFAULT_TABLE table=default.Table_c39a51586fe847b990c6d2c59e2280ff [id=44428a121dc24f5ba5e5d74158f9f4d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.837385 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1510cd3523646eba9333f7e6d85a5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:56.842144 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:56.808962 13269 raft_consensus.cc:3060] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:56.845746 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:56.826851 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:56.828208 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:56.834256 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 8473def35a97492a9172b483c2d670d9 (DEFAULT_TABLE table=default.Table_312808fed3bf45e8923e2b1be7f4d9fa [id=4de804595a6142819c0ea2f64fd1e34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.848588 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4e37b80b7645c2a14f3ab0c5e919d2" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:56.849443 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8473def35a97492a9172b483c2d670d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:56.810372 13577 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s user 0.004s sys 0.008s
W20260810 13:53:56.849776 13577 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s user 0.005s sys 0.008s
I20260810 13:53:56.851261 13640 tablet_bootstrap.cc:654] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:56.835374 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 48a059240c0f48ee958ef728acfcae92 (DEFAULT_TABLE table=default.Table_36d488faa81542ca8b55867672ca281a [id=a5d09cc8bf6b43aab5fa7aaae75baa3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:56.853372 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a059240c0f48ee958ef728acfcae92. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:56.854055 13638 ts_tablet_manager.cc:1467] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Tablet startup took 840ms
I20260810 13:53:56.841063 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a3a4d2724b42da83a523e208b5714b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:56.811914 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 61169145c539464fa9cf62eaaf8168e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61169145c539464fa9cf62eaaf8168e5 already in progress: creating tablet
W20260810 13:53:56.856962 12717 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 191261us
W20260810 13:53:56.857652 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 35ba701a453546088933416d17e71127 because the tablet was not found. No further retry: Not found: Tablet not found: 35ba701a453546088933416d17e71127
W20260810 13:53:56.858466 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 1d78892783474b329e31bf2df7d2952c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1d78892783474b329e31bf2df7d2952c already in progress: creating tablet
W20260810 13:53:56.859205 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 1330bcef6f234943b6b935b54aa3edfd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1330bcef6f234943b6b935b54aa3edfd already in progress: creating tablet
W20260810 13:53:56.859879 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet ef59f7013ab4489dadd9084d065533a8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef59f7013ab4489dadd9084d065533a8 already in progress: creating tablet
W20260810 13:53:56.854296 13638 ts_tablet_manager.cc:1469] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Trace:
0810 13:53:34.885428 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:34.885644 (+ 216us) service_pool.cc:224] Handling call
0810 13:53:34.887381 (+ 1737us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:34.887453 (+ 72us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:35.279591 (+392138us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:35.288115 (+ 8524us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:35.288805 (+ 690us) inbound_call.cc:177] Queueing success response
0810 13:53:55.968162 (+20679357us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:53:56.013791 (+ 45629us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:53:56.014336 (+ 545us) tablet_replica.cc:261] Starting instrumentation
0810 13:53:56.046260 (+ 31924us) tablet_replica.cc:280] Starting consensus
0810 13:53:56.640519 (+594259us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b4c00003480. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f911c79dfc0 00007f911c7aefa9 00007f911c774214 00007f911c79c4cd 00007f911c79c133 00007f911eb3e56b 00007f911eb3f095 00007f911eb3a310 00007f911eb39020 00007f911ef8b50e 00007f911fbf1b9a
Metrics: {"raft.queue_time_us":621,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":211,"spinlock_wait_cycles":296695552,"tablet-open.queue_time_us":20679554}
I20260810 13:53:56.867708 13638 tablet_bootstrap.cc:492] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:53:56.875068 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 63420.8us
W20260810 13:53:56.876909 13382 leader_election.cc:343] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:56.877353 15034 raft_consensus.cc:493] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:53:56.877596 13382 leader_election.cc:343] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:56.877873 15034 raft_consensus.cc:515] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:56.878357 13382 leader_election.cc:343] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:56.879068 13382 leader_election.cc:343] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:56.879885 15034 leader_election.cc:290] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:56.880757 15138 raft_consensus.cc:493] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:56.881207 15138 raft_consensus.cc:515] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:56.883814 12952 leader_election.cc:343] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:56.884606 15138 leader_election.cc:290] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:56.885319 15144 consensus_queue.cc:1048] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:56.900826 15027 raft_consensus.cc:515] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:56.903894 15027 leader_election.cc:290] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:53:56.906906 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f consensus state has no leader
I20260810 13:53:56.907640 12746 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:48758 (request call id 492) took 1520 ms. Trace:
I20260810 13:53:56.907979 12746 rpcz_store.cc:276] 0810 13:53:55.387177 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:55.816107 (+428930us) service_pool.cc:224] Handling call
0810 13:53:55.833369 (+ 17262us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c8846 00007fec6df85634 00007fec6df855c2 00007fec6df854f1 00007fec6df8546c 00007fec6df84722 00007fec6c22207c 00007fec6c2214b6
0810 13:53:55.834100 (+ 731us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:55.835266 (+ 1166us) catalog_manager.cc:3751] Apply alter schema
0810 13:53:55.835794 (+ 528us) catalog_manager.cc:3783] Acquired catalog manager lock
0810 13:53:55.835961 (+ 167us) catalog_manager.cc:3941] Updating metadata on disk
0810 13:53:56.905468 (+1069507us) catalog_manager.cc:3972] Committing alterations to in-memory state
0810 13:53:56.907546 (+ 2078us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:55.878012 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:55.878362 (+ 350us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:55.878385 (+ 23us) write_op.cc:435] Acquired schema lock
0810 13:53:55.878397 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:55.878616 (+ 219us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:55.878648 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:55.878669 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:55.878872 (+ 203us) tablet.cc:701] Row locks acquired
0810 13:53:55.878886 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:55.878992 (+ 106us) write_op.cc:270] Start()
0810 13:53:55.879070 (+ 78us) write_op.cc:276] Timestamp: P: 1786370035875429 usec, L: 0
0810 13:53:55.879086 (+ 16us) op_driver.cc:348] REPLICATION: starting
0810 13:53:55.879526 (+ 440us) log.cc:844] Serialized 405 byte log entry
0810 13:53:56.898577 (+1019051us) op_driver.cc:464] REPLICATION: finished
0810 13:53:56.899431 (+ 854us) write_op.cc:301] APPLY: starting
0810 13:53:56.899516 (+ 85us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:56.899642 (+ 126us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:56.899768 (+ 126us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:56.900005 (+ 237us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:56.900147 (+ 142us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:56.900269 (+ 122us) write_op.cc:312] APPLY: finished
0810 13:53:56.900611 (+ 342us) log.cc:844] Serialized 23 byte log entry
0810 13:53:56.900923 (+ 312us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:56.901073 (+ 150us) write_op.cc:454] Released schema lock
0810 13:53:56.901122 (+ 49us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:56.901490 (+ 368us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:56.901525 (+ 35us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":28426624,"child_traces":[["op",{"apply.queue_time_us":640,"apply.run_cpu_time_us":1989,"apply.run_wall_time_us":1989,"num_ops":1,"prepare.queue_time_us":11352,"prepare.run_cpu_time_us":1777,"prepare.run_wall_time_us":2859,"raft.queue_time_us":85,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":12,"replication_time_us":1019360}]]}
I20260810 13:53:56.914963 12745 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 493) took 1362 ms. Trace:
I20260810 13:53:56.917553 12745 rpcz_store.cc:276] 0810 13:53:55.551884 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:55.844383 (+292499us) service_pool.cc:224] Handling call
0810 13:53:55.867818 (+ 23435us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:53:55.870024 (+ 2206us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:53:55.871469 (+ 1445us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:53:56.913475 (+1042006us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:53:56.914039 (+ 564us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:53:56.914541 (+ 502us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:55.880974 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:55.881336 (+ 362us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:55.881360 (+ 24us) write_op.cc:435] Acquired schema lock
0810 13:53:55.881371 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:55.881623 (+ 252us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:55.881658 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:55.881682 (+ 24us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:55.881883 (+ 201us) tablet.cc:701] Row locks acquired
0810 13:53:55.881898 (+ 15us) write_op.cc:260] PREPARE: finished
0810 13:53:55.881997 (+ 99us) write_op.cc:270] Start()
0810 13:53:55.882069 (+ 72us) write_op.cc:276] Timestamp: P: 1786370035878435 usec, L: 0
0810 13:53:55.882085 (+ 16us) op_driver.cc:348] REPLICATION: starting
0810 13:53:55.882511 (+ 426us) log.cc:844] Serialized 433 byte log entry
0810 13:53:56.208733 (+326222us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400010a20. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e4cea98 00007fec6e4ce6da 00007fec6e552d45 00007fec6e5531e9 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1
0810 13:53:56.686139 (+477406us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b58000503d0. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e4b181c 00007fec6e4b8133 00007fec6e4b80b9 00007fec6e4b8049 00007fec6e4b8011 00007fec6e4b71dd 00000000005bd8c4 00000000005bd6f9 00007fec673f1db5 00007fec673f4121
0810 13:53:56.898862 (+212723us) op_driver.cc:464] REPLICATION: finished
0810 13:53:56.901846 (+ 2984us) write_op.cc:301] APPLY: starting
0810 13:53:56.901922 (+ 76us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:56.902166 (+ 244us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:56.902196 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:56.902879 (+ 683us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:56.903127 (+ 248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:53:56.903213 (+ 86us) write_op.cc:312] APPLY: finished
0810 13:53:56.903487 (+ 274us) log.cc:844] Serialized 29 byte log entry
0810 13:53:56.903722 (+ 235us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:56.903906 (+ 184us) write_op.cc:454] Released schema lock
0810 13:53:56.903974 (+ 68us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":50955136,"child_traces":[["op",{"apply.queue_time_us":2808,"apply.run_cpu_time_us":2483,"apply.run_wall_time_us":13569,"num_ops":2,"prepare.queue_time_us":8384,"prepare.run_cpu_time_us":17045,"prepare.run_wall_time_us":969349,"raft.queue_time_us":363085,"raft.run_cpu_time_us":3273,"raft.run_wall_time_us":469890,"replication_time_us":1016691,"spinlock_wait_cycles":1489040000,"thread_start_us":640878,"threads_started":2}]]}
I20260810 13:53:56.953274 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:56.954800 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet ac2c102382734913bffb5436e06fe0a1 (table default.Table_bbf02f15a5404f0d95042f20dac5c146 [id=cb4b9877529f4cc38a48b2a61be4aa6c]). Expected version 2 got 0
I20260810 13:53:56.955379 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43def9358894b2aa001a7db56706589" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:56.955969 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:53:56.956180 13040 raft_consensus.cc:2468] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:56.956508 12740 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:53:56.963807 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a3a4d2724b42da83a523e208b5714b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:56.978770 13639 tablet_bootstrap.cc:492] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
W20260810 13:53:56.834975 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 61fd4d043c354ad79d79c32498a469b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61fd4d043c354ad79d79c32498a469b4 already in progress: creating tablet
W20260810 13:53:56.982410 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 147463us
I20260810 13:53:57.014657 13640 tablet_bootstrap.cc:492] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:57.015089 13640 ts_tablet_manager.cc:1403] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.237s user 0.014s sys 0.035s
I20260810 13:53:57.011101 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c7b5e070007b4fab95eda8b85768c899"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:57.026047 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7b5e070007b4fab95eda8b85768c899 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:57.012444 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_253b7e39c5104cbf95380f1adce4c89c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:57.028157 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_253b7e39c5104cbf95380f1adce4c89c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:57.013803 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c42d109e12a9416384e73d68761d43d7" } new_table_name: "default.Table_d3b5260520ea4849ae4aacd58dc0dd68" modify_external_catalogs: true
I20260810 13:53:57.032112 13640 raft_consensus.cc:359] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.034184 13640 raft_consensus.cc:385] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:57.034469 13640 raft_consensus.cc:740] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:57.035128 13640 consensus_queue.cc:260] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.061784 13640 ts_tablet_manager.cc:1434] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.046s user 0.006s sys 0.001s
W20260810 13:53:57.070099 13345 tablet.cc:2406] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:53:57.079134 13640 tablet_bootstrap.cc:492] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:53:57.094125 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f consensus state has no leader
I20260810 13:53:57.103623 13638 tablet_bootstrap.cc:654] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:57.104815 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4946f79b54c46b1a59edf169109ab47" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:57.109172 12747 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_ed026dd607ea4b2e8b1f22bee438879d [id=5b919872756647048ea2e4fecbe78537] alter complete (version 2)
W20260810 13:53:57.121140 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 87017.8us
I20260810 13:53:57.124979 13213 tablet_service.cc:1511] Processing CreateTablet for tablet cafed58a5994479e91678ddbe74cd353 (DEFAULT_TABLE table=default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.126380 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cafed58a5994479e91678ddbe74cd353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.141245 13425 tablet_service.cc:1558] Processing DeleteTablet for tablet 61fd4d043c354ad79d79c32498a469b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 97127b08237c4d2e81f9966db12d3fdb) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:56.981372 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 96313.1us
I20260810 13:53:57.157147 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b84bd35b02f4a1faf15ac9bc21e6146" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:57.157866 13257 raft_consensus.cc:3060] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:57.162024 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:57.164769 13639 ts_tablet_manager.cc:1403] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.673s user 0.010s sys 0.005s
I20260810 13:53:57.184125 13257 raft_consensus.cc:2468] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:57.188939 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:57.189785 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:57.190444 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
W20260810 13:53:57.195955 12749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 80) took 1764 ms (client timeout 1000 ms). Trace:
I20260810 13:53:57.200145 13424 tablet_service.cc:1511] Processing CreateTablet for tablet 7a490fcb16164f968335f069129b3d71 (DEFAULT_TABLE table=default.Table_7515aaeccfe14052b6fd5de21c880a9b [id=e84d542e0e9d4fb188063d945e191b2f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.201476 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a490fcb16164f968335f069129b3d71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.204660 13638 tablet_bootstrap.cc:492] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:57.205350 13638 ts_tablet_manager.cc:1403] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.338s user 0.007s sys 0.007s
I20260810 13:53:57.206787 12952 leader_election.cc:304] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:57.208096 15144 raft_consensus.cc:2804] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:57.208562 15144 raft_consensus.cc:697] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:53:57.212764 15144 consensus_queue.cc:237] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.214003 15034 raft_consensus.cc:493] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:57.214454 15034 raft_consensus.cc:515] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.216317 15034 leader_election.cc:290] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:57.221406 13638 raft_consensus.cc:359] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.222184 13638 raft_consensus.cc:385] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:57.222486 13638 raft_consensus.cc:740] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:57.235415 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 613d7ddce24b45c886139bf68c3c9a4d (DEFAULT_TABLE table=default.Table_22e32aea1f65480bb9ff9718ea6f6abb [id=86fc73b8720844e5b72ec9d679d7dc1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.236148 13417 tablet_service.cc:1511] Processing CreateTablet for tablet 82848ef8dc904879854929de47db1e50 (DEFAULT_TABLE table=default.Table_229c64c5f5804f6c8a3047ec7858322b [id=f8aaac66943a4d9d8d2bf15d12a18009]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.237934 13432 tablet_service.cc:1511] Processing CreateTablet for tablet 3610bc4f8a0742fdb69347b40a04f078 (DEFAULT_TABLE table=default.Table_080235e72e36450ba5d17b341d2f2b2e [id=c9bacbddd4e24bdcad1b94ee64a34387]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.240136 13434 tablet_service.cc:1511] Processing CreateTablet for tablet b7a45cb763a84c7aa557fde815a92c07 (DEFAULT_TABLE table=default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f [id=cb722d559fe647018b6c959f6a93a037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.244710 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613d7ddce24b45c886139bf68c3c9a4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.245434 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82848ef8dc904879854929de47db1e50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.250056 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a45cb763a84c7aa557fde815a92c07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.253157 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3610bc4f8a0742fdb69347b40a04f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.261510 13640 tablet_bootstrap.cc:654] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:57.283109 12749 rpcz_store.cc:269] 0810 13:53:55.431715 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:55.526921 (+ 95206us) service_pool.cc:224] Handling call
0810 13:53:57.195878 (+1668957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25768,"reported_tablets":6}
I20260810 13:53:57.253428 12739 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 494) took 1656 ms. Trace:
I20260810 13:53:57.284245 12739 rpcz_store.cc:276] 0810 13:53:55.597019 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:55.963031 (+366012us) service_pool.cc:224] Handling call
0810 13:53:56.209843 (+246812us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:53:56.214884 (+ 5041us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:53:56.216995 (+ 2111us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:53:57.165334 (+948339us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:53:57.253038 (+ 87704us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:53:57.253360 (+ 322us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:56.850518 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:56.850961 (+ 443us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:56.850996 (+ 35us) write_op.cc:435] Acquired schema lock
0810 13:53:56.851031 (+ 35us) tablet.cc:662] Decoding operations
0810 13:53:56.851387 (+ 356us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:56.851458 (+ 71us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:56.851480 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:56.851706 (+ 226us) tablet.cc:701] Row locks acquired
0810 13:53:56.851719 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:53:56.851851 (+ 132us) write_op.cc:270] Start()
0810 13:53:56.851964 (+ 113us) write_op.cc:276] Timestamp: P: 1786370036851786 usec, L: 0
0810 13:53:56.851983 (+ 19us) op_driver.cc:348] REPLICATION: starting
0810 13:53:57.018870 (+166887us) log.cc:844] Serialized 433 byte log entry
0810 13:53:57.020974 (+ 2104us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e553208 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1 00007fec6e9e650d 00000000005bd8c4 00000000005bd6f9
0810 13:53:57.084710 (+ 63736us) op_driver.cc:464] REPLICATION: finished
0810 13:53:57.085321 (+ 611us) write_op.cc:301] APPLY: starting
0810 13:53:57.085407 (+ 86us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:57.085541 (+ 134us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:57.085563 (+ 22us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:57.086565 (+ 1002us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:57.086786 (+ 221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:53:57.086845 (+ 59us) write_op.cc:312] APPLY: finished
0810 13:53:57.087165 (+ 320us) log.cc:844] Serialized 29 byte log entry
0810 13:53:57.148890 (+ 61725us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.148994 (+ 104us) write_op.cc:454] Released schema lock
0810 13:53:57.149035 (+ 41us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:57.173358 (+ 24323us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.175011 (+ 1653us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":564747520,"child_traces":[["op",{"apply.queue_time_us":353,"apply.run_cpu_time_us":2759,"apply.run_wall_time_us":84253,"num_ops":2,"prepare.queue_time_us":632015,"prepare.run_cpu_time_us":4491,"prepare.run_wall_time_us":170705,"raft.queue_time_us":125,"raft.run_cpu_time_us":733,"raft.run_wall_time_us":733,"replication_time_us":232576,"spinlock_wait_cycles":381740672}]]}
I20260810 13:53:57.231194 13638 consensus_queue.cc:260] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.294302 15034 raft_consensus.cc:493] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:57.294821 15034 raft_consensus.cc:515] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.297185 13638 ts_tablet_manager.cc:1434] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.091s user 0.008s sys 0.000s
I20260810 13:53:57.297381 15034 leader_election.cc:290] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:57.303063 13639 raft_consensus.cc:359] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.303831 13639 raft_consensus.cc:385] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:57.304104 13639 raft_consensus.cc:740] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:57.310223 13229 tablet_service.cc:1511] Processing CreateTablet for tablet baa17cc9fd524b0981cb2368a7265df1 (DEFAULT_TABLE table=default.Table_a80ad2cc0680447898f832a3da957607 [id=b7e44fb60b9b401db5517c2fd7e8c70b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.321162 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 1a0f39d7fa7e4cac9dda6ec101229efd (DEFAULT_TABLE table=default.Table_131ccf6f50394a4facf6e622d5449b17 [id=b559d903254d433989a2deb00eb27361]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.321930 13442 tablet_service.cc:1511] Processing CreateTablet for tablet c1510cd3523646eba9333f7e6d85a5e8 (DEFAULT_TABLE table=default.Table_c39a51586fe847b990c6d2c59e2280ff [id=44428a121dc24f5ba5e5d74158f9f4d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.322450 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a0f39d7fa7e4cac9dda6ec101229efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.323462 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1510cd3523646eba9333f7e6d85a5e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.329538 13638 tablet_bootstrap.cc:492] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:57.134132 14888 ts_tablet_manager.cc:1929] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:57.351670 14888 log.cc:1199] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/35c43f7f8b7e4e56b5edbabe242c9dde
I20260810 13:53:57.340380 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa17cc9fd524b0981cb2368a7265df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.378691 15138 consensus_queue.cc:1048] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:57.369498 13040 raft_consensus.cc:3060] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:57.370934 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4946f79b54c46b1a59edf169109ab47" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:57.373092 13050 raft_consensus.cc:3060] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:57.373683 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 48a059240c0f48ee958ef728acfcae92 (DEFAULT_TABLE table=default.Table_36d488faa81542ca8b55867672ca281a [id=a5d09cc8bf6b43aab5fa7aaae75baa3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.394830 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a059240c0f48ee958ef728acfcae92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.374010 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet f4946f79b54c46b1a59edf169109ab47 with delete_type TABLET_DATA_DELETED (replaced by tablet dd58cc128ce64f9abe1418b6093a1c2c) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:57.374854 13007 tablet_service.cc:1511] Processing CreateTablet for tablet cafed58a5994479e91678ddbe74cd353 (DEFAULT_TABLE table=default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.397779 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cafed58a5994479e91678ddbe74cd353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.376137 13022 tablet_service.cc:1511] Processing CreateTablet for tablet baa17cc9fd524b0981cb2368a7265df1 (DEFAULT_TABLE table=default.Table_a80ad2cc0680447898f832a3da957607 [id=b7e44fb60b9b401db5517c2fd7e8c70b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.401463 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa17cc9fd524b0981cb2368a7265df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.421336 14888 ts_tablet_manager.cc:1950] T 35c43f7f8b7e4e56b5edbabe242c9dde P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:57.422307 14888 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 345) took 1125 ms. Trace:
I20260810 13:53:57.424065 14888 rpcz_store.cc:276] 0810 13:53:56.297286 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:56.297422 (+ 136us) service_pool.cc:224] Handling call
0810 13:53:56.298049 (+ 627us) ts_tablet_manager.cc:1151] Deleting tablet 35c43f7f8b7e4e56b5edbabe242c9dde
0810 13:53:56.298086 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:56.868806 (+570720us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:57.133971 (+265165us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:57.422242 (+288271us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":141}
I20260810 13:53:57.433305 14888 tablet_replica.cc:333] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:57.441370 14888 raft_consensus.cc:2243] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:57.447096 12739 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0644d20557a146a193d56d2b30b4c726" } modify_external_catalogs: true
I20260810 13:53:57.447818 12739 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0644d20557a146a193d56d2b30b4c726" } modify_external_catalogs: true
I20260810 13:53:57.450212 13638 tablet_bootstrap.cc:654] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:57.453518 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 8473def35a97492a9172b483c2d670d9 (DEFAULT_TABLE table=default.Table_312808fed3bf45e8923e2b1be7f4d9fa [id=4de804595a6142819c0ea2f64fd1e34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.454638 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8473def35a97492a9172b483c2d670d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.464497 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d04860a72c64a5db966e2784c6dbbf0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:57.465085 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 48a059240c0f48ee958ef728acfcae92 (DEFAULT_TABLE table=default.Table_36d488faa81542ca8b55867672ca281a [id=a5d09cc8bf6b43aab5fa7aaae75baa3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.465761 13442 tablet_service.cc:1511] Processing CreateTablet for tablet cafed58a5994479e91678ddbe74cd353 (DEFAULT_TABLE table=default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.465984 13432 tablet_service.cc:1558] Processing DeleteTablet for tablet d9ada39233e9421d9870565c73f2ee16 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:57.465798 13421 tablet_service.cc:1558] Processing DeleteTablet for tablet f62023d553cd46cab920de44baa96eec with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:33 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:57.466953 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet f7afa380245248f5bac203b0905721c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:57.468137 13426 tablet_service.cc:1558] Processing DeleteTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:57.469218 13428 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dea61b84b614ead8830873568f9b7c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:57.473124 13638 tablet_bootstrap.cc:492] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:57.473628 13638 ts_tablet_manager.cc:1403] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.144s user 0.009s sys 0.002s
I20260810 13:53:57.490494 13638 raft_consensus.cc:359] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.491146 13638 raft_consensus.cc:385] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:57.491415 13638 raft_consensus.cc:740] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:53:57.493999 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 116364us
I20260810 13:53:57.492035 13638 consensus_queue.cc:260] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:57.497221 12743 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 78) took 3039 ms (client timeout 1000 ms). Trace:
W20260810 13:53:57.497586 12743 rpcz_store.cc:269] 0810 13:53:54.457586 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:54.464095 (+ 6509us) service_pool.cc:224] Handling call
0810 13:53:57.497124 (+3033029us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":19}
I20260810 13:53:57.511471 12750 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 495) took 1789 ms. Trace:
I20260810 13:53:57.512328 13638 ts_tablet_manager.cc:1434] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260810 13:53:57.511811 12750 rpcz_store.cc:276] 0810 13:53:55.721810 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:56.332403 (+610593us) service_pool.cc:224] Handling call
0810 13:53:57.012343 (+679940us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:53:57.253745 (+241402us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:53:57.278094 (+ 24349us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:53:57.510848 (+232754us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:53:57.511162 (+ 314us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:53:57.511414 (+ 252us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:57.444005 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:57.444386 (+ 381us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:57.444409 (+ 23us) write_op.cc:435] Acquired schema lock
0810 13:53:57.444421 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:57.444672 (+ 251us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:57.488832 (+ 44160us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:57.488869 (+ 37us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:57.489096 (+ 227us) tablet.cc:701] Row locks acquired
0810 13:53:57.489111 (+ 15us) write_op.cc:260] PREPARE: finished
0810 13:53:57.489236 (+ 125us) write_op.cc:270] Start()
0810 13:53:57.489329 (+ 93us) write_op.cc:276] Timestamp: P: 1786370037489166 usec, L: 0
0810 13:53:57.489347 (+ 18us) op_driver.cc:348] REPLICATION: starting
0810 13:53:57.499093 (+ 9746us) log.cc:844] Serialized 433 byte log entry
0810 13:53:57.508919 (+ 9826us) op_driver.cc:464] REPLICATION: finished
0810 13:53:57.509225 (+ 306us) write_op.cc:301] APPLY: starting
0810 13:53:57.509280 (+ 55us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:57.509384 (+ 104us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:57.509479 (+ 95us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:57.509886 (+ 407us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:57.510027 (+ 141us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:53:57.510086 (+ 59us) write_op.cc:312] APPLY: finished
0810 13:53:57.510265 (+ 179us) log.cc:844] Serialized 29 byte log entry
0810 13:53:57.510422 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.510486 (+ 64us) write_op.cc:454] Released schema lock
0810 13:53:57.510516 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:57.510738 (+ 222us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.510763 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":1497565440,"child_traces":[["op",{"apply.queue_time_us":159,"apply.run_cpu_time_us":1487,"apply.run_wall_time_us":1486,"num_ops":2,"prepare.queue_time_us":164524,"prepare.run_cpu_time_us":2238,"prepare.run_wall_time_us":58160,"raft.queue_time_us":87,"raft.run_cpu_time_us":703,"raft.run_wall_time_us":702,"replication_time_us":19481}]]}
I20260810 13:53:57.519793 12750 master_service.cc:960] ReplaceTablet: received request to replace tablet c793dedc5e714fe6bd36e507695e82d0 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:57.542882 13638 tablet_bootstrap.cc:492] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:57.546671 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet c4db9d7e82414cab8a69618effe89b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:57.548000 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:57.549116 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c80bc85fe25433ab2559ea0ada61978 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:49 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:57.552079 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:57.552910 13480 raft_consensus.cc:2393] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:57.560967 13638 tablet_bootstrap.cc:654] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:57.562551 14888 raft_consensus.cc:2272] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:57.562400 13229 tablet_service.cc:1511] Processing CreateTablet for tablet bd3119d63857480294dcb68ed0451bc0 (DEFAULT_TABLE table=default.Table_866916d7d8234bcb8dfc9bff54ada066 [id=69ab247d257c42e89ed2ebe36dde8c01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.490754 13639 consensus_queue.cc:260] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.563678 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3119d63857480294dcb68ed0451bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.568161 13639 ts_tablet_manager.cc:1434] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.392s user 0.006s sys 0.001s
I20260810 13:53:57.380386 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 8473def35a97492a9172b483c2d670d9 (DEFAULT_TABLE table=default.Table_312808fed3bf45e8923e2b1be7f4d9fa [id=4de804595a6142819c0ea2f64fd1e34c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.575654 12999 tablet_service.cc:1511] Processing CreateTablet for tablet bd3119d63857480294dcb68ed0451bc0 (DEFAULT_TABLE table=default.Table_866916d7d8234bcb8dfc9bff54ada066 [id=69ab247d257c42e89ed2ebe36dde8c01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.577837 15138 consensus_queue.cc:1048] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:57.579087 15203 consensus_queue.cc:1048] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:57.585741 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3119d63857480294dcb68ed0451bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.597270 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8473def35a97492a9172b483c2d670d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.602806 14888 ts_tablet_manager.cc:1916] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:57.602891 13213 tablet_service.cc:1511] Processing CreateTablet for tablet ad6a373308fa4b039e8331d9a0a90d16 (DEFAULT_TABLE table=default.Table_de6ec143f22d4a129657021013e42fb8 [id=9f7549a9604c496b934fdac98cdae2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.603902 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6a373308fa4b039e8331d9a0a90d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.610635 13638 tablet_bootstrap.cc:492] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:57.611138 13638 ts_tablet_manager.cc:1403] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.069s user 0.006s sys 0.003s
I20260810 13:53:57.611370 13640 tablet_bootstrap.cc:492] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:57.611794 13640 ts_tablet_manager.cc:1403] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.533s user 0.008s sys 0.002s
I20260810 13:53:57.613708 13638 raft_consensus.cc:359] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.614347 13638 raft_consensus.cc:385] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:57.614203 13640 raft_consensus.cc:359] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.614627 13638 raft_consensus.cc:740] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:57.470919 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48a059240c0f48ee958ef728acfcae92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.614805 13640 raft_consensus.cc:385] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:57.624469 13640 raft_consensus.cc:740] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:57.625167 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cafed58a5994479e91678ddbe74cd353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.631757 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:57.631808 13638 consensus_queue.cc:260] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.632470 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:57.633806 13638 ts_tablet_manager.cc:1434] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.022s user 0.003s sys 0.004s
I20260810 13:53:57.638947 13639 tablet_bootstrap.cc:492] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:57.638527 13640 consensus_queue.cc:260] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.652846 13638 tablet_bootstrap.cc:492] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:57.661653 13640 ts_tablet_manager.cc:1434] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.050s user 0.007s sys 0.000s
I20260810 13:53:57.665375 13640 tablet_bootstrap.cc:492] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:57.677299 13640 tablet_bootstrap.cc:654] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:57.687395 13638 tablet_bootstrap.cc:654] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:57.690900 14888 ts_tablet_manager.cc:1929] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:57.691388 14888 log.cc:1199] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/f4946f79b54c46b1a59edf169109ab47
I20260810 13:53:57.701952 13021 tablet_service.cc:1511] Processing CreateTablet for tablet ad6a373308fa4b039e8331d9a0a90d16 (DEFAULT_TABLE table=default.Table_de6ec143f22d4a129657021013e42fb8 [id=9f7549a9604c496b934fdac98cdae2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.645538 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_bbf02f15a5404f0d95042f20dac5c146" } modify_external_catalogs: true
I20260810 13:53:57.664029 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 35c43f7f8b7e4e56b5edbabe242c9dde (table default.Table_c75d32693a7f4df68c1f2c97bfaf15f5 [id=6fef18912c5c43519e5759644317fc3c]) successfully deleted
I20260810 13:53:57.711148 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6a373308fa4b039e8331d9a0a90d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.713275 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b84bd35b02f4a1faf15ac9bc21e6146" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:57.714003 13480 raft_consensus.cc:2468] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:57.716434 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:57.717144 13480 raft_consensus.cc:2393] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:57.702211 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:53:57.721596 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:57.722378 12746 catalog_manager.cc:5719] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:57.725898 15203 raft_consensus.cc:493] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:57.726428 15203 raft_consensus.cc:515] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.729494 15203 leader_election.cc:290] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:57.760337 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:57.761123 13480 raft_consensus.cc:2468] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:53:57.768471 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b84bd35b02f4a1faf15ac9bc21e6146" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:57.769066 13470 raft_consensus.cc:3060] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:57.774863 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4cd2e5c73e467eb1bc4623e5d5e831" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:57.776791 13470 raft_consensus.cc:2468] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:53:57.777071 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5d7a695c694d1993c2d0c4d3127fca" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:57.777719 13265 raft_consensus.cc:2468] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:57.780942 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5ad84fe2604dd2959768db31f66e7c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:53:57.784288 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:53:57.785490 15203 consensus_queue.cc:1048] T 5f1df2c9593442afa84849da6874f0f4 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:57.800760 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43def9358894b2aa001a7db56706589" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:57.801375 13043 raft_consensus.cc:2468] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:57.803213 13167 leader_election.cc:304] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:57.805342 15063 raft_consensus.cc:2804] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:57.805696 15063 raft_consensus.cc:493] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:57.806025 15063 raft_consensus.cc:3060] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:57.806854 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4cd2e5c73e467eb1bc4623e5d5e831" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:57.811370 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5d7a695c694d1993c2d0c4d3127fca" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:57.811959 13043 raft_consensus.cc:2468] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:53:57.824738 15063 raft_consensus.cc:515] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.829475 15063 leader_election.cc:290] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:57.723902 12746 catalog_manager.cc:5719] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:57.841524 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ac2c102382734913bffb5436e06fe0a1 (table default.Table_bbf02f15a5404f0d95042f20dac5c146 [id=cb4b9877529f4cc38a48b2a61be4aa6c]). Expected version 2 got 0
I20260810 13:53:57.847344 14888 ts_tablet_manager.cc:1950] T f4946f79b54c46b1a59edf169109ab47 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:57.849607 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5ad84fe2604dd2959768db31f66e7c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:57.851203 13639 tablet_bootstrap.cc:654] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:57.856761 15138 raft_consensus.cc:493] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:57.857303 15138 raft_consensus.cc:515] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.883046 13638 tablet_bootstrap.cc:492] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:57.883610 13638 ts_tablet_manager.cc:1403] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.231s user 0.022s sys 0.024s
W20260810 13:53:57.884552 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 81410.4us
I20260810 13:53:57.893721 13638 raft_consensus.cc:359] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.904119 13638 raft_consensus.cc:385] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:57.907186 13640 tablet_bootstrap.cc:492] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:57.907632 13640 ts_tablet_manager.cc:1403] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.242s user 0.013s sys 0.000s
I20260810 13:53:57.907616 13638 raft_consensus.cc:740] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:57.908484 13638 consensus_queue.cc:260] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:57.927640 12742 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 496) took 2181 ms. Trace:
I20260810 13:53:57.931864 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 62e88a52755140019a6d9f7041db0837 (DEFAULT_TABLE table=default.Table_9f48e93a010b4fc5b43124a1f8248ddf [id=011f63bf5ea44f918070a9ead229fa95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.932263 13638 ts_tablet_manager.cc:1434] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.048s user 0.007s sys 0.000s
I20260810 13:53:57.933274 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e88a52755140019a6d9f7041db0837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.929452 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet c793dedc5e714fe6bd36e507695e82d0
I20260810 13:53:57.935920 12746 catalog_manager.cc:5719] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:57.940016 13638 tablet_bootstrap.cc:492] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:57.968458 13229 tablet_service.cc:1558] Processing DeleteTablet for tablet c793dedc5e714fe6bd36e507695e82d0 with delete_type TABLET_DATA_DELETED (replaced by tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:57.980365 12999 tablet_service.cc:1511] Processing CreateTablet for tablet 62e88a52755140019a6d9f7041db0837 (DEFAULT_TABLE table=default.Table_9f48e93a010b4fc5b43124a1f8248ddf [id=011f63bf5ea44f918070a9ead229fa95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:57.982777 13164 leader_election.cc:304] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:57.985190 15248 consensus_queue.cc:1048] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:57.987665 15063 raft_consensus.cc:2749] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:57.987610 15203 consensus_queue.cc:1048] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:57.993148 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
W20260810 13:53:57.965040 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb4dcad38c1a4269b4740a8e5247a867 consensus state has no leader
I20260810 13:53:57.996423 12744 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:48758 (request call id 497) took 2208 ms. Trace:
I20260810 13:53:57.996860 12744 rpcz_store.cc:276] 0810 13:53:55.788357 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:56.373367 (+585010us) service_pool.cc:224] Handling call
0810 13:53:57.013703 (+640336us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c8846 00007fec6df85634 00007fec6df855c2 00007fec6df854f1 00007fec6df8546c 00007fec6df84722 00007fec6c22207c 00007fec6c2214b6
0810 13:53:57.254114 (+240411us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:57.280201 (+ 26087us) catalog_manager.cc:3751] Apply alter schema
0810 13:53:57.280944 (+ 743us) catalog_manager.cc:3783] Acquired catalog manager lock
0810 13:53:57.281215 (+ 271us) catalog_manager.cc:3941] Updating metadata on disk
0810 13:53:57.531238 (+250023us) catalog_manager.cc:3972] Committing alterations to in-memory state
0810 13:53:57.996363 (+465125us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:57.502303 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:57.502709 (+ 406us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:57.502741 (+ 32us) write_op.cc:435] Acquired schema lock
0810 13:53:57.502753 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:57.503001 (+ 248us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:57.503036 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:57.503057 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:57.503205 (+ 148us) tablet.cc:701] Row locks acquired
0810 13:53:57.503217 (+ 12us) write_op.cc:260] PREPARE: finished
0810 13:53:57.503321 (+ 104us) write_op.cc:270] Start()
0810 13:53:57.503395 (+ 74us) write_op.cc:276] Timestamp: P: 1786370037503253 usec, L: 0
0810 13:53:57.503410 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:57.503854 (+ 444us) log.cc:844] Serialized 405 byte log entry
0810 13:53:57.520916 (+ 17062us) op_driver.cc:464] REPLICATION: finished
0810 13:53:57.529079 (+ 8163us) write_op.cc:301] APPLY: starting
0810 13:53:57.529142 (+ 63us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:57.529250 (+ 108us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:57.529362 (+ 112us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:57.529550 (+ 188us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:57.529727 (+ 177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:57.529778 (+ 51us) write_op.cc:312] APPLY: finished
0810 13:53:57.529968 (+ 190us) log.cc:844] Serialized 23 byte log entry
0810 13:53:57.530119 (+ 151us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.530188 (+ 69us) write_op.cc:454] Released schema lock
0810 13:53:57.530229 (+ 41us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:57.530462 (+ 233us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.530492 (+ 30us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":1470664448,"child_traces":[["op",{"apply.queue_time_us":7975,"apply.run_cpu_time_us":1364,"apply.run_wall_time_us":1364,"num_ops":1,"prepare.queue_time_us":219915,"prepare.run_cpu_time_us":1789,"prepare.run_wall_time_us":2774,"replication_time_us":17429}]]}
I20260810 13:53:58.007443 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:58.017952 13640 raft_consensus.cc:359] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.018620 13640 raft_consensus.cc:385] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:58.018970 13640 raft_consensus.cc:740] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:58.019767 13640 consensus_queue.cc:260] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.022009 15138 leader_election.cc:290] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:58.000631 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e88a52755140019a6d9f7041db0837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.026827 13638 tablet_bootstrap.cc:654] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:58.037309 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet c793dedc5e714fe6bd36e507695e82d0 with delete_type TABLET_DATA_DELETED (replaced by tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:58.040066 13021 tablet_service.cc:1511] Processing CreateTablet for tablet e3f4b863f701471ab173b68049b1a602 (DEFAULT_TABLE table=default.Table_b83389f8c6794e7bbfa97ae916d990cd [id=c6ed8601e0a247318e4b9177c74b1391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.041337 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f4b863f701471ab173b68049b1a602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:57.974891 12750 catalog_manager.cc:6807] ReplaceTablet: tablet c793dedc5e714fe6bd36e507695e82d0 deleted and replaced by tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2
I20260810 13:53:57.928079 12742 rpcz_store.cc:276] 0810 13:53:55.746048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:56.369198 (+623150us) service_pool.cc:224] Handling call
0810 13:53:57.010979 (+641781us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:53:57.244076 (+233097us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:53:57.276451 (+ 32375us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:53:57.867323 (+590872us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:53:57.927296 (+ 59973us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:53:57.927578 (+ 282us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:57.505386 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:57.667538 (+162152us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:57.667562 (+ 24us) write_op.cc:435] Acquired schema lock
0810 13:53:57.667574 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:57.667874 (+ 300us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:57.667913 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:57.667935 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:57.668134 (+ 199us) tablet.cc:701] Row locks acquired
0810 13:53:57.668147 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:53:57.668266 (+ 119us) write_op.cc:270] Start()
0810 13:53:57.668347 (+ 81us) write_op.cc:276] Timestamp: P: 1786370037668220 usec, L: 0
0810 13:53:57.668362 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:57.668891 (+ 529us) log.cc:844] Serialized 433 byte log entry
0810 13:53:57.832574 (+163683us) op_driver.cc:464] REPLICATION: finished
0810 13:53:57.863416 (+ 30842us) write_op.cc:301] APPLY: starting
0810 13:53:57.863519 (+ 103us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:57.863731 (+ 212us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:57.863935 (+ 204us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:57.864964 (+ 1029us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:57.865229 (+ 265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:53:57.865298 (+ 69us) write_op.cc:312] APPLY: finished
0810 13:53:57.865586 (+ 288us) log.cc:844] Serialized 29 byte log entry
0810 13:53:57.865812 (+ 226us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.865916 (+ 104us) write_op.cc:454] Released schema lock
0810 13:53:57.865967 (+ 51us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:57.866243 (+ 276us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.866281 (+ 38us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":1472476032,"child_traces":[["op",{"apply.queue_time_us":269,"apply.run_cpu_time_us":2599,"apply.run_wall_time_us":2782,"num_ops":2,"prepare.queue_time_us":122756,"prepare.run_cpu_time_us":2301,"prepare.run_wall_time_us":223815,"raft.queue_time_us":93,"raft.run_cpu_time_us":600,"raft.run_wall_time_us":600,"replication_time_us":164113,"spinlock_wait_cycles":199552}]]}
I20260810 13:53:57.979370 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet f4946f79b54c46b1a59edf169109ab47 (table default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec]) successfully deleted
W20260810 13:53:58.058538 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 79180us
I20260810 13:53:58.060915 13229 tablet_service.cc:1511] Processing CreateTablet for tablet e3f4b863f701471ab173b68049b1a602 (DEFAULT_TABLE table=default.Table_b83389f8c6794e7bbfa97ae916d990cd [id=c6ed8601e0a247318e4b9177c74b1391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.061887 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f4b863f701471ab173b68049b1a602. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:57.983207 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 61fd4d043c354ad79d79c32498a469b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61fd4d043c354ad79d79c32498a469b4 already in progress: creating tablet
W20260810 13:53:58.070050 12717 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 86867.3us
I20260810 13:53:57.953578 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_bbf02f15a5404f0d95042f20dac5c146" } modify_external_catalogs: true
I20260810 13:53:58.032437 12739 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 53a99165463a43c78f4ccb6c5892f4b1
I20260810 13:53:58.073439 12739 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 498) took 2007 ms. Trace:
I20260810 13:53:58.073740 12739 rpcz_store.cc:276] 0810 13:53:56.066635 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:57.375338 (+1308703us) service_pool.cc:224] Handling call
0810 13:53:57.446980 (+ 71642us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c84d6 00007fec6df80b34 00007fec6df80ac2 00007fec6df809f1 00007fec6df8096c 00007fec6df7fc22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:57.448335 (+ 1355us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:57.649290 (+200955us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:57.649415 (+ 125us) catalog_manager.cc:2850] Locking tablets
0810 13:53:57.650335 (+ 920us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:58.031940 (+381605us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:58.032213 (+ 273us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:58.032351 (+ 138us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:58.073353 (+ 41002us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:57.925213 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:57.925615 (+ 402us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:57.925640 (+ 25us) write_op.cc:435] Acquired schema lock
0810 13:53:57.925654 (+ 14us) tablet.cc:662] Decoding operations
0810 13:53:57.933916 (+ 8262us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:57.933958 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:57.933980 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:57.976013 (+ 42033us) tablet.cc:701] Row locks acquired
0810 13:53:57.976029 (+ 16us) write_op.cc:260] PREPARE: finished
0810 13:53:57.976148 (+ 119us) write_op.cc:270] Start()
0810 13:53:57.976229 (+ 81us) write_op.cc:276] Timestamp: P: 1786370037976081 usec, L: 0
0810 13:53:57.976243 (+ 14us) op_driver.cc:348] REPLICATION: starting
0810 13:53:58.010702 (+ 34459us) log.cc:844] Serialized 725 byte log entry
0810 13:53:58.013723 (+ 3021us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e553208 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1 00007fec6e9e650d 00000000005bd8c4 00000000005bd6f9
0810 13:53:58.027905 (+ 14182us) op_driver.cc:464] REPLICATION: finished
0810 13:53:58.029120 (+ 1215us) write_op.cc:301] APPLY: starting
0810 13:53:58.029187 (+ 67us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:58.029409 (+ 222us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:58.029455 (+ 46us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:58.030000 (+ 545us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:58.030294 (+ 294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:58.030378 (+ 84us) write_op.cc:312] APPLY: finished
0810 13:53:58.030649 (+ 271us) log.cc:844] Serialized 29 byte log entry
0810 13:53:58.031402 (+ 753us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:58.031525 (+ 123us) write_op.cc:454] Released schema lock
0810 13:53:58.031586 (+ 61us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":160920832,"child_traces":[["op",{"apply.queue_time_us":964,"apply.run_cpu_time_us":2425,"apply.run_wall_time_us":3848,"num_ops":2,"prepare.queue_time_us":273303,"raft.queue_time_us":82,"raft.run_cpu_time_us":764,"raft.run_wall_time_us":1721,"replication_time_us":51471,"spinlock_wait_cycles":77820800}]]}
W20260810 13:53:58.080024 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet c793dedc5e714fe6bd36e507695e82d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c793dedc5e714fe6bd36e507695e82d0 already in progress: creating tablet
I20260810 13:53:58.082060 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 53a99165463a43c78f4ccb6c5892f4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:57 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:58.085042 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 53a99165463a43c78f4ccb6c5892f4b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53a99165463a43c78f4ccb6c5892f4b1 already in progress: creating tablet
I20260810 13:53:58.093052 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43def9358894b2aa001a7db56706589" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:58.093894 13050 raft_consensus.cc:3060] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:58.107686 13233 tablet_service.cc:1511] Processing CreateTablet for tablet f37f4b2d04f84e119da2743234865baf (DEFAULT_TABLE table=default.Table_071663fc830e44ef9d25a38fc8301ba7 [id=dd579b0cb2684ce08640cf4f5edae65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.108287 13638 tablet_bootstrap.cc:492] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:58.116443 13638 ts_tablet_manager.cc:1403] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.181s user 0.011s sys 0.010s
I20260810 13:53:58.123456 13638 raft_consensus.cc:359] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.124322 13638 raft_consensus.cc:385] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:58.124648 13638 raft_consensus.cc:740] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:58.125646 13638 consensus_queue.cc:260] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.128255 13638 ts_tablet_manager.cc:1434] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.011s user 0.007s sys 0.000s
W20260810 13:53:58.133558 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cb4dcad38c1a4269b4740a8e5247a867 consensus state has no leader
I20260810 13:53:58.134045 13639 tablet_bootstrap.cc:492] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:58.134455 13639 ts_tablet_manager.cc:1403] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.496s user 0.003s sys 0.007s
W20260810 13:53:58.137835 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet c793dedc5e714fe6bd36e507695e82d0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c793dedc5e714fe6bd36e507695e82d0 already in progress: creating tablet
I20260810 13:53:58.137835 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:58.138717 13040 raft_consensus.cc:2468] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:58.142091 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:58.143976 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 53a99165463a43c78f4ccb6c5892f4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:57 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:58.146032 13008 tablet_service.cc:1511] Processing CreateTablet for tablet f37f4b2d04f84e119da2743234865baf (DEFAULT_TABLE table=default.Table_071663fc830e44ef9d25a38fc8301ba7 [id=dd579b0cb2684ce08640cf4f5edae65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.146965 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f37f4b2d04f84e119da2743234865baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.149151 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:53:58.152791 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 2d04860a72c64a5db966e2784c6dbbf0 because the tablet was not found. No further retry: Not found: Tablet not found: 2d04860a72c64a5db966e2784c6dbbf0
I20260810 13:53:58.153359 13167 leader_election.cc:304] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:53:58.153765 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet d9ada39233e9421d9870565c73f2ee16 because the tablet was not found. No further retry: Not found: Tablet not found: d9ada39233e9421d9870565c73f2ee16
W20260810 13:53:58.154378 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet f62023d553cd46cab920de44baa96eec because the tablet was not found. No further retry: Not found: Tablet not found: f62023d553cd46cab920de44baa96eec
I20260810 13:53:58.154727 15138 raft_consensus.cc:2804] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 13:53:58.154884 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet f7afa380245248f5bac203b0905721c6 because the tablet was not found. No further retry: Not found: Tablet not found: f7afa380245248f5bac203b0905721c6
I20260810 13:53:58.155160 15138 raft_consensus.cc:493] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 13:53:58.155386 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 35c43f7f8b7e4e56b5edbabe242c9dde because the tablet was not found. No further retry: Not found: Tablet not found: 35c43f7f8b7e4e56b5edbabe242c9dde
I20260810 13:53:58.155548 15138 raft_consensus.cc:3060] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:58.155864 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 4dea61b84b614ead8830873568f9b7c4 because the tablet was not found. No further retry: Not found: Tablet not found: 4dea61b84b614ead8830873568f9b7c4
W20260810 13:53:58.156347 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet c4db9d7e82414cab8a69618effe89b40 because the tablet was not found. No further retry: Not found: Tablet not found: c4db9d7e82414cab8a69618effe89b40
W20260810 13:53:58.163692 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 07ff9e8a8ca845b89154ed0626d34c5c because the tablet was not found. No further retry: Not found: Tablet not found: 07ff9e8a8ca845b89154ed0626d34c5c
W20260810 13:53:58.164464 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 8c80bc85fe25433ab2559ea0ada61978 because the tablet was not found. No further retry: Not found: Tablet not found: 8c80bc85fe25433ab2559ea0ada61978
I20260810 13:53:58.192421 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 1bbee4f9a50342599434a2b05c0740bd (DEFAULT_TABLE table=default.Table_85b411d6527d4231a4934a690459d06d [id=53f4e0e75cee4b53a7ba2b30f19025cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.193747 13239 tablet_service.cc:1511] Processing CreateTablet for tablet bec54cb915a54949871181763ad956d5 (DEFAULT_TABLE table=default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.198704 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:58.202999 13050 raft_consensus.cc:2468] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:58.207684 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f37f4b2d04f84e119da2743234865baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.212019 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bbee4f9a50342599434a2b05c0740bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.213294 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec54cb915a54949871181763ad956d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.217813 13638 tablet_bootstrap.cc:492] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:58.217955 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 8d647bf5c1ba42f48186661310065448 (DEFAULT_TABLE table=default.Table_4a0d9399ab4c468fab4289955631b20f [id=9ec5220333d6496b83c73d11150e444c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.219019 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d647bf5c1ba42f48186661310065448. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:58.225322 13011 consensus_meta.cc:287] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.525s user 0.012s sys 0.000s
I20260810 13:53:58.228420 13640 ts_tablet_manager.cc:1434] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.320s user 0.002s sys 0.007s
I20260810 13:53:58.232627 13640 tablet_bootstrap.cc:492] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:58.237200 13639 raft_consensus.cc:359] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.237954 13639 raft_consensus.cc:385] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:58.238268 13639 raft_consensus.cc:740] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:58.238965 13639 consensus_queue.cc:260] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.241376 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_69d9d4a2261c401ca6f16490def91c0a" } new_table_name: "default.Table_93d8d5188346467fa9b67f276a3fabe3" modify_external_catalogs: true
I20260810 13:53:58.254947 13639 ts_tablet_manager.cc:1434] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.120s user 0.007s sys 0.000s
I20260810 13:53:58.256315 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f6d23e8eec824ef08b26dec8c7c6d010"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:58.257959 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6d23e8eec824ef08b26dec8c7c6d010 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:58.267156 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:58.268227 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:58.269110 13224 tablet_service.cc:1511] Processing CreateTablet for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 (DEFAULT_TABLE table=default.Table_2e79b198186741b39955b48b1832908a [id=cee4946b4fa14e43aaff44073785db31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.270212 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.272394 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet ac2c102382734913bffb5436e06fe0a1 (table default.Table_bbf02f15a5404f0d95042f20dac5c146 [id=cb4b9877529f4cc38a48b2a61be4aa6c]). Expected version 2 got 0
I20260810 13:53:58.273168 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:58.273854 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
W20260810 13:53:58.271543 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 53a99165463a43c78f4ccb6c5892f4b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53a99165463a43c78f4ccb6c5892f4b1 already in progress: creating tablet
I20260810 13:53:58.278821 13639 tablet_bootstrap.cc:492] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:53:58.284124 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6406062bb0934eadae901502806178b5 consensus state has no leader
I20260810 13:53:58.285801 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b392780f45ab4b899ddb12eefbcdd556"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:58.287415 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b392780f45ab4b899ddb12eefbcdd556 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:58.287976 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:53:58.288833 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:53:58.290793 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:53:58.296142 13638 tablet_bootstrap.cc:654] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:58.296845 13167 leader_election.cc:304] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:58.297796 15063 raft_consensus.cc:2804] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:58.298411 15063 raft_consensus.cc:697] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:58.299538 15063 consensus_queue.cc:237] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.306223 13008 tablet_service.cc:1511] Processing CreateTablet for tablet bec54cb915a54949871181763ad956d5 (DEFAULT_TABLE table=default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:58.306800 12951 leader_election.cc:343] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 063e3b74a9a248a1aa0c2de4b4b73a06
I20260810 13:53:58.307386 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 8d647bf5c1ba42f48186661310065448 (DEFAULT_TABLE table=default.Table_4a0d9399ab4c468fab4289955631b20f [id=9ec5220333d6496b83c73d11150e444c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.307974 15144 consensus_queue.cc:1048] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:58.309299 13007 tablet_service.cc:1511] Processing CreateTablet for tablet efc446acced34a6c87e459c5542c1c77 (DEFAULT_TABLE table=default.Table_3fb4e7e2f617464f930b338a8ece6e38 [id=0acde9f8e2f7483c9eb7f3df14b0859d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.307214 12951 leader_election.cc:304] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:58.310297 15144 raft_consensus.cc:2749] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:58.308638 13022 tablet_service.cc:1511] Processing CreateTablet for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 (DEFAULT_TABLE table=default.Table_2e79b198186741b39955b48b1832908a [id=cee4946b4fa14e43aaff44073785db31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.311601 12951 leader_election.cc:304] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:58.312229 14244 rpc_server.cc:307] RPC server started. Bound to: 127.12.36.61:35861
I20260810 13:53:58.317255 14244 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/master-1/data/info.pb
I20260810 13:53:58.305485 15287 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.36.61:35861 every 8 connection(s)
I20260810 13:53:58.325073 15248 raft_consensus.cc:493] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:58.325570 15248 raft_consensus.cc:515] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.329916 15248 leader_election.cc:290] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:58.334381 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec54cb915a54949871181763ad956d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.334674 15144 raft_consensus.cc:2749] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:58.350893 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 1bbee4f9a50342599434a2b05c0740bd (DEFAULT_TABLE table=default.Table_85b411d6527d4231a4934a690459d06d [id=53f4e0e75cee4b53a7ba2b30f19025cc]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:58.359836 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 48299.4us
I20260810 13:53:58.360817 15144 consensus_queue.cc:1048] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:53:58.363119 15034 raft_consensus.cc:493] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:58.363461 12951 leader_election.cc:304] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:53:58.364085 15144 raft_consensus.cc:2749] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:58.365430 12951 leader_election.cc:304] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:53:58.366240 15144 raft_consensus.cc:2804] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:58.366712 15144 raft_consensus.cc:493] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:58.367223 15144 raft_consensus.cc:3060] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:58.363668 15034 raft_consensus.cc:515] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.372733 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d647bf5c1ba42f48186661310065448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.374881 15034 leader_election.cc:290] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:58.376962 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.378384 15144 raft_consensus.cc:515] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.381036 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc446acced34a6c87e459c5542c1c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.383883 15138 raft_consensus.cc:515] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.392254 12995 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 28) took 1239 ms. Trace:
I20260810 13:53:58.394603 13640 tablet_bootstrap.cc:654] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:58.399158 13382 leader_election.cc:343] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:58.399572 13382 leader_election.cc:304] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:58.416967 13229 tablet_service.cc:1511] Processing CreateTablet for tablet efc446acced34a6c87e459c5542c1c77 (DEFAULT_TABLE table=default.Table_3fb4e7e2f617464f930b338a8ece6e38 [id=0acde9f8e2f7483c9eb7f3df14b0859d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.425503 13227 tablet_service.cc:1511] Processing CreateTablet for tablet bf672d15f88c4f0dbdf2fdb6aefa1108 (DEFAULT_TABLE table=default.Table_51465ee8c49d4f90ab30de95dbda8bbc [id=15017d241bbc4bd58f9951ed24687713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.438150 15286 raft_consensus.cc:2749] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:58.418102 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063e3b74a9a248a1aa0c2de4b4b73a06" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:58.441606 12995 rpcz_store.cc:276] 0810 13:53:57.152532 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:57.152723 (+ 191us) service_pool.cc:224] Handling call
0810 13:53:57.358592 (+205869us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54000f3554. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:53:58.392048 (+1033456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329535232}
I20260810 13:53:58.448030 13043 raft_consensus.cc:2468] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:58.425423 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bbee4f9a50342599434a2b05c0740bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.427543 13004 tablet_service.cc:1511] Processing CreateTablet for tablet bf672d15f88c4f0dbdf2fdb6aefa1108 (DEFAULT_TABLE table=default.Table_51465ee8c49d4f90ab30de95dbda8bbc [id=15017d241bbc4bd58f9951ed24687713]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:58.436844 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 45251.8us
I20260810 13:53:58.462838 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2822dc6c838f40929cbe086ba80014db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:58.464834 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2822dc6c838f40929cbe086ba80014db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:58.468664 13167 leader_election.cc:304] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:58.469756 15063 raft_consensus.cc:2804] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:58.470377 15063 raft_consensus.cc:493] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:58.470922 15063 raft_consensus.cc:3060] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:58.480003 15138 leader_election.cc:290] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:58.440459 13382 leader_election.cc:343] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:58.489063 13382 leader_election.cc:304] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:58.489993 15286 raft_consensus.cc:2749] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:58.493790 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:58.494649 13043 raft_consensus.cc:2393] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:53:58.499168 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5114911fdf4b19afec0c71ded5ef9a (DEFAULT_TABLE table=default.Table_8a8233c099eb45dba66c3d0f9bdbe18b [id=d9a327f6557d42bb998964e1d594cb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.500629 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5114911fdf4b19afec0c71ded5ef9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.501448 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf672d15f88c4f0dbdf2fdb6aefa1108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.488746 13640 tablet_bootstrap.cc:492] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:58.505048 13640 ts_tablet_manager.cc:1403] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.273s user 0.015s sys 0.002s
I20260810 13:53:58.508335 15309 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
W20260810 13:53:58.509003 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 68573.8us
I20260810 13:53:58.509666 13382 leader_election.cc:304] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:53:58.510396 15286 raft_consensus.cc:2804] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:58.511519 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:58.510777 15286 raft_consensus.cc:493] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:58.513079 15286 raft_consensus.cc:3060] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:58.512981 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc446acced34a6c87e459c5542c1c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.518893 13259 raft_consensus.cc:2393] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:58.520913 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:58.525081 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:58.522245 15309 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:53:58.525583 13382 leader_election.cc:343] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:58.525957 13382 leader_election.cc:304] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:58.525964 12744 catalog_manager.cc:5719] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } }
I20260810 13:53:58.526638 15285 raft_consensus.cc:2749] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:58.526979 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:53:58.527635 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:53:58.528261 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:58.531085 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5114911fdf4b19afec0c71ded5ef9a (DEFAULT_TABLE table=default.Table_8a8233c099eb45dba66c3d0f9bdbe18b [id=d9a327f6557d42bb998964e1d594cb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.534255 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:53:58.538769 15309 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:58.558914 15290 sys_catalog.cc:263] Verifying existing consensus state
I20260810 13:53:58.568895 15309 raft_consensus.cc:493] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:58.569483 15309 raft_consensus.cc:515] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.573904 13640 raft_consensus.cc:359] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.574679 13640 raft_consensus.cc:385] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:58.575011 13640 raft_consensus.cc:740] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:53:58.575793 13640 consensus_queue.cc:260] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.440829 13639 tablet_bootstrap.cc:654] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:58.582197 15309 leader_election.cc:290] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:58.468844 15144 leader_election.cc:290] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:58.541950 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:58.529544 13638 tablet_bootstrap.cc:492] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:58.589752 13638 ts_tablet_manager.cc:1403] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.372s user 0.012s sys 0.003s
I20260810 13:53:58.583947 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a3a4d2724b42da83a523e208b5714b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:58.469594 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf672d15f88c4f0dbdf2fdb6aefa1108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.552383 15138 raft_consensus.cc:493] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:58.593823 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5114911fdf4b19afec0c71ded5ef9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.594103 15138 raft_consensus.cc:515] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:58.597334 12952 leader_election.cc:343] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:58.599179 15138 leader_election.cc:290] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:58.605212 15034 raft_consensus.cc:493] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:58.605729 15034 raft_consensus.cc:515] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.607847 13640 ts_tablet_manager.cc:1434] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.102s user 0.008s sys 0.000s
I20260810 13:53:58.612969 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:58.613544 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:53:58.614845 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:53:58.615703 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:58.616194 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:53:58.616160 15138 raft_consensus.cc:493] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:58.616734 15138 raft_consensus.cc:515] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:58.619680 13167 leader_election.cc:343] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 4dea61b84b614ead8830873568f9b7c4
I20260810 13:53:58.623348 13213 tablet_service.cc:1511] Processing CreateTablet for tablet f425739a239144048975fb15a26d197e (DEFAULT_TABLE table=default.Table_2d75c2da0411444ba34cab36ab78b40b [id=b41bc79022ca450faafad8b504afe6ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.624526 13008 tablet_service.cc:1511] Processing CreateTablet for tablet f425739a239144048975fb15a26d197e (DEFAULT_TABLE table=default.Table_2d75c2da0411444ba34cab36ab78b40b [id=b41bc79022ca450faafad8b504afe6ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.625692 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f425739a239144048975fb15a26d197e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.629269 12749 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:58.631466 13638 raft_consensus.cc:359] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.632534 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c94325b8ad884fbf8fa662c283cbaf83" } new_table_name: "default.Table_f95c9f662de4490cac0ad50321a985cd" modify_external_catalogs: true
I20260810 13:53:58.632916 13638 raft_consensus.cc:385] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:58.633176 13638 raft_consensus.cc:740] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:58.633787 13638 consensus_queue.cc:260] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.643424 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:53:58.644222 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:58.645347 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:58.651150 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:58.651376 15138 leader_election.cc:290] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:58.651825 15286 raft_consensus.cc:515] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.661180 13639 tablet_bootstrap.cc:492] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:58.661639 13639 ts_tablet_manager.cc:1403] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.403s user 0.014s sys 0.003s
I20260810 13:53:58.668736 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f425739a239144048975fb15a26d197e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.668820 12999 tablet_service.cc:1511] Processing CreateTablet for tablet ce84eacbab61417a9497f8770b4da511 (DEFAULT_TABLE table=default.Table_640c451fefef49f3a4960de11632ca5a [id=23d722ef12c849af85d88c980f7ae3d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.670529 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce84eacbab61417a9497f8770b4da511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.674109 15249 raft_consensus.cc:493] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:53:58.675036 13216 tablet_service.cc:1511] Processing CreateTablet for tablet ce84eacbab61417a9497f8770b4da511 (DEFAULT_TABLE table=default.Table_640c451fefef49f3a4960de11632ca5a [id=23d722ef12c849af85d88c980f7ae3d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:58.674930 15249 raft_consensus.cc:515] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.676720 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:58.683911 15034 leader_election.cc:290] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:58.688318 13638 ts_tablet_manager.cc:1434] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.098s user 0.007s sys 0.000s
I20260810 13:53:58.689186 13640 tablet_bootstrap.cc:492] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:58.690735 15249 leader_election.cc:290] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:53:58.691900 13167 leader_election.cc:343] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: c4db9d7e82414cab8a69618effe89b40
I20260810 13:53:58.692473 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce84eacbab61417a9497f8770b4da511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:58.694386 15249 raft_consensus.cc:493] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:58.695048 15249 raft_consensus.cc:515] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.698562 15249 leader_election.cc:290] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:58.698378 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a3a4d2724b42da83a523e208b5714b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:58.699276 13050 raft_consensus.cc:2468] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:58.700611 13167 leader_election.cc:304] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:58.701233 13638 tablet_bootstrap.cc:492] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:58.701664 15249 raft_consensus.cc:2804] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:58.702167 15249 raft_consensus.cc:493] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:58.702925 15249 raft_consensus.cc:3060] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:58.705476 13551 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
W20260810 13:53:58.709666 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 182545us
W20260810 13:53:58.712167 13382 leader_election.cc:343] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:58.676095 15290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Bootstrap starting.
I20260810 13:53:58.724745 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:53:58.729586 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:53:58.738344 13342 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:53:58.734954 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:53:58.762007 13121 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:53:58.766012 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:58.766942 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:53:58.767599 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:58.768410 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:53:58.769398 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:58.770042 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
W20260810 13:53:58.774247 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 62113.2us
I20260810 13:53:58.777369 12747 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_96cdf642a68642ce9fe947569577b42a [id=667ccf7ba20c49b2be82e167aa212ecd] alter complete (version 3)
I20260810 13:53:58.781864 13638 tablet_bootstrap.cc:654] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:58.783931 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet c4db9d7e82414cab8a69618effe89b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:58.715926 15063 raft_consensus.cc:515] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.789361 13229 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dea61b84b614ead8830873568f9b7c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:58.790228 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "063e3b74a9a248a1aa0c2de4b4b73a06" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:58.791079 13050 raft_consensus.cc:3060] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:58.797389 12747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 78) took 3629 ms (client timeout 1000 ms). Trace:
W20260810 13:53:58.797866 12747 rpcz_store.cc:269] 0810 13:53:55.167966 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:55.168133 (+ 167us) service_pool.cc:224] Handling call
0810 13:53:58.797316 (+3629183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:57.021467 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:57.021862 (+ 395us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:57.021891 (+ 29us) write_op.cc:435] Acquired schema lock
0810 13:53:57.021904 (+ 13us) tablet.cc:662] Decoding operations
0810 13:53:57.022277 (+ 373us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:57.022315 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:57.022336 (+ 21us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:57.022483 (+ 147us) tablet.cc:701] Row locks acquired
0810 13:53:57.022501 (+ 18us) write_op.cc:260] PREPARE: finished
0810 13:53:57.022608 (+ 107us) write_op.cc:270] Start()
0810 13:53:57.022705 (+ 97us) write_op.cc:276] Timestamp: P: 1786370037022543 usec, L: 0
0810 13:53:57.022720 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:57.023271 (+ 551us) log.cc:844] Serialized 356 byte log entry
0810 13:53:57.107506 (+ 84235us) op_driver.cc:464] REPLICATION: finished
0810 13:53:57.107764 (+ 258us) write_op.cc:301] APPLY: starting
0810 13:53:57.107820 (+ 56us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:57.107910 (+ 90us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:57.108005 (+ 95us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:57.108225 (+ 220us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:57.108354 (+ 129us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:57.108399 (+ 45us) write_op.cc:312] APPLY: finished
0810 13:53:57.108581 (+ 182us) log.cc:844] Serialized 23 byte log entry
0810 13:53:57.108755 (+ 174us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.108809 (+ 54us) write_op.cc:454] Released schema lock
0810 13:53:57.108840 (+ 31us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
0810 13:53:57.139818 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:57.310831 (+171013us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:57.310862 (+ 31us) write_op.cc:435] Acquired schema lock
0810 13:53:57.310877 (+ 15us) tablet.cc:662] Decoding operations
0810 13:53:57.311192 (+ 315us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:57.311238 (+ 46us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:57.311266 (+ 28us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:57.311423 (+ 157us) tablet.cc:701] Row locks acquired
0810 13:53:57.311438 (+ 15us) write_op.cc:260] PREPARE: finished
0810 13:53:57.311560 (+ 122us) write_op.cc:270] Start()
0810 13:53:57.311651 (+ 91us) write_op.cc:276] Timestamp: P: 1786370037311502 usec, L: 0
0810 13:53:57.311669 (+ 18us) op_driver.cc:348] REPLICATION: starting
0810 13:53:57.312209 (+ 540us) log.cc:844] Serialized 356 byte log entry
0810 13:53:57.449665 (+137456us) op_driver.cc:464] REPLICATION: finished
0810 13:53:57.449984 (+ 319us) write_op.cc:301] APPLY: starting
0810 13:53:57.450045 (+ 61us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:57.450135 (+ 90us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:57.450244 (+ 109us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:57.450459 (+ 215us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:57.450587 (+ 128us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:57.454021 (+ 3434us) write_op.cc:312] APPLY: finished
0810 13:53:57.454202 (+ 181us) log.cc:844] Serialized 23 byte log entry
0810 13:53:57.454359 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.454430 (+ 71us) write_op.cc:454] Released schema lock
0810 13:53:57.454462 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:57.454843 (+ 381us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.454865 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":87,"apply.run_cpu_time_us":1291,"apply.run_wall_time_us":1291,"num_ops":1,"prepare.queue_time_us":399688,"prepare.run_cpu_time_us":2030,"prepare.run_wall_time_us":2933,"replication_time_us":84658}],["op",{"apply.queue_time_us":158,"apply.run_cpu_time_us":1340,"apply.run_wall_time_us":4810,"num_ops":1,"prepare.queue_time_us":28110,"prepare.run_cpu_time_us":2455,"prepare.run_wall_time_us":304134,"raft.queue_time_us":108,"raft.run_cpu_time_us":743,"raft.run_wall_time_us":744,"replication_time_us":137911}]]}
I20260810 13:53:58.735029 15286 leader_election.cc:290] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:58.815042 13639 raft_consensus.cc:359] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.816062 13639 raft_consensus.cc:385] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:58.820379 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ac2c102382734913bffb5436e06fe0a1
I20260810 13:53:58.822171 12743 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 499) took 2755 ms. Trace:
I20260810 13:53:58.824645 15063 leader_election.cc:290] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:58.836210 13229 tablet_service.cc:1558] Processing DeleteTablet for tablet ac2c102382734913bffb5436e06fe0a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:58 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:58.822467 12743 rpcz_store.cc:276] 0810 13:53:56.067000 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:57.498499 (+1431499us) service_pool.cc:224] Handling call
0810 13:53:57.645430 (+146931us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c84d6 00007fec6df80b34 00007fec6df80ac2 00007fec6df809f1 00007fec6df8096c 00007fec6df7fc22 00007fec6c22207c 00007fec6c2214b6
0810 13:53:58.077170 (+431740us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:58.077734 (+ 564us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:58.077884 (+ 150us) catalog_manager.cc:2850] Locking tablets
0810 13:53:58.295342 (+217458us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:58.483692 (+188350us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:58.518222 (+ 34530us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:58.820272 (+302050us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:58.822099 (+ 1827us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:58.418315 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:58.418769 (+ 454us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:58.418804 (+ 35us) write_op.cc:435] Acquired schema lock
0810 13:53:58.418823 (+ 19us) tablet.cc:662] Decoding operations
0810 13:53:58.419198 (+ 375us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:58.419235 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:58.419262 (+ 27us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:58.419591 (+ 329us) tablet.cc:701] Row locks acquired
0810 13:53:58.419608 (+ 17us) write_op.cc:260] PREPARE: finished
0810 13:53:58.419736 (+ 128us) write_op.cc:270] Start()
0810 13:53:58.419822 (+ 86us) write_op.cc:276] Timestamp: P: 1786370038419653 usec, L: 0
0810 13:53:58.419839 (+ 17us) op_driver.cc:348] REPLICATION: starting
0810 13:53:58.467273 (+ 47434us) log.cc:844] Serialized 790 byte log entry
0810 13:53:58.467969 (+ 696us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e553208 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1 00007fec6e9e650d 00000000005bd8c4 00000000005bd6f9
0810 13:53:58.481287 (+ 13318us) op_driver.cc:464] REPLICATION: finished
0810 13:53:58.481612 (+ 325us) write_op.cc:301] APPLY: starting
0810 13:53:58.481675 (+ 63us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:58.481864 (+ 189us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:58.481894 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:58.482265 (+ 371us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:58.482474 (+ 209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:58.482584 (+ 110us) write_op.cc:312] APPLY: finished
0810 13:53:58.482854 (+ 270us) log.cc:844] Serialized 29 byte log entry
0810 13:53:58.483076 (+ 222us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:58.483178 (+ 102us) write_op.cc:454] Released schema lock
0810 13:53:58.483235 (+ 57us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:58.483573 (+ 338us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:58.483623 (+ 50us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":335961856,"child_traces":[["op",{"apply.queue_time_us":176,"apply.run_cpu_time_us":1890,"apply.run_wall_time_us":1889,"num_ops":2,"prepare.queue_time_us":120960,"prepare.run_cpu_time_us":3364,"prepare.run_wall_time_us":49844,"raft.queue_time_us":1228,"raft.run_cpu_time_us":1243,"raft.run_wall_time_us":10972,"replication_time_us":61363,"spinlock_wait_cycles":107661184}]]}
I20260810 13:53:58.840258 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e9b13b3af4bb489f8772f0fdd67e5dab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:58.816423 13639 raft_consensus.cc:740] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:58.850320 15290 log.cc:826] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Log is configured to *not* fsync() on all Append() calls
I20260810 13:53:58.854180 13639 consensus_queue.cc:260] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.855255 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet 35c43f7f8b7e4e56b5edbabe242c9dde with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:32 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:58.855296 13043 raft_consensus.cc:2468] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:58.858711 13167 leader_election.cc:304] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:58.859524 15063 raft_consensus.cc:2804] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:58.860011 15063 raft_consensus.cc:493] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:58.864305 13216 tablet_service.cc:1558] Processing DeleteTablet for tablet f4946f79b54c46b1a59edf169109ab47 with delete_type TABLET_DATA_DELETED (replaced by tablet dd58cc128ce64f9abe1418b6093a1c2c) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:58.866159 13216 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:58.860577 15063 raft_consensus.cc:3060] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:58.885712 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9b13b3af4bb489f8772f0fdd67e5dab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:58.868659 12744 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 80) took 1347 ms (client timeout 1000 ms). Trace:
W20260810 13:53:58.869666 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 35c43f7f8b7e4e56b5edbabe242c9dde because the tablet was not found. No further retry: Not found: Tablet not found: 35c43f7f8b7e4e56b5edbabe242c9dde
I20260810 13:53:58.889982 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:58.890250 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet 17df06cad1404d96bda5822be6a6e995 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:58.890815 15328 tablet_replica.cc:333] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:58.891078 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet f4946f79b54c46b1a59edf169109ab47 with delete_type TABLET_DATA_DELETED (replaced by tablet dd58cc128ce64f9abe1418b6093a1c2c) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:58.891888 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:58.892185 15249 raft_consensus.cc:515] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:58.869513 12746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 79) took 2039 ms (client timeout 1000 ms). Trace:
I20260810 13:53:58.898789 15138 raft_consensus.cc:493] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:53:58.899281 15138 raft_consensus.cc:515] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:58.901976 15138 leader_election.cc:290] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:58.902801 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:58.907976 15305 raft_consensus.cc:493] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:53:58.908566 15305 raft_consensus.cc:515] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.912901 15305 leader_election.cc:290] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:58.914036 13639 ts_tablet_manager.cc:1434] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.252s user 0.008s sys 0.001s
W20260810 13:53:58.923110 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:53:58.896916 12746 rpcz_store.cc:269] 0810 13:53:56.829871 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:56.931415 (+101544us) service_pool.cc:224] Handling call
0810 13:53:57.015051 (+ 83636us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:58.869445 (+1854394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:58.150523 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:58.151079 (+ 556us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:58.151113 (+ 34us) write_op.cc:435] Acquired schema lock
0810 13:53:58.151132 (+ 19us) tablet.cc:662] Decoding operations
0810 13:53:58.151673 (+ 541us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:58.151729 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:58.151763 (+ 34us) tablet.cc:685] Acquiring locks for 3 operations
0810 13:53:58.152120 (+ 357us) tablet.cc:701] Row locks acquired
0810 13:53:58.152139 (+ 19us) write_op.cc:260] PREPARE: finished
0810 13:53:58.152276 (+ 137us) write_op.cc:270] Start()
0810 13:53:58.152367 (+ 91us) write_op.cc:276] Timestamp: P: 1786370038152214 usec, L: 0
0810 13:53:58.152391 (+ 24us) op_driver.cc:348] REPLICATION: starting
0810 13:53:58.235552 (+ 83161us) log.cc:844] Serialized 1275 byte log entry
0810 13:53:58.246299 (+ 10747us) op_driver.cc:464] REPLICATION: finished
0810 13:53:58.247879 (+ 1580us) write_op.cc:301] APPLY: starting
0810 13:53:58.247938 (+ 59us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:58.248062 (+ 124us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:58.248156 (+ 94us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:58.248550 (+ 394us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:58.248718 (+ 168us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0810 13:53:58.248759 (+ 41us) write_op.cc:312] APPLY: finished
0810 13:53:58.248952 (+ 193us) log.cc:844] Serialized 35 byte log entry
0810 13:53:58.249094 (+ 142us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:58.249167 (+ 73us) write_op.cc:454] Released schema lock
0810 13:53:58.249197 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:58.249432 (+ 235us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:58.249457 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24391,"reported_tablets":13,"spinlock_wait_cycles":152958336,"child_traces":[["op",{"apply.queue_time_us":1415,"apply.run_cpu_time_us":1523,"apply.run_wall_time_us":1523,"num_ops":3,"prepare.queue_time_us":154482,"prepare.run_cpu_time_us":2861,"prepare.run_wall_time_us":86136,"raft.queue_time_us":96,"raft.run_cpu_time_us":613,"raft.run_wall_time_us":614,"replication_time_us":93795}]]}
I20260810 13:53:58.934684 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_13af97840a5a4e1cb52df81dc991d50c" } modify_external_catalogs: true
I20260810 13:53:58.938475 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet ac2c102382734913bffb5436e06fe0a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:58 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:58.940371 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:58.941967 13382 leader_election.cc:304] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:58.943560 15034 raft_consensus.cc:2804] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:58.944155 15034 raft_consensus.cc:493] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 13:53:58.944890 13382 leader_election.cc:343] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:58.945226 13640 tablet_bootstrap.cc:654] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:58.945719 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_13af97840a5a4e1cb52df81dc991d50c" } modify_external_catalogs: true
W20260810 13:53:58.946029 13382 leader_election.cc:343] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:58.946625 13382 leader_election.cc:343] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:53:58.883288 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet aa0567b908974da5817ed62aafecee35 consensus state has no leader
I20260810 13:53:58.954771 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_eaa42749fbe84eeb91655d963d5a34ea" } new_table_name: "default.Table_e29a3f5b330e407d9a9e94706d641719" modify_external_catalogs: true
W20260810 13:53:58.937567 12749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 81) took 1819 ms (client timeout 1000 ms). Trace:
I20260810 13:53:58.949591 15034 raft_consensus.cc:3060] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:58.961534 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43def9358894b2aa001a7db56706589" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:58.962240 13480 raft_consensus.cc:2393] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:53:58.967773 15034 raft_consensus.cc:515] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.972855 15249 leader_election.cc:290] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:58.974583 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a3a4d2724b42da83a523e208b5714b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:58.975224 13043 raft_consensus.cc:3060] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:58.977861 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5d7a695c694d1993c2d0c4d3127fca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:58.978031 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43def9358894b2aa001a7db56706589" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:58.978820 13476 raft_consensus.cc:2393] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
W20260810 13:53:58.956658 12749 rpcz_store.cc:269] 0810 13:53:57.118045 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:57.316428 (+198383us) service_pool.cc:224] Handling call
0810 13:53:58.937485 (+1621057us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3977,"reported_tablets":15}
I20260810 13:53:58.986621 13050 raft_consensus.cc:2468] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:58.989349 15328 raft_consensus.cc:2243] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:58.991189 15328 raft_consensus.cc:2272] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:58.992654 13167 leader_election.cc:304] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:58.994151 13043 raft_consensus.cc:2468] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:58.995299 13167 leader_election.cc:304] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:58.996054 15330 raft_consensus.cc:2804] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:58.996800 15138 raft_consensus.cc:2804] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:59.000089 15330 raft_consensus.cc:697] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:59.001632 15328 ts_tablet_manager.cc:1916] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:59.001461 15330 consensus_queue.cc:237] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:58.321004 12432 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskCfbsfU/build/tsan/bin/kudu as pid 14244
W20260810 13:53:58.892846 12744 rpcz_store.cc:269] 0810 13:53:57.520813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.046959 (+526146us) service_pool.cc:224] Handling call
0810 13:53:58.276080 (+229121us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:58.868577 (+592497us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:58.548225 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:58.548844 (+ 619us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:58.548872 (+ 28us) write_op.cc:435] Acquired schema lock
0810 13:53:58.548887 (+ 15us) tablet.cc:662] Decoding operations
0810 13:53:58.549168 (+ 281us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:58.549211 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:58.549233 (+ 22us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:58.549403 (+ 170us) tablet.cc:701] Row locks acquired
0810 13:53:58.549418 (+ 15us) write_op.cc:260] PREPARE: finished
0810 13:53:58.549547 (+ 129us) write_op.cc:270] Start()
0810 13:53:58.549641 (+ 94us) write_op.cc:276] Timestamp: P: 1786370038549465 usec, L: 0
0810 13:53:58.549657 (+ 16us) op_driver.cc:348] REPLICATION: starting
0810 13:53:58.550534 (+ 877us) log.cc:844] Serialized 527 byte log entry
0810 13:53:58.561783 (+ 11249us) op_driver.cc:464] REPLICATION: finished
0810 13:53:58.562196 (+ 413us) write_op.cc:301] APPLY: starting
0810 13:53:58.562264 (+ 68us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:58.562458 (+ 194us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:58.562589 (+ 131us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:58.562882 (+ 293us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:58.563113 (+ 231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:58.563178 (+ 65us) write_op.cc:312] APPLY: finished
0810 13:53:58.563389 (+ 211us) log.cc:844] Serialized 23 byte log entry
0810 13:53:58.563569 (+ 180us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:58.563640 (+ 71us) write_op.cc:454] Released schema lock
0810 13:53:58.563683 (+ 43us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:58.564034 (+ 351us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:58.564067 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"spinlock_wait_cycles":207338240,"child_traces":[["op",{"apply.queue_time_us":203,"apply.run_cpu_time_us":1834,"apply.run_wall_time_us":1834,"mutex_wait_us":29925,"num_ops":1,"prepare.queue_time_us":12006,"prepare.run_cpu_time_us":2453,"prepare.run_wall_time_us":2646,"raft.queue_time_us":220,"raft.run_cpu_time_us":1495,"raft.run_wall_time_us":34842,"replication_time_us":12002}]]}
W20260810 13:53:58.882562 12740 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 79) took 3301 ms (client timeout 1000 ms). Trace:
I20260810 13:53:59.019119 15138 raft_consensus.cc:697] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:59.020105 15138 consensus_queue.cc:237] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.021565 13638 tablet_bootstrap.cc:492] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:59.021984 13638 ts_tablet_manager.cc:1403] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.321s user 0.019s sys 0.019s
I20260810 13:53:59.023216 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_230d8010fef046048e532692ee7681c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:59.024549 13638 raft_consensus.cc:359] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.025269 13638 raft_consensus.cc:385] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:59.025542 13638 raft_consensus.cc:740] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:59.027609 13638 consensus_queue.cc:260] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.020781 12744 master_service.cc:960] ReplaceTablet: received request to replace tablet 452978fbf3b74e3c9b16756b9f394be7 from {username='slave'} at 127.0.0.1:48758
I20260810 13:53:59.030351 13638 ts_tablet_manager.cc:1434] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260810 13:53:59.031898 13638 tablet_bootstrap.cc:492] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:53:59.037212 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11e3902adc094227830cf6ddab916916 has no consensus state
I20260810 13:53:59.039098 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_70b6f93d3d5b4c96a17ca2ffe2efe136"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:58.989044 15321 tablet_replica.cc:333] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:59.044241 13638 tablet_bootstrap.cc:654] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:53:59.014163 12740 rpcz_store.cc:269] 0810 13:53:55.580720 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:55.598313 (+ 17593us) service_pool.cc:224] Handling call
0810 13:53:58.882461 (+3284148us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:57.024559 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:57.135985 (+111426us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:57.136024 (+ 39us) write_op.cc:435] Acquired schema lock
0810 13:53:57.136045 (+ 21us) tablet.cc:662] Decoding operations
0810 13:53:57.136390 (+ 345us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:57.136444 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:57.136477 (+ 33us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:57.136736 (+ 259us) tablet.cc:701] Row locks acquired
0810 13:53:57.136756 (+ 20us) write_op.cc:260] PREPARE: finished
0810 13:53:57.136912 (+ 156us) write_op.cc:270] Start()
0810 13:53:57.137021 (+ 109us) write_op.cc:276] Timestamp: P: 1786370037136858 usec, L: 0
0810 13:53:57.137045 (+ 24us) op_driver.cc:348] REPLICATION: starting
0810 13:53:57.137751 (+ 706us) log.cc:844] Serialized 527 byte log entry
0810 13:53:57.154722 (+ 16971us) op_driver.cc:464] REPLICATION: finished
0810 13:53:57.154971 (+ 249us) write_op.cc:301] APPLY: starting
0810 13:53:57.155021 (+ 50us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:57.155108 (+ 87us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:57.155200 (+ 92us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:57.155416 (+ 216us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:57.155543 (+ 127us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:57.155587 (+ 44us) write_op.cc:312] APPLY: finished
0810 13:53:57.155773 (+ 186us) log.cc:844] Serialized 23 byte log entry
0810 13:53:57.155918 (+ 145us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.155974 (+ 56us) write_op.cc:454] Released schema lock
0810 13:53:57.156005 (+ 31us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:57.156251 (+ 246us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:57.156275 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":143975,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":107,"apply.run_cpu_time_us":1243,"apply.run_wall_time_us":1243,"num_ops":1,"prepare.queue_time_us":65571,"prepare.run_cpu_time_us":2790,"prepare.run_wall_time_us":114744,"replication_time_us":17570}]]}
I20260810 13:53:58.966840 15063 raft_consensus.cc:515] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.058794 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:59.059648 13043 raft_consensus.cc:3060] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:59.063666 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:59.066286 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:59.064395 13465 raft_consensus.cc:2468] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:58.938648 13639 tablet_bootstrap.cc:492] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:53:59.074896 15321 raft_consensus.cc:2243] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:59.079567 15034 leader_election.cc:290] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:59.087800 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:53:59.089327 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70b6f93d3d5b4c96a17ca2ffe2efe136 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:59.089509 13467 raft_consensus.cc:2468] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:53:59.090016 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_230d8010fef046048e532692ee7681c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:59.090327 15063 leader_election.cc:290] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:59.090816 15321 raft_consensus.cc:2272] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:59.092417 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a3a4d2724b42da83a523e208b5714b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:59.092994 13474 raft_consensus.cc:2468] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:59.112545 13640 tablet_bootstrap.cc:492] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:53:59.076661 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_3b9ddfd681b44dce8e728004ab230e73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:59.112991 13640 ts_tablet_manager.cc:1403] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.424s user 0.018s sys 0.001s
I20260810 13:53:59.115319 13640 raft_consensus.cc:359] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.115933 13640 raft_consensus.cc:385] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:59.116189 13640 raft_consensus.cc:740] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:53:59.116623 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3b9ddfd681b44dce8e728004ab230e73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:59.119721 13043 raft_consensus.cc:2468] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:59.121593 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:59.122539 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d4ada59acb684b27b742fb4abba2fccf" } modify_external_catalogs: true
I20260810 13:53:59.123904 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a3a4d2724b42da83a523e208b5714b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:59.124903 13474 raft_consensus.cc:3060] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:53:59.129401 12745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 80) took 2449 ms (client timeout 1000 ms). Trace:
W20260810 13:53:59.130151 12745 rpcz_store.cc:269] 0810 13:53:56.679818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:56.923317 (+243499us) service_pool.cc:224] Handling call
0810 13:53:57.080213 (+156896us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:59.129324 (+2049111us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":24,"spinlock_wait_cycles":297438080}
I20260810 13:53:59.141757 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:59.149290 13434 tablet_service.cc:1511] Processing CreateTablet for tablet baa17cc9fd524b0981cb2368a7265df1 (DEFAULT_TABLE table=default.Table_a80ad2cc0680447898f832a3da957607 [id=b7e44fb60b9b401db5517c2fd7e8c70b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.150460 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa17cc9fd524b0981cb2368a7265df1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.153337 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_198786add2fc4ddda490f49366a8eeed" } new_table_name: "default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5" modify_external_catalogs: true
W20260810 13:53:59.163097 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cb4dcad38c1a4269b4740a8e5247a867 consensus state has no leader
I20260810 13:53:59.120118 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet 69a3a4d2724b42da83a523e208b5714b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:59.122262 15305 raft_consensus.cc:493] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:53:59.173331 15305 raft_consensus.cc:515] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:59.176548 15305 leader_election.cc:290] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:59.179339 13167 leader_election.cc:304] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:59.180311 15063 raft_consensus.cc:2804] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:53:59.181048 15063 raft_consensus.cc:697] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:53:59.182509 15063 consensus_queue.cc:237] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.184418 15034 raft_consensus.cc:493] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:59.185067 15034 raft_consensus.cc:515] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.189519 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:59.196873 13470 raft_consensus.cc:3060] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:59.199364 13639 tablet_bootstrap.cc:654] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:59.111474 15321 ts_tablet_manager.cc:1916] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:59.217496 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_de488738829d49dbb554c8fb0d854bd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:59.221066 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d4ada59acb684b27b742fb4abba2fccf" } modify_external_catalogs: true
I20260810 13:53:59.221627 15034 leader_election.cc:290] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:59.222621 13425 tablet_service.cc:1558] Processing DeleteTablet for tablet f4946f79b54c46b1a59edf169109ab47 with delete_type TABLET_DATA_DELETED (replaced by tablet dd58cc128ce64f9abe1418b6093a1c2c) from {username='slave'} at 127.0.0.1:43224
W20260810 13:53:59.227123 12750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 81) took 1523 ms (client timeout 1000 ms). Trace:
W20260810 13:53:59.238318 12750 rpcz_store.cc:269] 0810 13:53:57.703802 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.053215 (+349413us) service_pool.cc:224] Handling call
0810 13:53:58.237468 (+184253us) spinlock_profiling.cc:243] Waited 50.5 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:53:59.227056 (+989588us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":28,"spinlock_wait_cycles":116126080}
I20260810 13:53:59.250061 13638 tablet_bootstrap.cc:492] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:59.250593 13638 ts_tablet_manager.cc:1403] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.219s user 0.010s sys 0.003s
W20260810 13:53:59.253499 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d2d209f801b4aa0aff3137a51fc7556 consensus state has no leader
I20260810 13:53:59.254968 13638 raft_consensus.cc:359] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:53:59.257038 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de488738829d49dbb554c8fb0d854bd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:59.258826 13638 raft_consensus.cc:385] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:59.262203 13638 raft_consensus.cc:740] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:59.263129 13638 consensus_queue.cc:260] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.266705 13638 ts_tablet_manager.cc:1434] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20260810 13:53:59.270064 13638 tablet_bootstrap.cc:492] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:59.285779 13640 consensus_queue.cc:260] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.295437 13639 tablet_bootstrap.cc:492] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:59.296005 13639 ts_tablet_manager.cc:1403] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.358s user 0.010s sys 0.005s
I20260810 13:53:59.299645 13639 raft_consensus.cc:359] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.300395 13639 raft_consensus.cc:385] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:59.300889 13639 raft_consensus.cc:740] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:53:59.301529 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet c793dedc5e714fe6bd36e507695e82d0 with delete_type TABLET_DATA_DELETED (replaced by tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.302906 13420 tablet_service.cc:1511] Processing CreateTablet for tablet e3f4b863f701471ab173b68049b1a602 (DEFAULT_TABLE table=default.Table_b83389f8c6794e7bbfa97ae916d990cd [id=c6ed8601e0a247318e4b9177c74b1391]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.303748 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet 53a99165463a43c78f4ccb6c5892f4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:57 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.304234 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3f4b863f701471ab173b68049b1a602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.304823 13432 tablet_service.cc:1511] Processing CreateTablet for tablet efc446acced34a6c87e459c5542c1c77 (DEFAULT_TABLE table=default.Table_3fb4e7e2f617464f930b338a8ece6e38 [id=0acde9f8e2f7483c9eb7f3df14b0859d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.305506 13428 tablet_service.cc:1511] Processing CreateTablet for tablet 1bbee4f9a50342599434a2b05c0740bd (DEFAULT_TABLE table=default.Table_85b411d6527d4231a4934a690459d06d [id=53f4e0e75cee4b53a7ba2b30f19025cc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.306809 13435 tablet_service.cc:1511] Processing CreateTablet for tablet ce84eacbab61417a9497f8770b4da511 (DEFAULT_TABLE table=default.Table_640c451fefef49f3a4960de11632ca5a [id=23d722ef12c849af85d88c980f7ae3d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.307322 13426 tablet_service.cc:1511] Processing CreateTablet for tablet bec54cb915a54949871181763ad956d5 (DEFAULT_TABLE table=default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.307586 13639 consensus_queue.cc:260] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.302876 15328 ts_tablet_manager.cc:1929] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:59.308533 13436 tablet_service.cc:1558] Processing DeleteTablet for tablet ac2c102382734913bffb5436e06fe0a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:58 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.308892 15328 log.cc:1199] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/063e3b74a9a248a1aa0c2de4b4b73a06
I20260810 13:53:59.309715 15328 ts_tablet_manager.cc:1950] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:59.305787 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efc446acced34a6c87e459c5542c1c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.310212 13421 tablet_service.cc:1511] Processing CreateTablet for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 (DEFAULT_TABLE table=default.Table_2e79b198186741b39955b48b1832908a [id=cee4946b4fa14e43aaff44073785db31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.311352 15328 tablet_replica.cc:333] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:59.312072 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 62e88a52755140019a6d9f7041db0837 (DEFAULT_TABLE table=default.Table_9f48e93a010b4fc5b43124a1f8248ddf [id=011f63bf5ea44f918070a9ead229fa95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.304913 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5114911fdf4b19afec0c71ded5ef9a (DEFAULT_TABLE table=default.Table_8a8233c099eb45dba66c3d0f9bdbe18b [id=d9a327f6557d42bb998964e1d594cb1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.315541 13640 ts_tablet_manager.cc:1434] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.202s user 0.006s sys 0.000s
I20260810 13:53:59.317828 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce84eacbab61417a9497f8770b4da511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.317970 13429 tablet_service.cc:1511] Processing CreateTablet for tablet f37f4b2d04f84e119da2743234865baf (DEFAULT_TABLE table=default.Table_071663fc830e44ef9d25a38fc8301ba7 [id=dd579b0cb2684ce08640cf4f5edae65c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.318853 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f37f4b2d04f84e119da2743234865baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.322748 13417 tablet_service.cc:1511] Processing CreateTablet for tablet bd3119d63857480294dcb68ed0451bc0 (DEFAULT_TABLE table=default.Table_866916d7d8234bcb8dfc9bff54ada066 [id=69ab247d257c42e89ed2ebe36dde8c01]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.324316 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd3119d63857480294dcb68ed0451bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.325521 13424 tablet_service.cc:1511] Processing CreateTablet for tablet ad6a373308fa4b039e8331d9a0a90d16 (DEFAULT_TABLE table=default.Table_de6ec143f22d4a129657021013e42fb8 [id=9f7549a9604c496b934fdac98cdae2cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.327720 13470 raft_consensus.cc:2468] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:53:59.309165 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 8d647bf5c1ba42f48186661310065448 (DEFAULT_TABLE table=default.Table_4a0d9399ab4c468fab4289955631b20f [id=9ec5220333d6496b83c73d11150e444c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.343241 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0273e6188f99471782854cfcfc5ac382" } new_table_name: "default.Table_1be07447c0034861a4616ab195eb8e46" modify_external_catalogs: true
I20260810 13:53:59.346865 13442 tablet_service.cc:1511] Processing CreateTablet for tablet f425739a239144048975fb15a26d197e (DEFAULT_TABLE table=default.Table_2d75c2da0411444ba34cab36ab78b40b [id=b41bc79022ca450faafad8b504afe6ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.361055 15290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=5 ignored=0} inserts{seen=5 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260810 13:53:59.362336 15290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Bootstrap complete.
W20260810 13:53:59.384115 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d5aa1374d37a4918af34a5e9b15c16b3 consensus state has no leader
I20260810 13:53:59.306804 13423 tablet_service.cc:1511] Processing CreateTablet for tablet bf672d15f88c4f0dbdf2fdb6aefa1108 (DEFAULT_TABLE table=default.Table_51465ee8c49d4f90ab30de95dbda8bbc [id=15017d241bbc4bd58f9951ed24687713]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.388378 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5114911fdf4b19afec0c71ded5ef9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.392361 15348 tablet_replica.cc:333] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:53:59.392401 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad6a373308fa4b039e8331d9a0a90d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.393352 15348 raft_consensus.cc:2243] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:59.393893 15348 raft_consensus.cc:2272] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:59.394474 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d647bf5c1ba42f48186661310065448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.409101 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 063e3b74a9a248a1aa0c2de4b4b73a06 (table default.Table_1023c03a20e448b4abaa7920a9ae09d9 [id=e1f370bc63c248378875a3361c4e28e3]) successfully deleted
I20260810 13:53:59.422566 13640 tablet_bootstrap.cc:492] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:53:59.423162 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bec54cb915a54949871181763ad956d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.424010 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.427915 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet 07ff9e8a8ca845b89154ed0626d34c5c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.428488 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.429032 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5d7a695c694d1993c2d0c4d3127fca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.429504 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc9bef2781f4046a30c5394fc5d5529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:40 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.429692 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 17df06cad1404d96bda5822be6a6e995 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.430208 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet c4db9d7e82414cab8a69618effe89b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.430276 13430 tablet_service.cc:1558] Processing DeleteTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.430799 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet ee27d158bd40425a8c6fa8cb068daa79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.435873 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_be306c3fb9ed4777b1f296aac4b5ae63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:53:59.437111 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f425739a239144048975fb15a26d197e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.437903 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9930da7fdf244dd099a7b0c848073c55"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:59.439365 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9930da7fdf244dd099a7b0c848073c55 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:59.441581 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be306c3fb9ed4777b1f296aac4b5ae63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:59.447583 13639 ts_tablet_manager.cc:1434] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.151s user 0.001s sys 0.006s
I20260810 13:53:59.447683 15321 ts_tablet_manager.cc:1929] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:59.448100 15321 log.cc:1199] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/c4db9d7e82414cab8a69618effe89b40
I20260810 13:53:59.453279 13638 tablet_bootstrap.cc:654] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:59.459610 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_750e154b9a7a4141baa6de859c042732" } new_table_name: "default.Table_a74e3c8045af416794a1ae89194e4eff" modify_external_catalogs: true
I20260810 13:53:59.460940 15328 raft_consensus.cc:2243] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:59.461612 15328 raft_consensus.cc:2272] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:59.464339 15328 ts_tablet_manager.cc:1916] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:59.477763 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:59.488178 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:59.492214 15328 ts_tablet_manager.cc:1929] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:53:59.492673 15328 log.cc:1199] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/17df06cad1404d96bda5822be6a6e995
I20260810 13:53:59.493607 15328 ts_tablet_manager.cc:1950] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:59.499521 13639 tablet_bootstrap.cc:492] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:53:59.509377 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 00a7bce2378f482d81d2ad08e9d15b0c consensus state has no leader
I20260810 13:53:59.515764 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bbee4f9a50342599434a2b05c0740bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.516948 15286 raft_consensus.cc:493] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:59.517409 15286 raft_consensus.cc:515] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.517935 13427 tablet_service.cc:1558] Processing DeleteTablet for tablet 69a3a4d2724b42da83a523e208b5714b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.523209 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.523903 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62e88a52755140019a6d9f7041db0837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.526105 15328 tablet_replica.cc:333] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:59.527050 15328 raft_consensus.cc:2243] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:53:59.528005 15328 raft_consensus.cc:2272] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:53:59.531082 12954 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:53:59.541286 15328 ts_tablet_manager.cc:1916] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:59.542932 13425 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dea61b84b614ead8830873568f9b7c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:39 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.551349 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9243eda3974532aff0425885f54166" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:59.560981 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 17df06cad1404d96bda5822be6a6e995 (table default.Table_f101d8577cc1452ea2515229ebad2441 [id=eb2b695cdb5c4ee78dc155df3cc8e21f]) successfully deleted
W20260810 13:53:59.561830 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet f4946f79b54c46b1a59edf169109ab47 because the tablet was not found. No further retry: Not found: Tablet not found: f4946f79b54c46b1a59edf169109ab47
I20260810 13:53:59.565128 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9243eda3974532aff0425885f54166" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:59.575060 15328 ts_tablet_manager.cc:1929] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:59.575467 15328 log.cc:1199] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/1b84bd35b02f4a1faf15ac9bc21e6146
I20260810 13:53:59.576218 15328 ts_tablet_manager.cc:1950] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:53:59.576897 13164 leader_election.cc:343] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 063e3b74a9a248a1aa0c2de4b4b73a06
I20260810 13:53:59.577939 13164 leader_election.cc:304] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:59.579010 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43def9358894b2aa001a7db56706589" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:59.513993 13639 tablet_bootstrap.cc:654] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:59.581936 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef59f7013ab4489dadd9084d065533a8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:59.583490 15138 raft_consensus.cc:2749] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:53:59.585734 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5d7a695c694d1993c2d0c4d3127fca" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:53:59.586261 13260 raft_consensus.cc:3060] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:59.586547 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:53:59.587440 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:53:59.588086 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:53:59.590621 15063 consensus_queue.cc:1048] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:53:59.591573 12999 tablet_service.cc:1511] Processing CreateTablet for tablet 006c7409946a4122a95468288ed3aef0 (DEFAULT_TABLE table=default.Table_2822dc6c838f40929cbe086ba80014db [id=4382337c7dcd4747b3e6abb01c288085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.592492 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:53:59.592844 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006c7409946a4122a95468288ed3aef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.593070 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:53:59.593175 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 006c7409946a4122a95468288ed3aef0 (DEFAULT_TABLE table=default.Table_2822dc6c838f40929cbe086ba80014db [id=4382337c7dcd4747b3e6abb01c288085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.593647 12747 catalog_manager.cc:5719] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260810 13:53:59.596557 13213 tablet_service.cc:1511] Processing CreateTablet for tablet ac27a168faad4542967097f909ce3997 (DEFAULT_TABLE table=default.Table_b392780f45ab4b899ddb12eefbcdd556 [id=0a7b7ff4685e4a8884b4aab7a835890d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.595875 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5d55900f1adf4aca973dbf4e94ca29c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:59.603309 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d55900f1adf4aca973dbf4e94ca29c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:59.603720 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef59f7013ab4489dadd9084d065533a8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:59.597826 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_36d488faa81542ca8b55867672ca281a" } new_table_name: "default.Table_749584748a734ef5bb99ef5e3d783857" modify_external_catalogs: true
I20260810 13:53:59.608754 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43def9358894b2aa001a7db56706589" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:59.609303 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:53:59.609505 13050 raft_consensus.cc:2393] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:53:59.624394 15328 tablet_replica.cc:333] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:59.625380 15328 raft_consensus.cc:2243] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:59.625964 15328 raft_consensus.cc:2272] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:59.626591 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006c7409946a4122a95468288ed3aef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.628062 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac27a168faad4542967097f909ce3997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.628239 15328 ts_tablet_manager.cc:1916] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:59.632265 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5d7a695c694d1993c2d0c4d3127fca" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:53:59.632901 13050 raft_consensus.cc:3060] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:59.636448 13260 raft_consensus.cc:2468] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:59.640846 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 1b84bd35b02f4a1faf15ac9bc21e6146 (table default.Table_cb09b1a8472e4349bbbac0669af3d045 [id=5222178a76314f4da374fe8c2984369b]) successfully deleted
I20260810 13:53:59.649066 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 0a6893b0b32646f6aeb72c866251a112
I20260810 13:53:59.650195 13050 raft_consensus.cc:2468] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:53:59.650544 12746 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 507) took 1366 ms. Trace:
I20260810 13:53:59.557003 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf672d15f88c4f0dbdf2fdb6aefa1108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.655104 13216 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a6893b0b32646f6aeb72c866251a112 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:58 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:59.650828 12746 rpcz_store.cc:276] 0810 13:53:58.284004 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.934243 (+650239us) service_pool.cc:224] Handling call
0810 13:53:58.947527 (+ 13284us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:53:58.998647 (+ 51120us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:53:58.998778 (+ 131us) catalog_manager.cc:2850] Locking tablets
0810 13:53:59.572299 (+573521us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:53:59.648670 (+ 76371us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:53:59.648905 (+ 235us) catalog_manager.cc:2898] Committing in-memory state
0810 13:53:59.648988 (+ 83us) catalog_manager.cc:2902] Aborting table tasks
0810 13:53:59.650484 (+ 1496us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:59.597040 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:59.597382 (+ 342us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:59.597408 (+ 26us) write_op.cc:435] Acquired schema lock
0810 13:53:59.597420 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:59.597708 (+ 288us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:59.597752 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:59.597773 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:59.598029 (+ 256us) tablet.cc:701] Row locks acquired
0810 13:53:59.598043 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:59.598136 (+ 93us) write_op.cc:270] Start()
0810 13:53:59.598207 (+ 71us) write_op.cc:276] Timestamp: P: 1786370039598067 usec, L: 0
0810 13:53:59.598222 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:59.598603 (+ 381us) log.cc:844] Serialized 725 byte log entry
0810 13:53:59.645565 (+ 46962us) op_driver.cc:464] REPLICATION: finished
0810 13:53:59.647332 (+ 1767us) write_op.cc:301] APPLY: starting
0810 13:53:59.647388 (+ 56us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:59.647482 (+ 94us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:59.647562 (+ 80us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:59.647845 (+ 283us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:59.647979 (+ 134us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:53:59.648022 (+ 43us) write_op.cc:312] APPLY: finished
0810 13:53:59.648179 (+ 157us) log.cc:844] Serialized 29 byte log entry
0810 13:53:59.648331 (+ 152us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:59.648387 (+ 56us) write_op.cc:454] Released schema lock
0810 13:53:59.648414 (+ 27us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:59.648629 (+ 215us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:59.648651 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1634,"apply.run_cpu_time_us":1265,"apply.run_wall_time_us":1264,"num_ops":2,"prepare.queue_time_us":22991,"prepare.run_cpu_time_us":1714,"prepare.run_wall_time_us":1713,"replication_time_us":47266}]]}
I20260810 13:53:59.662784 15321 ts_tablet_manager.cc:1950] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:53:59.665839 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet c4db9d7e82414cab8a69618effe89b40 (table default.Table_a854e55f38e14aee8898f1cb29ba6b9b [id=7f6b178a7e0a44cdbc49adfea482738b]) successfully deleted
I20260810 13:53:59.691809 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 452978fbf3b74e3c9b16756b9f394be7
I20260810 13:53:59.693133 12744 catalog_manager.cc:6807] ReplaceTablet: tablet 452978fbf3b74e3c9b16756b9f394be7 deleted and replaced by tablet 01d42c8476514b71af3ce2fbc12270d0
I20260810 13:53:59.693468 12744 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:48758 (request call id 510) took 1030 ms. Trace:
W20260810 13:53:59.694221 13164 leader_election.cc:343] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 4dea61b84b614ead8830873568f9b7c4
I20260810 13:53:59.694643 13164 leader_election.cc:304] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:59.695652 15063 raft_consensus.cc:2749] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:59.693754 12744 rpcz_store.cc:276] 0810 13:53:58.662866 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.020630 (+357764us) service_pool.cc:224] Handling call
0810 13:53:59.693416 (+672786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:59.598872 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:59.599193 (+ 321us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:59.599214 (+ 21us) write_op.cc:435] Acquired schema lock
0810 13:53:59.599225 (+ 11us) tablet.cc:662] Decoding operations
0810 13:53:59.612980 (+ 13755us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:59.613014 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:59.613036 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:53:59.613211 (+ 175us) tablet.cc:701] Row locks acquired
0810 13:53:59.613225 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:53:59.613330 (+ 105us) write_op.cc:270] Start()
0810 13:53:59.613405 (+ 75us) write_op.cc:276] Timestamp: P: 1786370039613257 usec, L: 0
0810 13:53:59.613420 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:53:59.613846 (+ 426us) log.cc:844] Serialized 622 byte log entry
0810 13:53:59.689042 (+ 75196us) op_driver.cc:464] REPLICATION: finished
0810 13:53:59.689918 (+ 876us) write_op.cc:301] APPLY: starting
0810 13:53:59.689977 (+ 59us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:59.690092 (+ 115us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:59.690172 (+ 80us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:59.690566 (+ 394us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:59.690754 (+ 188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:59.690797 (+ 43us) write_op.cc:312] APPLY: finished
0810 13:53:59.690978 (+ 181us) log.cc:844] Serialized 29 byte log entry
0810 13:53:59.691129 (+ 151us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:59.691189 (+ 60us) write_op.cc:454] Released schema lock
0810 13:53:59.691235 (+ 46us) write_op.cc:341] FINISH: Updating metrics
0810 13:53:59.691457 (+ 222us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:59.691479 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":726,"apply.run_cpu_time_us":1512,"apply.run_wall_time_us":1512,"num_ops":2,"prepare.queue_time_us":16422,"prepare.run_cpu_time_us":1685,"prepare.run_wall_time_us":15128,"replication_time_us":75532}]]}
W20260810 13:53:59.696463 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 48a059240c0f48ee958ef728acfcae92 consensus state has no leader
I20260810 13:53:59.697368 13216 tablet_service.cc:1558] Processing DeleteTablet for tablet 452978fbf3b74e3c9b16756b9f394be7 with delete_type TABLET_DATA_DELETED (replaced by tablet 01d42c8476514b71af3ce2fbc12270d0) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:59.700189 15348 ts_tablet_manager.cc:1916] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:59.706678 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 with delete_type TABLET_DATA_DELETED (replaced by tablet 97015b4984c74a4682b6dedd47dc6650) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.707589 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4
I20260810 13:53:59.709939 13216 tablet_service.cc:1558] Processing DeleteTablet for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:59 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:53:59.713899 13164 leader_election.cc:343] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: c4db9d7e82414cab8a69618effe89b40
I20260810 13:53:59.714406 13164 leader_election.cc:304] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:53:59.715034 13164 raft_consensus.cc:2686] T c4db9d7e82414cab8a69618effe89b40 P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:53:59.717854 13164 leader_election.cc:343] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 063e3b74a9a248a1aa0c2de4b4b73a06
I20260810 13:53:59.707211 13436 tablet_service.cc:1558] Processing DeleteTablet for tablet 1b84bd35b02f4a1faf15ac9bc21e6146 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:37 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:53:59.724309 13164 leader_election.cc:304] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:59.725734 15063 raft_consensus.cc:2749] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:53:59.728534 15314 raft_consensus.cc:493] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:59.729136 15314 raft_consensus.cc:515] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.731035 15314 leader_election.cc:290] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:59.731519 13229 tablet_service.cc:1511] Processing CreateTablet for tablet de012d382b194bf193fef76779abcf17 (DEFAULT_TABLE table=default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.732988 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 39514e069d6841df9fced9e62981eac5 (DEFAULT_TABLE table=default.Table_f6d23e8eec824ef08b26dec8c7c6d010 [id=4d373c8f174b46e99209a83ab947b204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.736514 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de012d382b194bf193fef76779abcf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.744659 15314 raft_consensus.cc:493] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:59.745107 15314 raft_consensus.cc:515] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.745940 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39514e069d6841df9fced9e62981eac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.717228 15286 leader_election.cc:290] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:59.748517 13638 tablet_bootstrap.cc:492] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:59.749020 13638 ts_tablet_manager.cc:1403] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.479s user 0.012s sys 0.006s
I20260810 13:53:59.751644 13638 raft_consensus.cc:359] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.752342 13638 raft_consensus.cc:385] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:59.758646 13227 tablet_service.cc:1511] Processing CreateTablet for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 (DEFAULT_TABLE table=default.Table_d4ada59acb684b27b742fb4abba2fccf [id=70dc47e225894242b54466f69cd37bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.759765 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.752636 13638 raft_consensus.cc:740] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:59.766505 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:59.767467 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:59.767753 15314 leader_election.cc:290] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:53:59.768306 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:53:59.769078 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:59.769162 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:59.770265 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69a3a4d2724b42da83a523e208b5714b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:53:59.770534 13470 raft_consensus.cc:3060] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:59.766235 13638 consensus_queue.cc:260] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.772356 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 67ec9aba240b49e6a78c268b20dc901b (DEFAULT_TABLE table=default.Table_32a20912aef145aabc1b19b2b796c682 [id=6180bc58d52049fa82f92dc5e5a6b891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.777274 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ec9aba240b49e6a78c268b20dc901b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.779592 13638 ts_tablet_manager.cc:1434] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.030s user 0.003s sys 0.002s
I20260810 13:53:59.781327 13639 tablet_bootstrap.cc:492] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:53:59.783530 12994 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 29) took 1400 ms. Trace:
I20260810 13:53:59.784016 13011 tablet_service.cc:1511] Processing CreateTablet for tablet ac27a168faad4542967097f909ce3997 (DEFAULT_TABLE table=default.Table_b392780f45ab4b899ddb12eefbcdd556 [id=0a7b7ff4685e4a8884b4aab7a835890d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.784070 12994 rpcz_store.cc:276] 0810 13:53:58.382496 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.382613 (+ 117us) service_pool.cc:224] Handling call
0810 13:53:58.996597 (+613984us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400170cd4. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:53:59.783263 (+786666us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345428352}
I20260810 13:53:59.785254 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac27a168faad4542967097f909ce3997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.785629 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet 452978fbf3b74e3c9b16756b9f394be7 with delete_type TABLET_DATA_DELETED (replaced by tablet 01d42c8476514b71af3ce2fbc12270d0) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:59.787391 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:59 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:59.789086 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a6893b0b32646f6aeb72c866251a112 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:58 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:53:59.789572 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 39514e069d6841df9fced9e62981eac5 (DEFAULT_TABLE table=default.Table_f6d23e8eec824ef08b26dec8c7c6d010 [id=4d373c8f174b46e99209a83ab947b204]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.790371 13639 ts_tablet_manager.cc:1403] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.291s user 0.008s sys 0.005s
I20260810 13:53:59.790525 15328 ts_tablet_manager.cc:1929] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:53:59.790930 15328 log.cc:1199] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/ac2c102382734913bffb5436e06fe0a1
I20260810 13:53:59.791782 15328 ts_tablet_manager.cc:1950] T ac2c102382734913bffb5436e06fe0a1 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:53:59.792814 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39514e069d6841df9fced9e62981eac5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:59.797291 13382 leader_election.cc:343] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:59.797693 13382 leader_election.cc:304] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:59.799528 15034 raft_consensus.cc:2749] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:59.751591 15290 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:53:59.809494 15328 tablet_replica.cc:333] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:53:59.810359 15328 raft_consensus.cc:2243] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:59.810838 15328 raft_consensus.cc:2272] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:59.819156 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 83c7a8e941ea433d890fdbea2b754f22 (DEFAULT_TABLE table=default.Table_253b7e39c5104cbf95380f1adce4c89c [id=0eb0b4069592419abf43b72e6c4df751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.822140 15328 ts_tablet_manager.cc:1916] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:59.825963 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c7a8e941ea433d890fdbea2b754f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.826404 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 4520d51666b04814814fbaa8b71430fc (DEFAULT_TABLE table=default.Table_d9a82635a9fc49d9943077eb2387dddb [id=3ee39e801f0245a8b38bd2c44ee239cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.829710 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4520d51666b04814814fbaa8b71430fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.830549 15369 raft_consensus.cc:493] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:59.831082 15369 raft_consensus.cc:515] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.838035 15369 leader_election.cc:290] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:59.848922 15344 raft_consensus.cc:493] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:53:59.849419 15344 raft_consensus.cc:515] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:53:59.851703 15344 leader_election.cc:290] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:53:59.853001 15321 tablet_replica.cc:333] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:53:59.855369 15321 raft_consensus.cc:2243] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:53:59.855878 15321 raft_consensus.cc:2272] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:53:59.857750 15321 ts_tablet_manager.cc:1916] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:53:59.862577 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:53:59.869855 13021 tablet_service.cc:1511] Processing CreateTablet for tablet de012d382b194bf193fef76779abcf17 (DEFAULT_TABLE table=default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.870407 13004 tablet_service.cc:1511] Processing CreateTablet for tablet 83c7a8e941ea433d890fdbea2b754f22 (DEFAULT_TABLE table=default.Table_253b7e39c5104cbf95380f1adce4c89c [id=0eb0b4069592419abf43b72e6c4df751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.871135 13022 tablet_service.cc:1511] Processing CreateTablet for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 (DEFAULT_TABLE table=default.Table_d4ada59acb684b27b742fb4abba2fccf [id=70dc47e225894242b54466f69cd37bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.872565 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 760914a47cc744b7bdf3b40a85b3369c (DEFAULT_TABLE table=default.Table_7cbcdca887724284a33c681c9574ea82 [id=8a8a45a7ac264648b3810d9c69a36751]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:53:59.874450 13167 consensus_peers.cc:597] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:59.874984 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 67ec9aba240b49e6a78c268b20dc901b (DEFAULT_TABLE table=default.Table_32a20912aef145aabc1b19b2b796c682 [id=6180bc58d52049fa82f92dc5e5a6b891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.875656 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 4520d51666b04814814fbaa8b71430fc (DEFAULT_TABLE table=default.Table_d9a82635a9fc49d9943077eb2387dddb [id=3ee39e801f0245a8b38bd2c44ee239cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.877480 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet ac2c102382734913bffb5436e06fe0a1 (table default.Table_bbf02f15a5404f0d95042f20dac5c146 [id=cb4b9877529f4cc38a48b2a61be4aa6c]) successfully deleted
W20260810 13:53:59.881563 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 82303.5us
W20260810 13:53:59.882165 13382 leader_election.cc:343] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:59.882617 13382 leader_election.cc:304] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:59.883644 13638 tablet_bootstrap.cc:492] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:53:59.885116 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 760914a47cc744b7bdf3b40a85b3369c (DEFAULT_TABLE table=default.Table_7cbcdca887724284a33c681c9574ea82 [id=8a8a45a7ac264648b3810d9c69a36751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.886066 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760914a47cc744b7bdf3b40a85b3369c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:59.889281 15370 log.cc:927] Time spent T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.088s user 0.000s sys 0.000s
I20260810 13:53:59.898577 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 30676a11ab60455aa4ccd22347beb80e (DEFAULT_TABLE table=default.Table_d8ab37a103a5426b81dcf295239ec9af [id=b7130fcdfcf54b76861fd9c87559beeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.874419 15138 raft_consensus.cc:493] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:53:59.902506 15138 raft_consensus.cc:515] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.916582 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_685646f8452341a5ab555e24627f28ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:59.918180 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_685646f8452341a5ab555e24627f28ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:53:59.919996 13382 leader_election.cc:343] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:53:59.920490 13382 leader_election.cc:304] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:53:59.921404 12749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_749584748a734ef5bb99ef5e3d783857" } modify_external_catalogs: true
I20260810 13:53:59.921864 12749 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_749584748a734ef5bb99ef5e3d783857" } modify_external_catalogs: true
I20260810 13:53:59.927946 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_23cb4b4f896b48b1adc91079a7382c5c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:59.929374 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23cb4b4f896b48b1adc91079a7382c5c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:59.929970 13638 tablet_bootstrap.cc:654] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:53:59.930956 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ad5024a6b14845a2aaf72b7f2f6fba8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:53:59.932298 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad5024a6b14845a2aaf72b7f2f6fba8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:53:59.932838 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_866916d7d8234bcb8dfc9bff54ada066" } new_table_name: "default.Table_45b2de0cf9874b08bf25152d4657565e" modify_external_catalogs: true
I20260810 13:53:59.937314 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 30676a11ab60455aa4ccd22347beb80e (DEFAULT_TABLE table=default.Table_d8ab37a103a5426b81dcf295239ec9af [id=b7130fcdfcf54b76861fd9c87559beeb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.937601 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8a99e35fd2274affb747df98a59aa265" } new_table_name: "default.Table_fbd2d824d17949508201413ec47a331f" modify_external_catalogs: true
I20260810 13:53:59.940119 13018 tablet_service.cc:1511] Processing CreateTablet for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (DEFAULT_TABLE table=default.Table_8394a311b0bd4203bbb0ec788da4e245 [id=8002eabb2979433ab1c98eafdbe23470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.942196 13227 tablet_service.cc:1511] Processing CreateTablet for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (DEFAULT_TABLE table=default.Table_8394a311b0bd4203bbb0ec788da4e245 [id=8002eabb2979433ab1c98eafdbe23470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.961470 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:59.971900 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:59.973261 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:59.975883 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5ad84fe2604dd2959768db31f66e7c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:53:59.976677 13049 raft_consensus.cc:2468] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:53:59.981663 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 45530faa785a4642b4efc18733d0d9b1 (DEFAULT_TABLE table=default.Table_8eeb870902124e9696cfa7e98dfa0e88 [id=614fbd4b5dd440cb8f5a6fa4d994266d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:53:59.982740 13167 leader_election.cc:304] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:53:59.983932 15367 raft_consensus.cc:2804] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:53:59.984797 15367 raft_consensus.cc:493] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:53:59.985409 15367 raft_consensus.cc:3060] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:53:59.989836 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet eb5d7a695c694d1993c2d0c4d3127fca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:36 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:53:59.991083 13638 tablet_bootstrap.cc:492] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:53:59.991468 13638 ts_tablet_manager.cc:1403] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.108s user 0.008s sys 0.004s
W20260810 13:53:59.993883 13167 consensus_peers.cc:597] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 063e3b74a9a248a1aa0c2de4b4b73a06. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:53:59.994679 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de012d382b194bf193fef76779abcf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.996081 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:53:59.995914 13638 raft_consensus.cc:359] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:53:59.996728 13638 raft_consensus.cc:385] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:53:59.997169 13638 raft_consensus.cc:740] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:53:59.997538 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c7a8e941ea433d890fdbea2b754f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:53:59.998420 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:54:00.001504 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.005954 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760914a47cc744b7bdf3b40a85b3369c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.009363 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ec9aba240b49e6a78c268b20dc901b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.011871 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4520d51666b04814814fbaa8b71430fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.009605 15363 raft_consensus.cc:2749] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:53:59.950373 15286 raft_consensus.cc:2749] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:00.020098 13640 tablet_bootstrap.cc:654] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:00.027669 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet c4db9d7e82414cab8a69618effe89b40 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:00.028384 13217 tablet_service.cc:1511] Processing CreateTablet for tablet 45530faa785a4642b4efc18733d0d9b1 (DEFAULT_TABLE table=default.Table_8eeb870902124e9696cfa7e98dfa0e88 [id=614fbd4b5dd440cb8f5a6fa4d994266d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.028950 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 17df06cad1404d96bda5822be6a6e995 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:00.027223 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:54:00.032814 15138 leader_election.cc:290] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:00.038576 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30676a11ab60455aa4ccd22347beb80e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.044548 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45530faa785a4642b4efc18733d0d9b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.047679 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f600e14cc2a64f6bb5cf8d4057ad45b5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:53:59.952538 13474 consensus_meta.cc:287] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.827s user 0.010s sys 0.008s
I20260810 13:53:59.916289 13639 raft_consensus.cc:359] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.064342 13639 raft_consensus.cc:385] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:00.064718 13639 raft_consensus.cc:740] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:00.073410 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 5579f4f12fb9495390d8261d24d120d8 (DEFAULT_TABLE table=default.Table_8a99e35fd2274affb747df98a59aa265 [id=b5552da41a544323a596c1d9715a7224]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.077329 15328 ts_tablet_manager.cc:1929] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:00.080484 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5579f4f12fb9495390d8261d24d120d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.079757 15328 log.cc:1199] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/eb5d7a695c694d1993c2d0c4d3127fca
I20260810 13:54:00.099946 15328 ts_tablet_manager.cc:1950] T eb5d7a695c694d1993c2d0c4d3127fca P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:00.103343 15290 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2928f7d4503145b182d99007d240334d, State: Initialized, Role: FOLLOWER
W20260810 13:54:00.106421 12747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 81) took 1305 ms (client timeout 1000 ms). Trace:
I20260810 13:54:00.118287 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:54:00.119592 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:54:00.120360 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:54:00.105346 15290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:00.132557 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
W20260810 13:54:00.106833 12747 rpcz_store.cc:269] 0810 13:53:58.800870 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.813860 (+ 12990us) service_pool.cc:224] Handling call
0810 13:54:00.106323 (+1292463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:59.619286 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:53:59.619615 (+ 329us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:53:59.619636 (+ 21us) write_op.cc:435] Acquired schema lock
0810 13:53:59.619648 (+ 12us) tablet.cc:662] Decoding operations
0810 13:53:59.619877 (+ 229us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:53:59.619907 (+ 30us) write_op.cc:641] Partition lock acquired for write op
0810 13:53:59.619930 (+ 23us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:53:59.620059 (+ 129us) tablet.cc:701] Row locks acquired
0810 13:53:59.620071 (+ 12us) write_op.cc:260] PREPARE: finished
0810 13:53:59.620160 (+ 89us) write_op.cc:270] Start()
0810 13:53:59.620227 (+ 67us) write_op.cc:276] Timestamp: P: 1786370039620092 usec, L: 0
0810 13:53:59.620241 (+ 14us) op_driver.cc:348] REPLICATION: starting
0810 13:53:59.620629 (+ 388us) log.cc:844] Serialized 527 byte log entry
0810 13:53:59.905204 (+284575us) op_driver.cc:464] REPLICATION: finished
0810 13:53:59.907136 (+ 1932us) write_op.cc:301] APPLY: starting
0810 13:53:59.907182 (+ 46us) tablet.cc:1367] starting BulkCheckPresence
0810 13:53:59.907264 (+ 82us) tablet.cc:1370] finished BulkCheckPresence
0810 13:53:59.907338 (+ 74us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:53:59.907498 (+ 160us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:53:59.907614 (+ 116us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:53:59.907657 (+ 43us) write_op.cc:312] APPLY: finished
0810 13:53:59.907810 (+ 153us) log.cc:844] Serialized 23 byte log entry
0810 13:53:59.907916 (+ 106us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:53:59.907971 (+ 55us) write_op.cc:454] Released schema lock
0810 13:53:59.907998 (+ 27us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":1822,"apply.run_cpu_time_us":1037,"apply.run_wall_time_us":1021,"num_ops":1,"prepare.queue_time_us":8144,"prepare.run_cpu_time_us":1584,"prepare.run_wall_time_us":29670,"replication_time_us":284890}]]}
I20260810 13:54:00.136744 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5d1526181af947a2ae46e8e9e2718688" } modify_external_catalogs: true
I20260810 13:54:00.139473 12750 master_service.cc:960] ReplaceTablet: received request to replace tablet 918edf5d7b4f45009c5d476588399d0c from {username='slave'} at 127.0.0.1:48758
I20260810 13:54:00.142117 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_7e2df1474a324a139e9e31ca581a4f34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:00.143599 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7e2df1474a324a139e9e31ca581a4f34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.150205 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 48a059240c0f48ee958ef728acfcae92
I20260810 13:54:00.058380 13474 raft_consensus.cc:2468] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:00.150902 13474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.12.36.2:50939 (request call id 172) took 1028 ms. Trace:
I20260810 13:54:00.151449 13474 rpcz_store.cc:276] 0810 13:53:59.122788 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.123639 (+ 851us) service_pool.cc:224] Handling call
0810 13:54:00.150808 (+1027169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:00.155622 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5d1526181af947a2ae46e8e9e2718688" } modify_external_catalogs: true
W20260810 13:54:00.176249 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 00a7bce2378f482d81d2ad08e9d15b0c (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 00a7bce2378f482d81d2ad08e9d15b0c consensus state has no leader
I20260810 13:54:00.178345 13470 raft_consensus.cc:2468] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:00.205801 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:54:00.207072 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 5579f4f12fb9495390d8261d24d120d8 (DEFAULT_TABLE table=default.Table_8a99e35fd2274affb747df98a59aa265 [id=b5552da41a544323a596c1d9715a7224]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:00.206878 12740 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd3119d63857480294dcb68ed0451bc0 consensus state has no leader
I20260810 13:54:00.211313 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
W20260810 13:54:00.199622 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5579f4f12fb9495390d8261d24d120d8 consensus state has no leader
I20260810 13:54:00.214884 13638 consensus_queue.cc:260] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.213210 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:54:00.224898 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:54:00.227305 12745 catalog_manager.cc:5719] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:00.236141 13640 tablet_bootstrap.cc:492] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:00.236615 13640 ts_tablet_manager.cc:1403] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.814s user 0.003s sys 0.019s
I20260810 13:54:00.238950 13640 raft_consensus.cc:359] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.239557 13640 raft_consensus.cc:385] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:00.239812 13640 raft_consensus.cc:740] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:00.245692 13417 consensus_meta.cc:287] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.525s user 0.007s sys 0.004s
I20260810 13:54:00.232925 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 5dac7ad18d3c4fb58171ff8ab959d98a
I20260810 13:54:00.251848 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:54:00.253274 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:54:00.240371 13640 consensus_queue.cc:260] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.256716 13640 ts_tablet_manager.cc:1434] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20260810 13:54:00.257195 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
W20260810 13:54:00.260273 12739 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 82) took 1317 ms (client timeout 1000 ms). Trace:
W20260810 13:54:00.263478 12739 rpcz_store.cc:269] 0810 13:53:58.943169 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.951142 (+ 7973us) service_pool.cc:224] Handling call
0810 13:54:00.260207 (+1309065us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":31}
I20260810 13:54:00.268498 12999 tablet_service.cc:1511] Processing CreateTablet for tablet a7fb3f80f940435a902c355cb699b434 (DEFAULT_TABLE table=default.Table_12828de8d2fe4b32bf5d775a9ad9019b [id=63d0afa43b9243c5b7044be3dbcce100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.270228 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fb3f80f940435a902c355cb699b434. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:00.254694 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 334171us
W20260810 13:54:00.273391 13382 leader_election.cc:343] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:00.273764 13382 leader_election.cc:304] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:00.275897 13417 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 387) took 1047 ms. Trace:
I20260810 13:54:00.277065 13417 rpcz_store.cc:276] 0810 13:53:59.228822 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.242422 (+ 13600us) service_pool.cc:224] Handling call
0810 13:53:59.323604 (+ 81182us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:59.323750 (+ 146us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:59.719947 (+396197us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.246286 (+526339us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:00.275842 (+ 29556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:00.279281 15348 ts_tablet_manager.cc:1929] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:00.288744 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 380) took 1235 ms. Trace:
I20260810 13:54:00.289132 15328 rpcz_store.cc:276] 0810 13:53:58.958573 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.977718 (+ 19145us) service_pool.cc:224] Handling call
0810 13:53:59.809279 (+831561us) ts_tablet_manager.cc:1151] Deleting tablet eb5d7a695c694d1993c2d0c4d3127fca
0810 13:53:59.809345 (+ 66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:59.888245 (+ 78900us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.076815 (+188570us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.193835 (+117020us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":830893}
I20260810 13:54:00.290542 15328 tablet_replica.cc:333] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:00.291456 15328 raft_consensus.cc:2243] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:00.292004 15328 raft_consensus.cc:2272] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:00.299290 15328 ts_tablet_manager.cc:1916] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:00.287140 15363 raft_consensus.cc:2749] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:00.288017 13382 leader_election.cc:343] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:00.302986 13382 leader_election.cc:343] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:00.303654 13382 leader_election.cc:304] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:00.304382 15363 raft_consensus.cc:2804] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:00.304832 15363 raft_consensus.cc:697] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:00.305744 15363 consensus_queue.cc:237] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.316368 13121 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:54:00.320838 15348 log.cc:1199] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/f4946f79b54c46b1a59edf169109ab47
W20260810 13:54:00.330525 13382 leader_election.cc:343] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:00.336186 13640 tablet_bootstrap.cc:492] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:00.336781 13424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 388) took 1051 ms. Trace:
I20260810 13:54:00.337352 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 48a059240c0f48ee958ef728acfcae92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:59 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:00.337190 13424 rpcz_store.cc:276] 0810 13:53:59.285208 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.287033 (+ 1825us) service_pool.cc:224] Handling call
0810 13:53:59.326571 (+ 39538us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:59.326781 (+ 210us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:59.820550 (+493769us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.265006 (+444456us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:00.336667 (+ 71661us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:00.338543 13004 tablet_service.cc:1511] Processing CreateTablet for tablet 6453dd9e48244c87b339ec515898bb0c (DEFAULT_TABLE table=default.Table_066011dcc620407a8cd316bb975b735b [id=e4eadf37ae6346738d1b0ca016f03ac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.339759 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 (DEFAULT_TABLE table=default.Table_a6f746f49e7c466b8008dc01f2f390ca [id=94408f08eb8d48a385788825ce3a8309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.343647 13018 tablet_service.cc:1511] Processing CreateTablet for tablet b3bbe54b2ba947a4a8b2d908f44c0db5 (DEFAULT_TABLE table=default.Table_4f02931df6b0437a9cb7869b14b73084 [id=b8289db1d29241f3815ff2da32fcfc1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.351310 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_50a288b03da74905ac5286346bd7df20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:00.351682 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:00.352725 13472 raft_consensus.cc:2468] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:00.354404 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_86221744224e4ac4aeebf77dbd274d49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:00.354995 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dac7ad18d3c4fb58171ff8ab959d98a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:54:00.355953 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_86221744224e4ac4aeebf77dbd274d49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.356745 15348 ts_tablet_manager.cc:1950] T f4946f79b54c46b1a59edf169109ab47 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:00.359180 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a0e9339c31fa470380def2ad49326176"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:00.361127 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_57a088306e614a01aa3e18ad8ab5c91c" } modify_external_catalogs: true
I20260810 13:54:00.361626 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_57a088306e614a01aa3e18ad8ab5c91c" } modify_external_catalogs: true
W20260810 13:54:00.364856 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a0e9339c31fa470380def2ad49326176 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.366418 15381 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:00.367707 15381 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: This master's current role is: FOLLOWER
W20260810 13:54:00.368995 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_50a288b03da74905ac5286346bd7df20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.369378 13428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 394) took 1067 ms. Trace:
I20260810 13:54:00.370000 13428 rpcz_store.cc:276] 0810 13:53:59.302296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.304778 (+ 2482us) service_pool.cc:224] Handling call
0810 13:53:59.306211 (+ 1433us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:59.306316 (+ 105us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.199247 (+892931us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.333478 (+134231us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:00.369284 (+ 35806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:00.377013 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 11e3902adc094227830cf6ddab916916 (DEFAULT_TABLE table=default.Table_e29a3f5b330e407d9a9e94706d641719 [id=4e31d56e9adc4ed597fbb9254d0e10ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.382405 13014 tablet_service.cc:1511] Processing CreateTablet for tablet afe75b90aa5548d8a6c35cf6db42bb25 (DEFAULT_TABLE table=default.Table_3abcbf71e2004a07888fe131143e8e76 [id=ab67527f31ce42d7a92bb0cba8f69ff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.382872 13011 tablet_service.cc:1511] Processing CreateTablet for tablet a4159387c6364989bc5f8bfef7f8458c (DEFAULT_TABLE table=default.Table_e9c73c2f54b54ea485cdcadc15b0a420 [id=41772225716845f794c8c7d1ab21fd32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.383500 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (DEFAULT_TABLE table=default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.385497 13019 tablet_service.cc:1511] Processing CreateTablet for tablet e30f03b6b326429eab7227616059a0db (DEFAULT_TABLE table=default.Table_d171e1a65676495882912f18dddff2ee [id=4f6c1859cd1a481da7b9b3c2013365c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.387876 15290 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 13:54:00.398013 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5ad84fe2604dd2959768db31f66e7c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:00.409143 13472 raft_consensus.cc:2468] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:00.413429 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6893b0b32646f6aeb72c866251a112 (DEFAULT_TABLE table=default.Table_13af97840a5a4e1cb52df81dc991d50c [id=a761f711b12d46aaa840be661183bf4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.413981 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_df442195c83b420ea736308ced6e4594" } new_table_name: "default.Table_76e484f1a993422f9e6916f20d5cab02" modify_external_catalogs: true
I20260810 13:54:00.418766 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_23f1932076424658b335360b8c388398" } new_table_name: "default.Table_c4a8958ee94a4a98b584204430a9546d" modify_external_catalogs: true
I20260810 13:54:00.421257 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet eb5d7a695c694d1993c2d0c4d3127fca (table default.Table_11e70bf5f071476d8ba0b19c299040e5 [id=b11aa3e242c34bc79d6ccc2d2dcfcda2]) successfully deleted
I20260810 13:54:00.412606 13640 tablet_bootstrap.cc:654] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:00.431336 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:54:00.416124 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 386) took 1219 ms. Trace:
I20260810 13:54:00.433857 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet cab5c35fa6b440a7bc4ebe2709fbfc60
I20260810 13:54:00.250320 13639 consensus_queue.cc:260] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.439695 15344 raft_consensus.cc:493] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:00.440171 15344 raft_consensus.cc:515] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.439920 15348 rpcz_store.cc:276] 0810 13:53:59.222353 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.222484 (+ 131us) service_pool.cc:224] Handling call
0810 13:53:59.391439 (+168955us) ts_tablet_manager.cc:1151] Deleting tablet f4946f79b54c46b1a59edf169109ab47
0810 13:53:59.391487 (+ 48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:00.200811 (+809324us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.279144 (+ 78333us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.416058 (+136914us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":168349,"thread_start_us":129539,"threads_started":1}
I20260810 13:54:00.441823 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 390) took 1140 ms. Trace:
I20260810 13:54:00.442157 15348 rpcz_store.cc:276] 0810 13:53:59.301241 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.301376 (+ 135us) service_pool.cc:224] Handling call
0810 13:54:00.441420 (+1140044us) ts_tablet_manager.cc:1151] Deleting tablet c793dedc5e714fe6bd36e507695e82d0
0810 13:54:00.441471 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:00.441761 (+ 290us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139418}
I20260810 13:54:00.443439 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 391) took 1141 ms. Trace:
I20260810 13:54:00.444588 13040 raft_consensus.cc:2468] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:00.444093 15344 leader_election.cc:290] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:00.454252 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2416e07beb8d42a6a48de9dab42936cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:00.456111 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2416e07beb8d42a6a48de9dab42936cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.457267 13639 ts_tablet_manager.cc:1434] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.667s user 0.008s sys 0.000s
I20260810 13:54:00.459249 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a6f746f49e7c466b8008dc01f2f390ca" } modify_external_catalogs: true
I20260810 13:54:00.459899 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_a6f746f49e7c466b8008dc01f2f390ca" } modify_external_catalogs: true
I20260810 13:54:00.477358 13640 tablet_bootstrap.cc:492] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:00.481918 13640 ts_tablet_manager.cc:1403] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.146s user 0.013s sys 0.003s
I20260810 13:54:00.444036 15348 rpcz_store.cc:276] 0810 13:53:59.301520 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.303633 (+ 2113us) service_pool.cc:224] Handling call
0810 13:54:00.443050 (+1139417us) ts_tablet_manager.cc:1151] Deleting tablet 53a99165463a43c78f4ccb6c5892f4b1
0810 13:54:00.443096 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:00.443341 (+ 245us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1138882}
I20260810 13:54:00.486286 15348 tablet_replica.cc:333] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:00.488191 15348 raft_consensus.cc:2243] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 13:54:00.493609 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a43ea90fc236424489a4981c32087d81 consensus state has no leader
I20260810 13:54:00.514328 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5579f4f12fb9495390d8261d24d120d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.515544 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f600e14cc2a64f6bb5cf8d4057ad45b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.516882 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30676a11ab60455aa4ccd22347beb80e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.518286 15381 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:00.518846 15381 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:00.522292 15381 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:00.536024 13432 tablet_service.cc:1511] Processing CreateTablet for tablet 4520d51666b04814814fbaa8b71430fc (DEFAULT_TABLE table=default.Table_d9a82635a9fc49d9943077eb2387dddb [id=3ee39e801f0245a8b38bd2c44ee239cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.494884 13424 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a6893b0b32646f6aeb72c866251a112 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:58 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:00.537202 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4520d51666b04814814fbaa8b71430fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.538007 13434 tablet_service.cc:1511] Processing CreateTablet for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 (DEFAULT_TABLE table=default.Table_d4ada59acb684b27b742fb4abba2fccf [id=70dc47e225894242b54466f69cd37bde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.539160 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.540264 13435 tablet_service.cc:1511] Processing CreateTablet for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (DEFAULT_TABLE table=default.Table_8394a311b0bd4203bbb0ec788da4e245 [id=8002eabb2979433ab1c98eafdbe23470]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.541455 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f600e14cc2a64f6bb5cf8d4057ad45b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.542407 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 45530faa785a4642b4efc18733d0d9b1 (DEFAULT_TABLE table=default.Table_8eeb870902124e9696cfa7e98dfa0e88 [id=614fbd4b5dd440cb8f5a6fa4d994266d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.543385 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45530faa785a4642b4efc18733d0d9b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.545678 13424 tablet_service.cc:1511] Processing CreateTablet for tablet a7fb3f80f940435a902c355cb699b434 (DEFAULT_TABLE table=default.Table_12828de8d2fe4b32bf5d775a9ad9019b [id=63d0afa43b9243c5b7044be3dbcce100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.546729 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fb3f80f940435a902c355cb699b434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.496025 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 452978fbf3b74e3c9b16756b9f394be7 with delete_type TABLET_DATA_DELETED (replaced by tablet 01d42c8476514b71af3ce2fbc12270d0) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:00.496449 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:59 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:00.499358 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 39514e069d6841df9fced9e62981eac5 (DEFAULT_TABLE table=default.Table_f6d23e8eec824ef08b26dec8c7c6d010 [id=4d373c8f174b46e99209a83ab947b204]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:00.541417 15369 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s user 0.027s sys 0.030s
W20260810 13:54:00.552410 15369 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s user 0.028s sys 0.030s
I20260810 13:54:00.553709 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45530faa785a4642b4efc18733d0d9b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:00.576778 15367 consensus_meta.cc:287] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb: Time spent flushing consensus metadata: real 0.575s user 0.005s sys 0.005s
I20260810 13:54:00.577430 15367 raft_consensus.cc:515] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.587638 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2
I20260810 13:54:00.609753 15367 leader_election.cc:290] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:00.621614 13213 tablet_service.cc:1511] Processing CreateTablet for tablet a7fb3f80f940435a902c355cb699b434 (DEFAULT_TABLE table=default.Table_12828de8d2fe4b32bf5d775a9ad9019b [id=63d0afa43b9243c5b7044be3dbcce100]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.623224 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6893b0b32646f6aeb72c866251a112 (DEFAULT_TABLE table=default.Table_13af97840a5a4e1cb52df81dc991d50c [id=a761f711b12d46aaa840be661183bf4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.628485 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7fb3f80f940435a902c355cb699b434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.629140 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6893b0b32646f6aeb72c866251a112. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:00.633468 13164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s user 0.000s sys 0.041s
W20260810 13:54:00.634402 13164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s user 0.000s sys 0.041s
I20260810 13:54:00.640251 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_0b822e65634b4fa6bbd83563bb9227dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:00.641939 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b822e65634b4fa6bbd83563bb9227dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.542847 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.648938 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe75b90aa5548d8a6c35cf6db42bb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.649873 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30f03b6b326429eab7227616059a0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.650539 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4159387c6364989bc5f8bfef7f8458c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.651191 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2def1317e7bc4c5eae5c93264da6d3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.651170 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:54:00.651783 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6453dd9e48244c87b339ec515898bb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.652063 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 73ad47d29d61456891478a9544594a94 (table default.Table_453ba61c4fad4f2e99635628e3dc94b9 [id=41ab72dabf7e4cbaaa1c8010766780c4]). Expected version 2 got 0
I20260810 13:54:00.652428 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bbe54b2ba947a4a8b2d908f44c0db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.653163 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e3902adc094227830cf6ddab916916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.653383 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]). Expected version 2 got 0
I20260810 13:54:00.653796 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6893b0b32646f6aeb72c866251a112. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:00.657475 13639 ts_tablet_manager.cc:1467] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3: Tablet startup took 866ms
I20260810 13:54:00.658855 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet ce9243eda3974532aff0425885f54166 with delete_type TABLET_DATA_DELETED (replaced by tablet f19e7aa805bd417eae45fb43ac18a66d) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:00.659332 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6893b0b32646f6aeb72c866251a112 (DEFAULT_TABLE table=default.Table_13af97840a5a4e1cb52df81dc991d50c [id=a761f711b12d46aaa840be661183bf4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.659637 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dac7ad18d3c4fb58171ff8ab959d98a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:00.660490 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6893b0b32646f6aeb72c866251a112. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:00.664600 12954 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:00.666075 13638 ts_tablet_manager.cc:1434] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.674s user 0.006s sys 0.012s
I20260810 13:54:00.666039 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 30676a11ab60455aa4ccd22347beb80e (DEFAULT_TABLE table=default.Table_d8ab37a103a5426b81dcf295239ec9af [id=b7130fcdfcf54b76861fd9c87559beeb]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:00.666436 13638 ts_tablet_manager.cc:1467] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: Tablet startup took 674ms
I20260810 13:54:00.667212 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30676a11ab60455aa4ccd22347beb80e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.671026 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 5579f4f12fb9495390d8261d24d120d8 (DEFAULT_TABLE table=default.Table_8a99e35fd2274affb747df98a59aa265 [id=b5552da41a544323a596c1d9715a7224]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.670950 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:00.672029 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5579f4f12fb9495390d8261d24d120d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.672857 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet 48a059240c0f48ee958ef728acfcae92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:59 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:00.673667 15348 raft_consensus.cc:2272] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:00.678026 13216 tablet_service.cc:1558] Processing DeleteTablet for tablet 48a059240c0f48ee958ef728acfcae92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:59 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:00.680238 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 6453dd9e48244c87b339ec515898bb0c (DEFAULT_TABLE table=default.Table_066011dcc620407a8cd316bb975b735b [id=e4eadf37ae6346738d1b0ca016f03ac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.681356 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]). Expected version 1 got 0
I20260810 13:54:00.682003 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6453dd9e48244c87b339ec515898bb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.682466 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:54:00.683225 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:54:00.683956 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
W20260810 13:54:00.689472 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2e5ad84fe2604dd2959768db31f66e7c consensus state has no leader
I20260810 13:54:00.691859 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e9b13b3af4bb489f8772f0fdd67e5dab" } modify_external_catalogs: true
I20260810 13:54:00.692361 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e9b13b3af4bb489f8772f0fdd67e5dab" } modify_external_catalogs: true
W20260810 13:54:00.658146 13639 ts_tablet_manager.cc:1469] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3: Trace:
0810 13:53:36.030137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:36.030294 (+ 157us) service_pool.cc:224] Handling call
0810 13:53:36.031651 (+ 1357us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:36.031725 (+ 74us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:36.160962 (+129237us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.166938 (+ 5976us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:36.167294 (+ 356us) inbound_call.cc:177] Queueing success response
0810 13:53:59.499075 (+23331781us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:53:59.790695 (+291620us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:53:59.791594 (+ 899us) tablet_replica.cc:261] Starting instrumentation
0810 13:53:59.914311 (+122717us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":4321,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":1069,"tablet-open.queue_time_us":23331811}
I20260810 13:54:00.705195 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee27d158bd40425a8c6fa8cb068daa79" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:00.723946 12742 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 506c80d95eb84a68b19f565338a48329
W20260810 13:54:00.725621 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 107169us
I20260810 13:54:00.726819 15367 raft_consensus.cc:493] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:00.727524 15367 raft_consensus.cc:515] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.728298 13164 leader_election.cc:304] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:00.730482 15367 leader_election.cc:290] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:00.730391 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:00.731722 15063 raft_consensus.cc:2804] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:00.732149 15063 raft_consensus.cc:493] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:00.732089 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee27d158bd40425a8c6fa8cb068daa79" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:00.732374 15367 consensus_queue.cc:1048] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:00.675797 13436 tablet_service.cc:1511] Processing CreateTablet for tablet 760914a47cc744b7bdf3b40a85b3369c (DEFAULT_TABLE table=default.Table_7cbcdca887724284a33c681c9574ea82 [id=8a8a45a7ac264648b3810d9c69a36751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.735041 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9eaa998ba18d4f539d5f28362896f421" } new_table_name: "default.Table_5d23780a98384a6e9889134a379e4570" modify_external_catalogs: true
I20260810 13:54:00.736632 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_dfe0fd41b106448e8a729e593ac63e5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:00.740376 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfe0fd41b106448e8a729e593ac63e5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.732666 15063 raft_consensus.cc:3060] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:00.741304 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c640dce5dd4fc8a49f07fb983c50eb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:00.754149 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 (DEFAULT_TABLE table=default.Table_a6f746f49e7c466b8008dc01f2f390ca [id=94408f08eb8d48a385788825ce3a8309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.754271 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet 5dac7ad18d3c4fb58171ff8ab959d98a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:00.755714 13236 tablet_service.cc:1511] Processing CreateTablet for tablet b3bbe54b2ba947a4a8b2d908f44c0db5 (DEFAULT_TABLE table=default.Table_4f02931df6b0437a9cb7869b14b73084 [id=b8289db1d29241f3815ff2da32fcfc1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.757177 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 11e3902adc094227830cf6ddab916916 (DEFAULT_TABLE table=default.Table_e29a3f5b330e407d9a9e94706d641719 [id=4e31d56e9adc4ed597fbb9254d0e10ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.758960 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (DEFAULT_TABLE table=default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.760964 13215 tablet_service.cc:1511] Processing CreateTablet for tablet afe75b90aa5548d8a6c35cf6db42bb25 (DEFAULT_TABLE table=default.Table_3abcbf71e2004a07888fe131143e8e76 [id=ab67527f31ce42d7a92bb0cba8f69ff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.763093 13210 tablet_service.cc:1511] Processing CreateTablet for tablet a4159387c6364989bc5f8bfef7f8458c (DEFAULT_TABLE table=default.Table_e9c73c2f54b54ea485cdcadc15b0a420 [id=41772225716845f794c8c7d1ab21fd32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.775390 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c640dce5dd4fc8a49f07fb983c50eb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:00.777074 15390 raft_consensus.cc:493] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:00.777789 15390 raft_consensus.cc:515] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.781258 15390 leader_election.cc:290] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:00.784024 15380 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:00.795017 12749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_93d8d5188346467fa9b67f276a3fabe3" } modify_external_catalogs: true
I20260810 13:54:00.795498 12749 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_93d8d5188346467fa9b67f276a3fabe3" } modify_external_catalogs: true
I20260810 13:54:00.795123 15380 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:00.797379 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4a451ed74dd140d8a587dbf01c988da5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:00.798454 15380 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:00.798801 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a451ed74dd140d8a587dbf01c988da5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.626565 15321 ts_tablet_manager.cc:1929] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:00.799714 15321 log.cc:1199] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/4dea61b84b614ead8830873568f9b7c4
I20260810 13:54:00.800737 15321 ts_tablet_manager.cc:1950] T 4dea61b84b614ead8830873568f9b7c4 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:00.788229 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:00.794526 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bbe54b2ba947a4a8b2d908f44c0db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.802249 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe75b90aa5548d8a6c35cf6db42bb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.803085 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e3902adc094227830cf6ddab916916. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.805120 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4159387c6364989bc5f8bfef7f8458c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.809931 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2def1317e7bc4c5eae5c93264da6d3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.825152 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.785777 15063 raft_consensus.cc:515] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.833658 13259 raft_consensus.cc:2393] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
W20260810 13:54:00.666837 13638 ts_tablet_manager.cc:1469] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: Trace:
0810 13:53:36.586047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:36.588781 (+ 2734us) service_pool.cc:224] Handling call
0810 13:53:36.590015 (+ 1234us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:36.590101 (+ 86us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:36.663520 (+ 73419us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:36.901254 (+237734us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:36.901779 (+ 525us) inbound_call.cc:177] Queueing success response
0810 13:53:59.883263 (+22981484us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:53:59.991706 (+108443us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:53:59.993266 (+ 1560us) tablet_replica.cc:261] Starting instrumentation
0810 13:53:59.994193 (+ 927us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":332773,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":10250,"tablet-open.queue_time_us":22981673,"thread_start_us":399979,"threads_started":1}
I20260810 13:54:00.835141 13638 tablet_bootstrap.cc:492] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:00.835911 13442 tablet_service.cc:1511] Processing CreateTablet for tablet b3bbe54b2ba947a4a8b2d908f44c0db5 (DEFAULT_TABLE table=default.Table_4f02931df6b0437a9cb7869b14b73084 [id=b8289db1d29241f3815ff2da32fcfc1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.837085 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3bbe54b2ba947a4a8b2d908f44c0db5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.837117 15063 leader_election.cc:290] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:00.849707 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39514e069d6841df9fced9e62981eac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.729547 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 (DEFAULT_TABLE table=default.Table_a6f746f49e7c466b8008dc01f2f390ca [id=94408f08eb8d48a385788825ce3a8309]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.851121 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.853037 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760914a47cc744b7bdf3b40a85b3369c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.853119 15402 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:00.858742 15348 ts_tablet_manager.cc:1916] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:00.865342 13428 tablet_service.cc:1511] Processing CreateTablet for tablet 006c7409946a4122a95468288ed3aef0 (DEFAULT_TABLE table=default.Table_2822dc6c838f40929cbe086ba80014db [id=4382337c7dcd4747b3e6abb01c288085]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.867230 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 006c7409946a4122a95468288ed3aef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.869957 13427 tablet_service.cc:1511] Processing CreateTablet for tablet 6453dd9e48244c87b339ec515898bb0c (DEFAULT_TABLE table=default.Table_066011dcc620407a8cd316bb975b735b [id=e4eadf37ae6346738d1b0ca016f03ac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.872236 13427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6453dd9e48244c87b339ec515898bb0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:00.882560 15063 raft_consensus.cc:493] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:00.883613 15063 raft_consensus.cc:515] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:00.887358 13640 raft_consensus.cc:359] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.888233 13640 raft_consensus.cc:385] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:00.888527 13640 raft_consensus.cc:740] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:00.889258 13640 consensus_queue.cc:260] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:00.889389 15063 leader_election.cc:290] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:00.890995 13640 ts_tablet_manager.cc:1434] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.407s user 0.006s sys 0.001s
I20260810 13:54:00.890561 15402 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:00.902702 13009 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 393) took 1031 ms. Trace:
I20260810 13:54:00.903699 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 373) took 2120 ms. Trace:
I20260810 13:54:00.904356 15321 rpcz_store.cc:276] 0810 13:53:58.783156 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.789226 (+ 6070us) service_pool.cc:224] Handling call
0810 13:53:59.852829 (+1063603us) ts_tablet_manager.cc:1151] Deleting tablet 4dea61b84b614ead8830873568f9b7c4
0810 13:53:59.852874 (+ 45us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:53:59.960748 (+107874us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.626361 (+665613us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.903533 (+277172us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1059875}
I20260810 13:54:00.906991 15321 tablet_replica.cc:333] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:00.908582 13639 tablet_bootstrap.cc:492] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:00.920562 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_de6ec143f22d4a129657021013e42fb8" } new_table_name: "default.Table_c76b1dec93c74830b7a89900defb8cb7" modify_external_catalogs: true
I20260810 13:54:00.923524 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_dd910306a7864aeb9230c62730dc3ff4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:00.925177 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd910306a7864aeb9230c62730dc3ff4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.913599 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet ef59f7013ab4489dadd9084d065533a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57fc6408d6664e9887b150d1cb934a8d) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:00.929001 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 11e3902adc094227830cf6ddab916916 (DEFAULT_TABLE table=default.Table_e29a3f5b330e407d9a9e94706d641719 [id=4e31d56e9adc4ed597fbb9254d0e10ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.929710 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8b694afed3584daaa326e8817c01b2da" } modify_external_catalogs: true
I20260810 13:54:00.930177 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8b694afed3584daaa326e8817c01b2da" } modify_external_catalogs: true
I20260810 13:54:00.931643 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 6406062bb0934eadae901502806178b5
I20260810 13:54:00.933424 13420 tablet_service.cc:1511] Processing CreateTablet for tablet a4159387c6364989bc5f8bfef7f8458c (DEFAULT_TABLE table=default.Table_e9c73c2f54b54ea485cdcadc15b0a420 [id=41772225716845f794c8c7d1ab21fd32]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:00.933849 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a17d73c65f544b7c8566fd874ee87a25 consensus state has no leader
I20260810 13:54:00.903343 13009 rpcz_store.cc:276] 0810 13:53:59.871395 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.871613 (+ 218us) service_pool.cc:224] Handling call
0810 13:54:00.004748 (+133135us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.005028 (+ 280us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.288015 (+282987us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.694023 (+406008us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:00.902592 (+208569us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:00.936854 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_8e6c5eec20c54d91b4021f43b8783007 [id=685e6bce7ba5467693e2b0e1c739897b]). Expected version 1 got 0
I20260810 13:54:00.938858 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d028580c0c154a01a3d21e5c767d23eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:00.940289 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d028580c0c154a01a3d21e5c767d23eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.892233 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 67ec9aba240b49e6a78c268b20dc901b (DEFAULT_TABLE table=default.Table_32a20912aef145aabc1b19b2b796c682 [id=6180bc58d52049fa82f92dc5e5a6b891]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:00.949009 13008 consensus_meta.cc:287] T 45530faa785a4642b4efc18733d0d9b1 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.853s user 0.010s sys 0.001s
I20260810 13:54:00.954368 15390 raft_consensus.cc:493] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
W20260810 13:54:00.947410 13382 leader_election.cc:343] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:00.954936 13382 leader_election.cc:304] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:00.955049 15390 raft_consensus.cc:515] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:00.957020 15390 leader_election.cc:290] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:00.963408 12742 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:54:00.979172 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c752da6252ce4541be9cef2bce47bfe3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:00.980631 13382 leader_election.cc:343] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:00.981029 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c752da6252ce4541be9cef2bce47bfe3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:00.981074 13382 leader_election.cc:304] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:00.993889 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:01.010864 13221 tablet_service.cc:1511] Processing CreateTablet for tablet e30f03b6b326429eab7227616059a0db (DEFAULT_TABLE table=default.Table_d171e1a65676495882912f18dddff2ee [id=4f6c1859cd1a481da7b9b3c2013365c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.012615 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30f03b6b326429eab7227616059a0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.038936 13215 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc9bef2781f4046a30c5394fc5d5529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:40 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:01.040467 13640 tablet_bootstrap.cc:492] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:00.945070 13474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s user 0.006s sys 0.004s
W20260810 13:54:01.075328 13474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s user 0.006s sys 0.004s
I20260810 13:54:01.077318 15286 raft_consensus.cc:2749] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:01.078760 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11e3902adc094227830cf6ddab916916. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:01.080832 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad6a373308fa4b039e8331d9a0a90d16 consensus state has no leader
I20260810 13:54:01.081334 15063 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:01.082142 15063 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:01.086246 15063 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:01.091475 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:54:01.100829 15321 raft_consensus.cc:2243] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:01.101979 15321 raft_consensus.cc:2272] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:01.105396 15321 ts_tablet_manager.cc:1916] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:01.107232 13215 tablet_service.cc:1558] Processing DeleteTablet for tablet 69a3a4d2724b42da83a523e208b5714b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:01.107865 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet cab5c35fa6b440a7bc4ebe2709fbfc60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:01.109416 13210 tablet_service.cc:1511] Processing CreateTablet for tablet 7800f588f3d64230b759c8814d169dbe (DEFAULT_TABLE table=default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 [id=3fa9cd2a62034a4d81a0b740d5c31447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.109452 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 57fc6408d6664e9887b150d1cb934a8d (DEFAULT_TABLE table=default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.111464 13215 tablet_service.cc:1511] Processing CreateTablet for tablet 97127b08237c4d2e81f9966db12d3fdb (DEFAULT_TABLE table=default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.114537 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 674599456f9a49dc98d8d089c166ca89
I20260810 13:54:01.114400 13209 tablet_service.cc:1511] Processing CreateTablet for tablet b0f98604d43049ac9b2befe5041a2bda (DEFAULT_TABLE table=default.Table_acc827f97bb244f59d2eed071cc9bd55 [id=7b4d23c35bc14f8598821f2838a18148]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.121896 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:01.125123 13434 tablet_service.cc:1511] Processing CreateTablet for tablet afe75b90aa5548d8a6c35cf6db42bb25 (DEFAULT_TABLE table=default.Table_3abcbf71e2004a07888fe131143e8e76 [id=ab67527f31ce42d7a92bb0cba8f69ff6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.125371 15135 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:01.126797 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afe75b90aa5548d8a6c35cf6db42bb25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.131349 13435 tablet_service.cc:1511] Processing CreateTablet for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (DEFAULT_TABLE table=default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.142167 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_be306c3fb9ed4777b1f296aac4b5ae63" } new_table_name: "default.Table_c4151a7b51d1422a91db569721e57895" modify_external_catalogs: true
I20260810 13:54:01.142324 12739 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f681c78b940441a29062623de79e8420" } modify_external_catalogs: true
I20260810 13:54:01.142905 12739 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f681c78b940441a29062623de79e8420" } modify_external_catalogs: true
I20260810 13:54:01.133033 13432 tablet_service.cc:1511] Processing CreateTablet for tablet e30f03b6b326429eab7227616059a0db (DEFAULT_TABLE table=default.Table_d171e1a65676495882912f18dddff2ee [id=4f6c1859cd1a481da7b9b3c2013365c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:00.967186 15363 raft_consensus.cc:2749] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:01.152664 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d3680fc81fed4821bc9a2eccc77c35d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:01.154096 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3680fc81fed4821bc9a2eccc77c35d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:01.166894 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5ad84fe2604dd2959768db31f66e7c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:01.167426 13049 raft_consensus.cc:3060] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:01.169896 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:01.170388 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:01.172108 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:01.177522 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:01.178857 15135 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 53722.7us
I20260810 13:54:01.180168 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 73c03f98d7804d22acbba72da63c121b (DEFAULT_TABLE table=default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:01.180724 13387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s user 0.007s sys 0.000s
I20260810 13:54:01.182193 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet 6406062bb0934eadae901502806178b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:01.182310 13387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.231s user 0.007s sys 0.001s
I20260810 13:54:01.182621 13229 tablet_service.cc:1558] Processing DeleteTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 with delete_type TABLET_DATA_DELETED (replaced by tablet 97015b4984c74a4682b6dedd47dc6650) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:01.183264 13239 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 390) took 1292 ms. Trace:
I20260810 13:54:01.183666 13239 rpcz_store.cc:276] 0810 13:53:59.890489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.897986 (+ 7497us) service_pool.cc:224] Handling call
0810 13:54:00.510719 (+612733us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a684c 00007f91179a640b 00007f91208eafb9 00007f911fb2c640 00007f911fc11641 00007f911fbee8d3 00007f911fb9d210 00007f911e129bf4 00007f911e129b82 00007f911e129ab1
0810 13:54:00.516374 (+ 5655us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.516472 (+ 98us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.668535 (+152063us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:00.767152 (+ 98617us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.183211 (+416059us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333998848}
I20260810 13:54:01.184127 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 7800f588f3d64230b759c8814d169dbe (DEFAULT_TABLE table=default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 [id=3fa9cd2a62034a4d81a0b740d5c31447]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:01.193219 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 212609us
I20260810 13:54:01.198066 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:01.199357 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ad6a373308fa4b039e8331d9a0a90d16 consensus state has no leader
I20260810 13:54:01.199733 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7fb49228fa4a0c8d28a4ed0a4ae180 (DEFAULT_TABLE table=default.Table_2ca2243ef2fe4479bb1edec0046866b9 [id=d9cc836fbee549a08553ed113e483bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.193146 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4159387c6364989bc5f8bfef7f8458c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.201017 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:01.203887 12999 tablet_service.cc:1511] Processing CreateTablet for tablet 7800f588f3d64230b759c8814d169dbe (DEFAULT_TABLE table=default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 [id=3fa9cd2a62034a4d81a0b740d5c31447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.204903 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet cab5c35fa6b440a7bc4ebe2709fbfc60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:01.205317 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7800f588f3d64230b759c8814d169dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.207669 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f98604d43049ac9b2befe5041a2bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.208253 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fc6408d6664e9887b150d1cb934a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.208879 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97127b08237c4d2e81f9966db12d3fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.196276 13417 tablet_service.cc:1511] Processing CreateTablet for tablet ac27a168faad4542967097f909ce3997 (DEFAULT_TABLE table=default.Table_b392780f45ab4b899ddb12eefbcdd556 [id=0a7b7ff4685e4a8884b4aab7a835890d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.210541 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c03f98d7804d22acbba72da63c121b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.210232 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 97127b08237c4d2e81f9966db12d3fdb (DEFAULT_TABLE table=default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.196440 13426 tablet_service.cc:1511] Processing CreateTablet for tablet 83c7a8e941ea433d890fdbea2b754f22 (DEFAULT_TABLE table=default.Table_253b7e39c5104cbf95380f1adce4c89c [id=0eb0b4069592419abf43b72e6c4df751]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.212603 13003 tablet_service.cc:1511] Processing CreateTablet for tablet b0f98604d43049ac9b2befe5041a2bda (DEFAULT_TABLE table=default.Table_acc827f97bb244f59d2eed071cc9bd55 [id=7b4d23c35bc14f8598821f2838a18148]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.194496 13423 tablet_service.cc:1511] Processing CreateTablet for tablet de012d382b194bf193fef76779abcf17 (DEFAULT_TABLE table=default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.214030 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30f03b6b326429eab7227616059a0db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.215749 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ec9aba240b49e6a78c268b20dc901b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.216475 12998 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7fb49228fa4a0c8d28a4ed0a4ae180 (DEFAULT_TABLE table=default.Table_2ca2243ef2fe4479bb1edec0046866b9 [id=d9cc836fbee549a08553ed113e483bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.219810 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 57fc6408d6664e9887b150d1cb934a8d (DEFAULT_TABLE table=default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.221788 13639 tablet_bootstrap.cc:700] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: Time spent opening tablet: real 0.134s user 0.003s sys 0.000s
I20260810 13:54:01.250172 13639 tablet_bootstrap.cc:654] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:01.198173 15402 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:01.258107 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 73c03f98d7804d22acbba72da63c121b (DEFAULT_TABLE table=default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.261682 13006 tablet_service.cc:1558] Processing DeleteTablet for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:01.262490 13010 tablet_service.cc:1558] Processing DeleteTablet for tablet 6406062bb0934eadae901502806178b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:01.265266 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c03f98d7804d22acbba72da63c121b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.266024 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97127b08237c4d2e81f9966db12d3fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.268049 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f98604d43049ac9b2befe5041a2bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.269732 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 4dea61b84b614ead8830873568f9b7c4 (table default.Table_6b195ecd5f17492f81064d6d53d8fde9 [id=e4c6b90e139246beac835146660eb0ad]) successfully deleted
I20260810 13:54:01.271178 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7800f588f3d64230b759c8814d169dbe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:01.275281 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 81360us
I20260810 13:54:01.276239 13382 leader_election.cc:304] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:01.284842 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_85b411d6527d4231a4934a690459d06d" } new_table_name: "default.Table_45d030548717429993bab4df43ab59a4" modify_external_catalogs: true
I20260810 13:54:01.287519 12997 tablet_service.cc:1558] Processing DeleteTablet for tablet 674599456f9a49dc98d8d089c166ca89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:01.297928 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 674599456f9a49dc98d8d089c166ca89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:01.250154 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:01.302587 13638 tablet_bootstrap.cc:654] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:01.303172 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9d26366e03454a73ae877683e6700ff0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:01.303709 13382 leader_election.cc:343] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:01.304060 13382 leader_election.cc:304] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:01.304711 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d26366e03454a73ae877683e6700ff0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:01.306348 15386 raft_consensus.cc:2749] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:01.304860 15426 raft_consensus.cc:2749] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:01.321460 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_94f6cc658a01407194e9d5858f48d615" } modify_external_catalogs: true
I20260810 13:54:01.322191 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_94f6cc658a01407194e9d5858f48d615" } modify_external_catalogs: true
I20260810 13:54:01.331053 15367 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:01.331504 13227 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 391) took 1405 ms. Trace:
I20260810 13:54:01.331588 15367 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:01.331840 13227 rpcz_store.cc:276] 0810 13:53:59.926539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.926646 (+ 107us) service_pool.cc:224] Handling call
0810 13:54:00.281600 (+354954us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a684c 00007f91179a640b 00007f91208eafb9 00007f911fb2c640 00007f911fc11641 00007f911fbee8d3 00007f911fb9d210 00007f911e129bf4 00007f911e129b82 00007f911e129ab1
0810 13:54:00.514977 (+233377us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.515107 (+ 130us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.876333 (+361226us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.217280 (+340947us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.331049 (+113769us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a6b52 00007f91209141d9 00007f911fb2c4e8 00007f911fbf2783 00007f911fbee51f 00007f911fbeecdd 00007f911fb9d210 00007f911e129bf4 00007f911e129b82
0810 13:54:01.331445 (+ 396us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587212928}
I20260810 13:54:01.333681 15367 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:01.333668 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7fb49228fa4a0c8d28a4ed0a4ae180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.364982 15390 raft_consensus.cc:493] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:01.372854 15390 raft_consensus.cc:515] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:01.374961 15390 leader_election.cc:290] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:01.378070 15348 ts_tablet_manager.cc:1929] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:01.381722 13640 tablet_bootstrap.cc:654] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:01.381687 15348 log.cc:1199] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/ac2c102382734913bffb5436e06fe0a1
I20260810 13:54:01.383121 15348 ts_tablet_manager.cc:1950] T ac2c102382734913bffb5436e06fe0a1 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:01.409533 13217 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 396) took 1382 ms. Trace:
I20260810 13:54:01.425102 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2def1317e7bc4c5eae5c93264da6d3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.459236 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_51b05316075a49bc898ede0e35031c70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:01.461022 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51b05316075a49bc898ede0e35031c70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:01.468216 13004 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 401) took 1128 ms. Trace:
I20260810 13:54:01.469174 13014 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 408) took 1086 ms. Trace:
I20260810 13:54:01.469520 13014 rpcz_store.cc:276] 0810 13:54:00.379658 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.380934 (+ 1276us) service_pool.cc:224] Handling call
0810 13:54:00.397366 (+ 16432us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.397459 (+ 93us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.019683 (+622224us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.462906 (+443223us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.466303 (+ 3397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:01.471565 13018 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 404) took 1132 ms. Trace:
I20260810 13:54:01.471922 13018 rpcz_store.cc:276] 0810 13:54:00.338946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.342862 (+ 3916us) service_pool.cc:224] Handling call
0810 13:54:00.396765 (+ 53903us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.396857 (+ 92us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.021334 (+624477us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.471194 (+449860us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.471517 (+ 323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:01.472802 13019 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 409) took 1092 ms. Trace:
I20260810 13:54:01.473084 13019 rpcz_store.cc:276] 0810 13:54:00.380301 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.383829 (+ 3528us) service_pool.cc:224] Handling call
0810 13:54:00.399034 (+ 15205us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.399097 (+ 63us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.150346 (+751249us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.472251 (+321905us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.472752 (+ 501us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:01.473784 13022 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 405) took 1134 ms. Trace:
W20260810 13:54:01.474212 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 170510us
I20260810 13:54:01.474054 13022 rpcz_store.cc:276] 0810 13:54:00.339438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.376236 (+ 36798us) service_pool.cc:224] Handling call
0810 13:54:00.396968 (+ 20732us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.397074 (+ 106us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.999140 (+602066us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.473367 (+474227us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.473735 (+ 368us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:01.476374 13382 leader_election.cc:343] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:01.476943 13382 leader_election.cc:343] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:01.478498 12739 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet a83ddc3ea3e74b569385b289fe8cf469
W20260810 13:54:01.481796 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3d299c668c444908ccdc2f36873ad24 has no consensus state
I20260810 13:54:01.485692 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7800f588f3d64230b759c8814d169dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.490685 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac27a168faad4542967097f909ce3997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.493287 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet cab5c35fa6b440a7bc4ebe2709fbfc60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:01.493743 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 1a7fb49228fa4a0c8d28a4ed0a4ae180 (DEFAULT_TABLE table=default.Table_2ca2243ef2fe4479bb1edec0046866b9 [id=d9cc836fbee549a08553ed113e483bf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.494253 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 57fc6408d6664e9887b150d1cb934a8d (DEFAULT_TABLE table=default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.494666 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7fb49228fa4a0c8d28a4ed0a4ae180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.495187 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fc6408d6664e9887b150d1cb934a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.440253 15321 ts_tablet_manager.cc:1929] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:01.499547 15321 log.cc:1199] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/ac2c102382734913bffb5436e06fe0a1
I20260810 13:54:01.484241 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet a83ddc3ea3e74b569385b289fe8cf469 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:01.496362 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 97127b08237c4d2e81f9966db12d3fdb (DEFAULT_TABLE table=default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.504094 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 403) took 2196 ms. Trace:
I20260810 13:54:01.504487 15348 rpcz_store.cc:276] 0810 13:53:59.308093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.308274 (+ 181us) service_pool.cc:224] Handling call
0810 13:54:00.486014 (+1177740us) ts_tablet_manager.cc:1151] Deleting tablet ac2c102382734913bffb5436e06fe0a1
0810 13:54:00.486086 (+ 72us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.360172 (+874086us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.377944 (+ 17772us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.504036 (+126092us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121553,"tablet-delete.queue_time_us":1177041}
I20260810 13:54:01.506470 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 407) took 2082 ms. Trace:
I20260810 13:54:01.506914 15348 rpcz_store.cc:276] 0810 13:53:59.423563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.423754 (+ 191us) service_pool.cc:224] Handling call
0810 13:54:01.506004 (+2082250us) ts_tablet_manager.cc:1151] Deleting tablet 063e3b74a9a248a1aa0c2de4b4b73a06
0810 13:54:01.506064 (+ 60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.506397 (+ 333us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2081542}
I20260810 13:54:01.495278 13217 rpcz_store.cc:276] 0810 13:54:00.027364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.027538 (+ 174us) service_pool.cc:224] Handling call
0810 13:54:00.511174 (+483636us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.513386 (+ 2212us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.984195 (+470809us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.408497 (+424302us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.409427 (+ 930us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:01.508934 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 408) took 2085 ms. Trace:
I20260810 13:54:01.518347 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:01.525665 13007 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 402) took 1187 ms. Trace:
I20260810 13:54:01.517364 13445 tablet_service.cc:1511] Processing CreateTablet for tablet b0f98604d43049ac9b2befe5041a2bda (DEFAULT_TABLE table=default.Table_acc827f97bb244f59d2eed071cc9bd55 [id=7b4d23c35bc14f8598821f2838a18148]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.531876 13638 tablet_bootstrap.cc:492] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:01.533871 13021 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 399) took 1197 ms. Trace:
I20260810 13:54:01.534210 13021 rpcz_store.cc:276] 0810 13:54:00.336657 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.408053 (+ 71396us) service_pool.cc:224] Handling call
0810 13:54:00.503386 (+ 95333us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.503508 (+ 122us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.992596 (+489088us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.456293 (+463697us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.533738 (+ 77445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:01.534436 13011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 406) took 1155 ms. Trace:
W20260810 13:54:01.536226 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 58777.3us
I20260810 13:54:01.527609 15321 ts_tablet_manager.cc:1950] T ac2c102382734913bffb5436e06fe0a1 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:01.468565 13004 rpcz_store.cc:276] 0810 13:54:00.337510 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.337872 (+ 362us) service_pool.cc:224] Handling call
0810 13:54:00.396342 (+ 58470us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.396436 (+ 94us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.832400 (+435964us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.301664 (+469264us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.465898 (+164234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:01.543179 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 375) took 2707 ms. Trace:
I20260810 13:54:01.468122 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fc6408d6664e9887b150d1cb934a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.465616 15328 ts_tablet_manager.cc:1929] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:01.553087 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c7a8e941ea433d890fdbea2b754f22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.561030 13424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 434) took 1016 ms. Trace:
W20260810 13:54:01.561617 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1bbee4f9a50342599434a2b05c0740bd consensus state has no leader
I20260810 13:54:01.561373 13424 rpcz_store.cc:276] 0810 13:54:00.544359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.545025 (+ 666us) service_pool.cc:224] Handling call
0810 13:54:00.546307 (+ 1282us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.546387 (+ 80us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.910703 (+364316us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.142880 (+232177us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.560974 (+418094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:01.563138 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de012d382b194bf193fef76779abcf17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.563832 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97127b08237c4d2e81f9966db12d3fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.566303 13436 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 429) took 1030 ms. Trace:
W20260810 13:54:01.566305 13382 leader_election.cc:343] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:01.569917 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet f4946f79b54c46b1a59edf169109ab47 (table default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec]) successfully deleted
W20260810 13:54:01.570850 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 53a99165463a43c78f4ccb6c5892f4b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 53a99165463a43c78f4ccb6c5892f4b1 already in progress: creating tablet
I20260810 13:54:01.576985 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet ac2c102382734913bffb5436e06fe0a1 (table default.Table_bbf02f15a5404f0d95042f20dac5c146 [id=cb4b9877529f4cc38a48b2a61be4aa6c]) successfully deleted
I20260810 13:54:01.582406 15367 consensus_queue.cc:1048] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:01.532577 13638 ts_tablet_manager.cc:1403] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.698s user 0.011s sys 0.006s
I20260810 13:54:01.589663 13638 raft_consensus.cc:359] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:01.590338 13638 raft_consensus.cc:385] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:01.590601 13638 raft_consensus.cc:740] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:01.591296 13551 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:54:01.595749 13638 consensus_queue.cc:260] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:01.602061 12951 leader_election.cc:304] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:01.543752 15321 rpcz_store.cc:276] 0810 13:53:58.835411 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.836057 (+ 646us) service_pool.cc:224] Handling call
0810 13:54:00.906624 (+2070567us) ts_tablet_manager.cc:1151] Deleting tablet ac2c102382734913bffb5436e06fe0a1
0810 13:54:00.906723 (+ 99us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.378065 (+471342us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.440117 (+ 62052us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.543095 (+102978us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192668,"tablet-delete.queue_time_us":2069314}
I20260810 13:54:01.614205 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet ac2c102382734913bffb5436e06fe0a1 (table default.Table_bbf02f15a5404f0d95042f20dac5c146 [id=cb4b9877529f4cc38a48b2a61be4aa6c]) successfully deleted
I20260810 13:54:01.624728 13638 ts_tablet_manager.cc:1434] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.038s user 0.006s sys 0.000s
I20260810 13:54:01.626961 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:01.627700 13037 raft_consensus.cc:3060] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:01.633411 15402 raft_consensus.cc:2749] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:01.593122 15328 log.cc:1199] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/69a3a4d2724b42da83a523e208b5714b
I20260810 13:54:01.641328 15328 ts_tablet_manager.cc:1950] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:01.642362 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 381) took 2523 ms. Trace:
I20260810 13:54:01.642781 15328 rpcz_store.cc:276] 0810 13:53:59.118654 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.119985 (+ 1331us) service_pool.cc:224] Handling call
0810 13:54:00.290360 (+1170375us) ts_tablet_manager.cc:1151] Deleting tablet 69a3a4d2724b42da83a523e208b5714b
0810 13:54:00.290425 (+ 65us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:00.542536 (+252111us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.459983 (+917447us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.642275 (+182292us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1117396}
I20260810 13:54:01.646296 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a7fb49228fa4a0c8d28a4ed0a4ae180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.680941 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f835565354f042368700f4252335e8eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:01.681587 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 386) took 1861 ms. Trace:
I20260810 13:54:01.681941 15328 rpcz_store.cc:276] 0810 13:53:59.783553 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.785338 (+ 1785us) service_pool.cc:224] Handling call
0810 13:54:01.644239 (+1858901us) ts_tablet_manager.cc:1151] Deleting tablet 452978fbf3b74e3c9b16756b9f394be7
0810 13:54:01.644291 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.644658 (+ 367us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1858111}
I20260810 13:54:01.683423 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_344892871be4435d92b2bc22d49a4e6a" } modify_external_catalogs: true
I20260810 13:54:01.683815 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 387) took 1897 ms. Trace:
I20260810 13:54:01.683916 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_344892871be4435d92b2bc22d49a4e6a" } modify_external_catalogs: true
W20260810 13:54:01.684648 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f835565354f042368700f4252335e8eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:01.687916 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_685646f8452341a5ab555e24627f28ec" } new_table_name: "default.Table_544dff9fafd242b687272b507aafbd47" modify_external_catalogs: true
I20260810 13:54:01.691483 15321 tablet_replica.cc:333] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:01.692239 13638 tablet_bootstrap.cc:492] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:01.693081 15321 raft_consensus.cc:2243] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:01.693859 15321 raft_consensus.cc:2272] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:01.707947 13638 tablet_bootstrap.cc:654] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:01.710742 15321 ts_tablet_manager.cc:1916] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:01.566649 13436 rpcz_store.cc:276] 0810 13:54:00.535579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.537549 (+ 1970us) service_pool.cc:224] Handling call
0810 13:54:00.733577 (+196028us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.734149 (+ 572us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.294428 (+560279us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.484525 (+190097us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.566015 (+ 81490us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d521 00007fb87ae4db52 00007fb883dbb1d9 00007fb882fd34e8 00007fb883099783 00007fb88309551f 00007fb883095cdd 00007fb883044210 00007fb8815d0bf4 00007fb8815d0b82
0810 13:54:01.566231 (+ 216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50653,"spinlock_wait_cycles":66770304}
I20260810 13:54:01.723770 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8e7dd076a139448aa4a3761732ba38bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:01.725559 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8e7dd076a139448aa4a3761732ba38bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:01.726619 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 because the tablet was not found. No further retry: Not found: Tablet not found: 063e3b74a9a248a1aa0c2de4b4b73a06
I20260810 13:54:01.640515 13049 raft_consensus.cc:2468] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:01.526252 13007 rpcz_store.cc:276] 0810 13:54:00.337957 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.339153 (+ 1196us) service_pool.cc:224] Handling call
0810 13:54:00.396577 (+ 57424us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.396645 (+ 68us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:00.999144 (+602499us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.466891 (+467747us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.525604 (+ 58713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:01.757244 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet ee27d158bd40425a8c6fa8cb068daa79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:01.684249 15328 rpcz_store.cc:276] 0810 13:53:59.786450 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.787245 (+ 795us) service_pool.cc:224] Handling call
0810 13:54:01.683281 (+1896036us) ts_tablet_manager.cc:1151] Deleting tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4
0810 13:54:01.683349 (+ 68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.683737 (+ 388us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1895487}
I20260810 13:54:01.759624 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 384) took 1976 ms. Trace:
I20260810 13:54:01.760135 15328 rpcz_store.cc:276] 0810 13:53:59.782841 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.788831 (+ 5990us) service_pool.cc:224] Handling call
0810 13:54:01.758897 (+1970066us) ts_tablet_manager.cc:1151] Deleting tablet 0a6893b0b32646f6aeb72c866251a112
0810 13:54:01.759053 (+ 156us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.759555 (+ 502us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1969313}
I20260810 13:54:01.762465 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 400) took 1425 ms. Trace:
I20260810 13:54:01.766865 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ee42df273bce4386bbf8edb282c2059a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:01.535596 13011 rpcz_store.cc:276] 0810 13:54:00.378495 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.382106 (+ 3611us) service_pool.cc:224] Handling call
0810 13:54:00.398705 (+ 16599us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.398820 (+ 115us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.006628 (+607808us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.449135 (+442507us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:01.534266 (+ 85131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:01.776156 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ef6e22114411476e94fe56014112b3f5" } new_table_name: "default.Table_f91581b601a14c6da9ad184fbd2ddbfc" modify_external_catalogs: true
I20260810 13:54:01.783161 13037 raft_consensus.cc:2468] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:01.792567 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_004ad2bd15214f94a0c183ec75f725ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:01.798590 12954 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:01.808179 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 73c03f98d7804d22acbba72da63c121b (DEFAULT_TABLE table=default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:01.809296 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c03f98d7804d22acbba72da63c121b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:01.815411 15425 raft_consensus.cc:493] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:01.815850 15425 raft_consensus.cc:515] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:01.763077 15328 rpcz_store.cc:276] 0810 13:54:00.337100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.337217 (+ 117us) service_pool.cc:224] Handling call
0810 13:54:01.761768 (+1424551us) ts_tablet_manager.cc:1151] Deleting tablet 48a059240c0f48ee958ef728acfcae92
0810 13:54:01.761881 (+ 113us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.762373 (+ 492us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1423937}
I20260810 13:54:01.817700 15425 leader_election.cc:290] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:01.820946 15447 tablet.cc:1724] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:01.822464 15328 tablet_replica.cc:333] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:01.838764 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:01.839509 13472 raft_consensus.cc:2468] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:01.844043 13639 tablet_bootstrap.cc:492] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:01.844504 13639 ts_tablet_manager.cc:1403] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.936s user 0.015s sys 0.013s
W20260810 13:54:01.846755 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 74427ad2017c46cd909973a4b8a83d04 has no consensus state
I20260810 13:54:01.842096 15328 raft_consensus.cc:2243] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:01.849295 15419 raft_consensus.cc:493] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:01.849874 15419 raft_consensus.cc:515] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:01.736896 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:01.851441 15328 raft_consensus.cc:2272] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:01.853945 15367 raft_consensus.cc:493] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:01.854581 15367 raft_consensus.cc:515] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:01.859200 15367 leader_election.cc:290] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:01.860867 13640 tablet_bootstrap.cc:492] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:01.861371 13640 ts_tablet_manager.cc:1403] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.893s user 0.028s sys 0.048s
I20260810 13:54:01.865988 13640 raft_consensus.cc:359] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:01.866684 13640 raft_consensus.cc:385] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:01.867004 13640 raft_consensus.cc:740] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:01.874922 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a27bf786a8274954afc2b2d8cfb34bf0 consensus state has no leader
I20260810 13:54:01.858057 13639 raft_consensus.cc:359] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:01.877087 13639 raft_consensus.cc:385] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:01.880923 13639 raft_consensus.cc:740] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:01.886782 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 419209us
I20260810 13:54:01.888092 12951 leader_election.cc:304] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:01.890493 15328 ts_tablet_manager.cc:1916] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:01.509564 15348 rpcz_store.cc:276] 0810 13:53:59.423909 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.427659 (+ 3750us) service_pool.cc:224] Handling call
0810 13:54:01.508148 (+2080489us) ts_tablet_manager.cc:1151] Deleting tablet 07ff9e8a8ca845b89154ed0626d34c5c
0810 13:54:01.508201 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.508876 (+ 675us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2079825}
I20260810 13:54:01.893178 13639 consensus_queue.cc:260] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:01.906538 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_004ad2bd15214f94a0c183ec75f725ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:01.907006 13382 leader_election.cc:343] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:01.907428 13382 leader_election.cc:304] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:01.910233 15454 raft_consensus.cc:2749] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:01.910912 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee42df273bce4386bbf8edb282c2059a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:01.914014 13382 leader_election.cc:343] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:01.914372 13382 leader_election.cc:304] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:01.916371 15426 raft_consensus.cc:2749] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:01.910441 13639 ts_tablet_manager.cc:1434] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.065s user 0.004s sys 0.006s
I20260810 13:54:01.925709 13639 tablet_bootstrap.cc:492] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:01.932965 15419 leader_election.cc:290] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:01.921448 12951 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:01.935097 15402 raft_consensus.cc:2749] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:01.938246 12951 leader_election.cc:304] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:01.944792 12951 raft_consensus.cc:2686] T 69a3a4d2724b42da83a523e208b5714b P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:54:01.932500 15321 ts_tablet_manager.cc:1929] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:01.950835 15321 log.cc:1199] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/f4946f79b54c46b1a59edf169109ab47
I20260810 13:54:01.960330 12951 leader_election.cc:304] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:54:01.964273 12951 raft_consensus.cc:2686] T 17df06cad1404d96bda5822be6a6e995 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:54:01.967904 15328 ts_tablet_manager.cc:1929] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260810 13:54:01.968284 15328 log.cc:1199] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/5dac7ad18d3c4fb58171ff8ab959d98a
I20260810 13:54:01.969328 15328 ts_tablet_manager.cc:1950] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:54:01.969903 13167 consensus_peers.cc:597] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:01.969594 13640 consensus_queue.cc:260] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:01.975884 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 403) took 1637 ms. Trace:
I20260810 13:54:01.976254 15328 rpcz_store.cc:276] 0810 13:54:00.338414 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.354840 (+ 16426us) service_pool.cc:224] Handling call
0810 13:54:01.821101 (+1466261us) ts_tablet_manager.cc:1151] Deleting tablet 5dac7ad18d3c4fb58171ff8ab959d98a
0810 13:54:01.821602 (+ 501us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.942266 (+120664us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.967779 (+ 25513us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.975800 (+ 8021us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":209,"tablet-delete.queue_time_us":1465033}
I20260810 13:54:01.974027 15321 ts_tablet_manager.cc:1950] T f4946f79b54c46b1a59edf169109ab47 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
W20260810 13:54:01.981886 13167 leader_election.cc:343] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:01.984432 15390 consensus_queue.cc:1048] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:01.986902 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 376) took 3123 ms. Trace:
I20260810 13:54:01.987443 15321 rpcz_store.cc:276] 0810 13:53:58.863826 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.864019 (+ 193us) service_pool.cc:224] Handling call
0810 13:54:01.616192 (+2752173us) ts_tablet_manager.cc:1151] Deleting tablet f4946f79b54c46b1a59edf169109ab47
0810 13:54:01.691298 (+ 75106us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:01.874737 (+183439us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.932286 (+ 57549us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.986840 (+ 54554us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2751115}
I20260810 13:54:02.005765 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 69a3a4d2724b42da83a523e208b5714b (table default.Table_85163b830b37444787dfe92a72503b29 [id=e4f461aca0304a8dba850e8d24b89841]) successfully deleted
W20260810 13:54:02.006565 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 452978fbf3b74e3c9b16756b9f394be7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 452978fbf3b74e3c9b16756b9f394be7 already in progress: creating tablet
W20260810 13:54:02.008774 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 already in progress: creating tablet
W20260810 13:54:02.009894 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 0a6893b0b32646f6aeb72c866251a112 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a6893b0b32646f6aeb72c866251a112 already in progress: creating tablet
W20260810 13:54:02.010897 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 48a059240c0f48ee958ef728acfcae92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48a059240c0f48ee958ef728acfcae92 already in progress: creating tablet
I20260810 13:54:02.013100 15321 tablet_replica.cc:333] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:02.013145 15425 raft_consensus.cc:2749] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:02.015058 15321 raft_consensus.cc:2243] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:02.012457 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet f4946f79b54c46b1a59edf169109ab47 (table default.Table_2c503da47ba34831aa28e953821d301d [id=84fa9b446459413fbc0b1c72e262acec]) successfully deleted
I20260810 13:54:02.015919 15321 raft_consensus.cc:2272] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:02.018863 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 104875us
W20260810 13:54:02.016325 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 147345us
I20260810 13:54:02.025079 13167 leader_election.cc:304] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:02.026098 15390 raft_consensus.cc:2804] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:02.028194 15390 raft_consensus.cc:697] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:02.029939 15390 consensus_queue.cc:237] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:02.034401 13382 leader_election.cc:343] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:02.024245 13427 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 437) took 1448 ms. Trace:
I20260810 13:54:02.034863 13427 rpcz_store.cc:276] 0810 13:54:00.575741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.655138 (+ 79397us) service_pool.cc:224] Handling call
0810 13:54:00.871224 (+216086us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.871467 (+ 243us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.506471 (+635004us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.893158 (+386687us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.024144 (+130986us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13997}
I20260810 13:54:02.025096 15348 tablet_replica.cc:333] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:02.025516 13420 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 444) took 1095 ms. Trace:
I20260810 13:54:02.025955 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0f98604d43049ac9b2befe5041a2bda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.040572 13167 leader_election.cc:304] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:02.026170 13428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 418) took 1542 ms. Trace:
I20260810 13:54:02.041596 13428 rpcz_store.cc:276] 0810 13:54:00.483891 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.544440 (+ 60549us) service_pool.cc:224] Handling call
0810 13:54:00.866324 (+321884us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:00.866526 (+ 202us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.408389 (+541863us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.918808 (+510419us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.026110 (+107302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:02.044982 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_dfe60ded8ca240529710962e7f530298"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:02.036338 13420 rpcz_store.cc:276] 0810 13:54:00.929637 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.932763 (+ 3126us) service_pool.cc:224] Handling call
0810 13:54:00.967068 (+ 34305us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:01.050702 (+ 83634us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.440548 (+389846us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.928474 (+487926us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.025456 (+ 96982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:02.041971 15466 raft_consensus.cc:2804] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:02.051560 15466 raft_consensus.cc:697] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:02.053049 15466 consensus_queue.cc:237] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.026691 13419 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 427) took 1491 ms. Trace:
I20260810 13:54:02.074083 13419 rpcz_store.cc:276] 0810 13:54:00.535044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.572652 (+ 37608us) service_pool.cc:224] Handling call
0810 13:54:01.146079 (+573427us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:01.161587 (+ 15508us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.562119 (+400532us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:01.931907 (+369788us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.026639 (+ 94732us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:02.022324 13640 ts_tablet_manager.cc:1434] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.161s user 0.007s sys 0.004s
W20260810 13:54:02.073000 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfe60ded8ca240529710962e7f530298 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:02.079391 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_453ba61c4fad4f2e99635628e3dc94b9" } new_table_name: "default.Table_c04efa0403424fbcb37f7215ea9dcd8b" modify_external_catalogs: true
I20260810 13:54:02.059811 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8394a311b0bd4203bbb0ec788da4e245" } new_table_name: "default.Table_03969f7d41104ba7bfd4d97a511eae52" modify_external_catalogs: true
I20260810 13:54:02.087333 15419 raft_consensus.cc:493] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:02.088860 13442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 450) took 1157 ms. Trace:
I20260810 13:54:02.089075 15419 raft_consensus.cc:515] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:02.092211 15419 leader_election.cc:290] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.055642 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6964fe82ae0c4d96a86d800f82062b3e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:02.103045 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6964fe82ae0c4d96a86d800f82062b3e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:02.097538 13442 rpcz_store.cc:276] 0810 13:54:00.931358 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.493749 (+562391us) service_pool.cc:224] Handling call
0810 13:54:01.494808 (+ 1059us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:01.494871 (+ 63us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.772499 (+277628us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.030987 (+258488us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.088793 (+ 57806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:02.110244 13639 tablet_bootstrap.cc:654] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:02.102084 13342 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:54:02.103971 15367 raft_consensus.cc:493] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:02.107474 15321 ts_tablet_manager.cc:1916] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:02.122203 15367 raft_consensus.cc:515] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.127810 13417 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 420) took 1632 ms. Trace:
I20260810 13:54:02.128228 13417 rpcz_store.cc:276] 0810 13:54:00.495456 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.627767 (+132311us) service_pool.cc:224] Handling call
0810 13:54:01.489913 (+862146us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:01.490132 (+ 219us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.920290 (+430158us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.031954 (+111664us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.127751 (+ 95797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:02.132541 13640 tablet_bootstrap.cc:492] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:02.132952 15367 leader_election.cc:290] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:02.137046 13421 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 451) took 1205 ms. Trace:
I20260810 13:54:02.137420 13421 rpcz_store.cc:276] 0810 13:54:00.931610 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.495860 (+564250us) service_pool.cc:224] Handling call
0810 13:54:01.563434 (+ 67574us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:01.563527 (+ 93us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.743303 (+179776us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.117000 (+373697us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.136981 (+ 19981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:02.140110 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:02.142370 13382 leader_election.cc:304] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:02.142359 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:02.143188 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 108808us
I20260810 13:54:02.143921 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee27d158bd40425a8c6fa8cb068daa79" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:02.144124 15426 raft_consensus.cc:2749] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:02.145390 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4cd2e5c73e467eb1bc4623e5d5e831" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:02.146566 13009 tablet_service.cc:1558] Processing DeleteTablet for tablet a83ddc3ea3e74b569385b289fe8cf469 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:02.146796 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_5d1526181af947a2ae46e8e9e2718688 [id=9a3a9159f7634bc999c5c10834eb41d3]) successfully deleted
I20260810 13:54:02.147508 15328 tablet_replica.cc:333] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
W20260810 13:54:02.148078 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet cab5c35fa6b440a7bc4ebe2709fbfc60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cab5c35fa6b440a7bc4ebe2709fbfc60 already in progress: creating tablet
I20260810 13:54:02.148289 15328 raft_consensus.cc:2243] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:02.148835 15328 raft_consensus.cc:2272] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:02.148984 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 already in progress: creating tablet
W20260810 13:54:02.149812 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 6406062bb0934eadae901502806178b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6406062bb0934eadae901502806178b5 already in progress: creating tablet
W20260810 13:54:02.150640 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 674599456f9a49dc98d8d089c166ca89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 674599456f9a49dc98d8d089c166ca89 already in progress: creating tablet
I20260810 13:54:02.151624 15328 ts_tablet_manager.cc:1916] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:54:02.159212 13167 leader_election.cc:343] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:02.160619 13167 leader_election.cc:343] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:02.173357 13423 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 424) took 1639 ms. Trace:
I20260810 13:54:02.173843 13423 rpcz_store.cc:276] 0810 13:54:00.534029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.620255 (+ 86226us) service_pool.cc:224] Handling call
0810 13:54:01.560592 (+940337us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:01.562764 (+ 2172us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.989937 (+427173us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.172633 (+182696us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.173290 (+ 657us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86912}
I20260810 13:54:02.181751 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5ad84fe2604dd2959768db31f66e7c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:02.182509 13472 raft_consensus.cc:3060] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:02.189476 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.190444 13470 raft_consensus.cc:2468] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:02.196385 13472 raft_consensus.cc:2468] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:02.199834 13638 tablet_bootstrap.cc:492] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:02.200268 13638 ts_tablet_manager.cc:1403] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.508s user 0.015s sys 0.008s
I20260810 13:54:02.183133 12994 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 30) took 2129 ms. Trace:
I20260810 13:54:02.204852 15348 raft_consensus.cc:2243] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:02.166728 15470 tablet.cc:1724] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:02.207783 15348 raft_consensus.cc:2272] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:02.204351 12994 rpcz_store.cc:276] 0810 13:54:00.061459 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.061630 (+ 171us) service_pool.cc:224] Handling call
0810 13:54:01.813605 (+1751975us) spinlock_profiling.cc:243] Waited 65.4 ms on lock 0x7b54000f4e54. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:02.183018 (+369413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150428928}
I20260810 13:54:02.216800 15348 ts_tablet_manager.cc:1916] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:02.221879 13448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 455) took 1289 ms. Trace:
I20260810 13:54:02.222273 13448 rpcz_store.cc:276] 0810 13:54:00.932638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.519301 (+586663us) service_pool.cc:224] Handling call
0810 13:54:01.808847 (+289546us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:01.808934 (+ 87us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:02.003217 (+194283us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.221304 (+218087us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.221812 (+ 508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:02.235114 15321 ts_tablet_manager.cc:1929] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:02.235703 15321 log.cc:1199] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/1b84bd35b02f4a1faf15ac9bc21e6146
I20260810 13:54:02.236994 15328 ts_tablet_manager.cc:1929] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:02.237433 15328 log.cc:1199] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/a83ddc3ea3e74b569385b289fe8cf469
I20260810 13:54:02.238340 15328 ts_tablet_manager.cc:1950] T a83ddc3ea3e74b569385b289fe8cf469 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:02.262159 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]) successfully deleted
I20260810 13:54:02.262923 12995 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 31) took 1404 ms. Trace:
I20260810 13:54:02.263279 13426 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 425) took 1728 ms. Trace:
I20260810 13:54:02.263309 12995 rpcz_store.cc:276] 0810 13:54:00.858443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.858827 (+ 384us) service_pool.cc:224] Handling call
0810 13:54:01.187652 (+328825us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400150c54. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:01.746007 (+558355us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b54000f4954. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:02.262301 (+516294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489540224}
W20260810 13:54:02.264074 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a27bf786a8274954afc2b2d8cfb34bf0 consensus state has no leader
I20260810 13:54:02.278600 13639 tablet_bootstrap.cc:492] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:02.279150 13639 ts_tablet_manager.cc:1403] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.354s user 0.004s sys 0.016s
I20260810 13:54:02.278834 15447 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 404) took 2969 ms. Trace:
I20260810 13:54:02.286196 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ad47d29d61456891478a9544594a94" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.288275 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.290052 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:02.290614 13474 raft_consensus.cc:3060] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:02.298146 13474 raft_consensus.cc:2468] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:02.309283 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dac7ad18d3c4fb58171ff8ab959d98a" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.309818 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.310366 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.311673 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.311895 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.332666 13638 raft_consensus.cc:359] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.333534 13638 raft_consensus.cc:385] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:02.334126 13638 raft_consensus.cc:740] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:02.283780 13639 raft_consensus.cc:359] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.338598 13639 raft_consensus.cc:385] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:02.338907 13639 raft_consensus.cc:740] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:02.264613 13426 rpcz_store.cc:276] 0810 13:54:00.534442 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.627393 (+ 92951us) service_pool.cc:224] Handling call
0810 13:54:01.552456 (+925063us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:01.552612 (+ 156us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:01.988388 (+435776us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.262504 (+274116us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.263215 (+ 711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:02.268646 15321 ts_tablet_manager.cc:1950] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:02.364215 13426 tablet_service.cc:1558] Processing DeleteTablet for tablet 6406062bb0934eadae901502806178b5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:02.365182 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4cd2e5c73e467eb1bc4623e5d5e831" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.366106 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee27d158bd40425a8c6fa8cb068daa79" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.371477 13474 raft_consensus.cc:2468] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:02.371827 13470 raft_consensus.cc:2468] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:02.366686 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 674599456f9a49dc98d8d089c166ca89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:02.280050 15447 rpcz_store.cc:276] 0810 13:53:59.309422 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.309582 (+ 160us) service_pool.cc:224] Handling call
0810 13:54:02.278731 (+2969149us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:53:59.339328 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:53:59.339827 (+ 499us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:53:59.339903 (+ 76us) alter_schema_op.cc:66] Acquired schema lock
0810 13:53:59.340010 (+ 107us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:53:59.340163 (+ 153us) alter_schema_op.cc:128] START. Timestamp: 1786370039339543
0810 13:53:59.340205 (+ 42us) op_driver.cc:348] REPLICATION: starting
0810 13:53:59.340944 (+ 739us) log.cc:844] Serialized 173 byte log entry
0810 13:54:01.559817 (+2218873us) op_driver.cc:464] REPLICATION: finished
0810 13:54:01.820862 (+261045us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:01.822314 (+ 1452us) log.cc:844] Serialized 5 byte log entry
0810 13:54:02.276645 (+454331us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.278068 (+ 1423us) log.cc:844] Serialized 14 byte log entry
0810 13:54:02.278384 (+ 316us) alter_schema_op.cc:73] Released schema lock
0810 13:54:02.278478 (+ 94us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":254293,"mutex_wait_us":13104,"prepare.queue_time_us":14883,"prepare.run_cpu_time_us":14944,"prepare.run_wall_time_us":314160,"raft.queue_time_us":95475,"raft.run_cpu_time_us":1014,"raft.run_wall_time_us":11192,"replication_time_us":2219347,"thread_start_us":531997,"threads_started":3,"wal-append.queue_time_us":529514,"wal-append.run_cpu_time_us":1482,"wal-append.run_wall_time_us":1001542}]]}
I20260810 13:54:02.376770 15402 raft_consensus.cc:493] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:02.386272 15402 raft_consensus.cc:515] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.345580 13640 tablet_bootstrap.cc:654] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:02.388072 15402 leader_election.cc:290] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.383495 13639 consensus_queue.cc:260] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.394382 13639 ts_tablet_manager.cc:1434] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.115s user 0.002s sys 0.006s
I20260810 13:54:02.400085 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet a83ddc3ea3e74b569385b289fe8cf469 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:54:02.419587 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f600e14cc2a64f6bb5cf8d4057ad45b5 consensus state has no leader
I20260810 13:54:02.421226 13640 tablet_bootstrap.cc:492] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:02.421744 13640 ts_tablet_manager.cc:1403] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.289s user 0.012s sys 0.007s
I20260810 13:54:02.427722 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7bce2378f482d81d2ad08e9d15b0c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:02.429059 12951 leader_election.cc:304] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:02.429733 15402 raft_consensus.cc:2764] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:02.430588 12951 leader_election.cc:304] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:02.431170 12951 raft_consensus.cc:2686] T 5dac7ad18d3c4fb58171ff8ab959d98a P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:54:02.433339 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 07ff9e8a8ca845b89154ed0626d34c5c because the tablet was not found. No further retry: Not found: Tablet not found: 07ff9e8a8ca845b89154ed0626d34c5c
I20260810 13:54:02.435735 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:02.436244 13049 raft_consensus.cc:2468] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:02.386189 13445 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 452) took 1454 ms. Trace:
I20260810 13:54:02.436618 13445 rpcz_store.cc:276] 0810 13:54:00.931856 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.514309 (+582453us) service_pool.cc:224] Handling call
0810 13:54:01.986481 (+472172us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d521 00007fb87ae4d3d2 00007fb883d91fb9 00007fb882fd3640 00007fb8830b8641 00007fb8830958d3 00007fb883044210 00007fb8815d0bf4 00007fb8815d0b82 00007fb8815d0ab1
0810 13:54:02.023644 (+ 37163us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d84c 00007fb87ae4d40b 00007fb883d91fb9 00007fb882fd3640 00007fb8830b8641 00007fb8830958d3 00007fb883044210 00007fb8815d0bf4 00007fb8815d0b82 00007fb8815d0ab1
0810 13:54:02.025505 (+ 1861us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:02.025584 (+ 79us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:02.119303 (+ 93719us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.385636 (+266333us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:02.386125 (+ 489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619648512}
I20260810 13:54:02.442191 13640 raft_consensus.cc:359] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.456907 13639 tablet_bootstrap.cc:492] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:02.475682 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:02.486917 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:02.492162 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7bce2378f482d81d2ad08e9d15b0c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:02.493762 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:02.494599 13265 raft_consensus.cc:2468] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:02.497615 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:02.498214 13269 raft_consensus.cc:2468] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:02.505867 12952 leader_election.cc:304] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:02.506752 15402 raft_consensus.cc:2804] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:02.507182 15402 raft_consensus.cc:493] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:02.507544 15402 raft_consensus.cc:3060] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:02.514945 13639 tablet_bootstrap.cc:654] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:02.529551 12747 catalog_manager.cc:5719] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:02.530799 12747 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2e5ad84fe2604dd2959768db31f66e7c (table default.Table_76e484f1a993422f9e6916f20d5cab02 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]). Expected version 1 got 0
I20260810 13:54:02.534204 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:54:02.534942 13639 tablet_bootstrap.cc:492] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:02.534852 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 00a7bce2378f482d81d2ad08e9d15b0c (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:02.535344 13639 ts_tablet_manager.cc:1403] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.079s user 0.010s sys 0.004s
I20260810 13:54:02.538053 13640 raft_consensus.cc:385] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:02.538376 13640 raft_consensus.cc:740] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:02.538753 13639 raft_consensus.cc:359] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.539367 13639 raft_consensus.cc:385] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:02.539626 13639 raft_consensus.cc:740] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:02.543025 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 00a4341f5d274a9eb54cb030b47c9a91
I20260810 13:54:02.538990 13640 consensus_queue.cc:260] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.547319 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet 00a4341f5d274a9eb54cb030b47c9a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:02.546242 15402 raft_consensus.cc:515] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.549757 13009 tablet_service.cc:1558] Processing DeleteTablet for tablet 00a4341f5d274a9eb54cb030b47c9a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:54:02.551663 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 00a4341f5d274a9eb54cb030b47c9a91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00a4341f5d274a9eb54cb030b47c9a91 already in progress: creating tablet
I20260810 13:54:02.540268 13639 consensus_queue.cc:260] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:02.552829 12749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 84) took 1319 ms (client timeout 1000 ms). Trace:
W20260810 13:54:02.553179 12749 rpcz_store.cc:269] 0810 13:54:01.233498 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.233657 (+ 159us) service_pool.cc:224] Handling call
0810 13:54:02.552762 (+1319105us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260810 13:54:02.560176 12749 master_service.cc:960] ReplaceTablet: received request to replace tablet ca4c0fea312c418f8ebd5c0619e7e220 from {username='slave'} at 127.0.0.1:48758
I20260810 13:54:02.566139 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:54:02.566627 15402 leader_election.cc:290] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.566733 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:54:02.568248 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:54:02.568842 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 00a7bce2378f482d81d2ad08e9d15b0c (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:02.569366 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
I20260810 13:54:02.571973 13009 tablet_service.cc:1511] Processing CreateTablet for tablet e828861d499a400c834b848acdb2afc5 (DEFAULT_TABLE table=default.Table_50a288b03da74905ac5286346bd7df20 [id=fb10a5d322514cbc98ef0f43ba16223e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.573153 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e828861d499a400c834b848acdb2afc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.584216 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 3a1b35d369474ba9bee379089796bd3c
I20260810 13:54:02.570106 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]). Expected version 1 got 0
I20260810 13:54:02.585831 12744 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 556) took 1265 ms. Trace:
I20260810 13:54:02.588029 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9469abb9f34b40cba5b88a7cdc20aeb7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:02.589519 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9469abb9f34b40cba5b88a7cdc20aeb7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:02.590391 12998 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a1b35d369474ba9bee379089796bd3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:02.599982 15419 raft_consensus.cc:493] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:02.600493 15419 raft_consensus.cc:515] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.602448 15419 leader_election.cc:290] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.586133 12744 rpcz_store.cc:276] 0810 13:54:01.320737 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.320908 (+ 171us) service_pool.cc:224] Handling call
0810 13:54:01.322751 (+ 1843us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:54:01.329301 (+ 6550us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:54:01.329423 (+ 122us) catalog_manager.cc:2850] Locking tablets
0810 13:54:02.558032 (+1228609us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:54:02.583823 (+ 25791us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:54:02.584017 (+ 194us) catalog_manager.cc:2898] Committing in-memory state
0810 13:54:02.584118 (+ 101us) catalog_manager.cc:2902] Aborting table tasks
0810 13:54:02.585774 (+ 1656us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:02.560205 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:02.560572 (+ 367us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:02.560594 (+ 22us) write_op.cc:435] Acquired schema lock
0810 13:54:02.560607 (+ 13us) tablet.cc:662] Decoding operations
0810 13:54:02.560939 (+ 332us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:02.560978 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:02.560999 (+ 21us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:02.561253 (+ 254us) tablet.cc:701] Row locks acquired
0810 13:54:02.561266 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:54:02.561369 (+ 103us) write_op.cc:270] Start()
0810 13:54:02.561443 (+ 74us) write_op.cc:276] Timestamp: P: 1786370042561326 usec, L: 0
0810 13:54:02.561458 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:54:02.561929 (+ 471us) log.cc:844] Serialized 756 byte log entry
0810 13:54:02.582022 (+ 20093us) op_driver.cc:464] REPLICATION: finished
0810 13:54:02.582366 (+ 344us) write_op.cc:301] APPLY: starting
0810 13:54:02.582419 (+ 53us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:02.582535 (+ 116us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:02.582622 (+ 87us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:02.582966 (+ 344us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:02.583115 (+ 149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:54:02.583159 (+ 44us) write_op.cc:312] APPLY: finished
0810 13:54:02.583371 (+ 212us) log.cc:844] Serialized 29 byte log entry
0810 13:54:02.583527 (+ 156us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:02.583592 (+ 65us) write_op.cc:454] Released schema lock
0810 13:54:02.583628 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":201,"num_ops":2,"prepare.queue_time_us":416,"prepare.run_cpu_time_us":2028,"prepare.run_wall_time_us":12051,"raft.queue_time_us":72,"raft.run_cpu_time_us":708,"raft.run_wall_time_us":776,"replication_time_us":20463}]]}
W20260810 13:54:02.593999 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 3a1b35d369474ba9bee379089796bd3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a1b35d369474ba9bee379089796bd3c already in progress: creating tablet
I20260810 13:54:02.606477 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ca4c0fea312c418f8ebd5c0619e7e220
I20260810 13:54:02.607776 12749 catalog_manager.cc:6807] ReplaceTablet: tablet ca4c0fea312c418f8ebd5c0619e7e220 deleted and replaced by tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d
I20260810 13:54:02.608282 12742 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:54:02.609400 12998 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4c0fea312c418f8ebd5c0619e7e220 with delete_type TABLET_DATA_DELETED (replaced by tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d) from {username='slave'} at 127.0.0.1:50548
W20260810 13:54:02.611016 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ca4c0fea312c418f8ebd5c0619e7e220 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca4c0fea312c418f8ebd5c0619e7e220 already in progress: creating tablet
I20260810 13:54:02.594239 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_def78e8fb6b74845bf2ef24bcef6691b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:02.614526 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_def78e8fb6b74845bf2ef24bcef6691b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:02.617141 15402 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:02.617620 15402 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.619647 15402 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.626011 12745 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b] alter complete (version 2)
I20260810 13:54:02.633849 12998 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fc9bef2781f4046a30c5394fc5d5529 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:40 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:02.634675 15328 tablet_replica.cc:333] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:02.635521 15328 raft_consensus.cc:2243] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:02.635950 15328 raft_consensus.cc:2272] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:02.636054 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_3b9ddfd681b44dce8e728004ab230e73" } new_table_name: "default.Table_96ae0c2b399a48b18829481ceaee950d" modify_external_catalogs: true
I20260810 13:54:02.637467 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_fe0baa9629ad42fbb05cfbc004e62688"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:02.637980 15328 ts_tablet_manager.cc:1916] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:54:02.638911 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe0baa9629ad42fbb05cfbc004e62688 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:02.640132 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_4a451ed74dd140d8a587dbf01c988da5" } new_table_name: "default.Table_021012dfc1b243daae27555cf7c6f486" modify_external_catalogs: true
W20260810 13:54:02.644909 12441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 64148.3us
I20260810 13:54:02.656158 15402 raft_consensus.cc:493] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:02.656710 15402 raft_consensus.cc:515] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.658947 15501 raft_consensus.cc:493] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:02.659471 15402 leader_election.cc:290] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.659364 15501 raft_consensus.cc:515] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.661571 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1c8d47b92e21464d98e32ae2ac93fb9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:02.662042 13639 ts_tablet_manager.cc:1434] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.126s user 0.012s sys 0.004s
I20260810 13:54:02.662992 13639 tablet_bootstrap.cc:492] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:02.663316 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1c8d47b92e21464d98e32ae2ac93fb9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:02.674459 12998 tablet_service.cc:1558] Processing DeleteTablet for tablet ee27d158bd40425a8c6fa8cb068daa79 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:35 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:02.676280 12998 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:02.682561 13640 ts_tablet_manager.cc:1434] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.260s user 0.004s sys 0.002s
I20260810 13:54:02.683931 13639 tablet_bootstrap.cc:654] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:02.691582 15328 ts_tablet_manager.cc:1929] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:02.691931 15328 log.cc:1199] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/4fc9bef2781f4046a30c5394fc5d5529
I20260810 13:54:02.692536 15328 ts_tablet_manager.cc:1950] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:02.694099 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 4fc9bef2781f4046a30c5394fc5d5529 (table default.Table_1efc108552b047538e81a19f9d985680 [id=b0c2c10c7abb49c0b0026662e9edba2a]) successfully deleted
I20260810 13:54:02.695258 15328 tablet_replica.cc:333] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:02.701315 15328 raft_consensus.cc:2243] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:02.334914 13638 consensus_queue.cc:260] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.703378 15328 raft_consensus.cc:2272] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:02.709828 15501 leader_election.cc:290] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.713356 13215 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4c0fea312c418f8ebd5c0619e7e220 with delete_type TABLET_DATA_DELETED (replaced by tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:02.714015 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a1b35d369474ba9bee379089796bd3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:02.717918 15328 ts_tablet_manager.cc:1916] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:54:02.721473 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9721201403f458b92613d0c12fd3eba consensus state has no leader
I20260810 13:54:02.729691 15367 raft_consensus.cc:493] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:02.730161 15367 raft_consensus.cc:515] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.732326 15367 leader_election.cc:290] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:02.734938 13210 tablet_service.cc:1511] Processing CreateTablet for tablet e828861d499a400c834b848acdb2afc5 (DEFAULT_TABLE table=default.Table_50a288b03da74905ac5286346bd7df20 [id=fb10a5d322514cbc98ef0f43ba16223e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.736373 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e828861d499a400c834b848acdb2afc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.740859 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 377) took 3850 ms. Trace:
I20260810 13:54:02.741271 15321 rpcz_store.cc:276] 0810 13:53:58.865741 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:58.865874 (+ 133us) service_pool.cc:224] Handling call
0810 13:54:02.012760 (+3146886us) ts_tablet_manager.cc:1151] Deleting tablet 1b84bd35b02f4a1faf15ac9bc21e6146
0810 13:54:02.012902 (+ 142us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:02.161074 (+148172us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.234978 (+ 73904us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.715643 (+480665us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3144707}
I20260810 13:54:02.742456 15348 ts_tablet_manager.cc:1929] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:02.743285 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 1b84bd35b02f4a1faf15ac9bc21e6146 (table default.Table_cb09b1a8472e4349bbbac0669af3d045 [id=5222178a76314f4da374fe8c2984369b]) successfully deleted
I20260810 13:54:02.747308 15348 log.cc:1199] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/0c4e37b80b7645c2a14f3ab0c5e919d2
I20260810 13:54:02.755331 15348 ts_tablet_manager.cc:1950] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:02.752871 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 380) took 3098 ms. Trace:
I20260810 13:54:02.756982 15321 rpcz_store.cc:276] 0810 13:53:59.654786 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.654927 (+ 141us) service_pool.cc:224] Handling call
0810 13:54:02.742628 (+3087701us) ts_tablet_manager.cc:1151] Deleting tablet 0a6893b0b32646f6aeb72c866251a112
0810 13:54:02.752342 (+ 9714us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:02.752792 (+ 450us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3087073}
W20260810 13:54:02.758950 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 009307ae14cf4e7db54b2146c0c4d143 has no consensus state
W20260810 13:54:02.761875 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 0a6893b0b32646f6aeb72c866251a112 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a6893b0b32646f6aeb72c866251a112 already in progress: creating tablet
I20260810 13:54:02.763273 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 381) took 3067 ms. Trace:
I20260810 13:54:02.763643 15321 rpcz_store.cc:276] 0810 13:53:59.695738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.697183 (+ 1445us) service_pool.cc:224] Handling call
0810 13:54:02.762799 (+3065616us) ts_tablet_manager.cc:1151] Deleting tablet 452978fbf3b74e3c9b16756b9f394be7
0810 13:54:02.762866 (+ 67us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:02.763211 (+ 345us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3064978}
W20260810 13:54:02.765031 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 452978fbf3b74e3c9b16756b9f394be7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 452978fbf3b74e3c9b16756b9f394be7 already in progress: creating tablet
I20260810 13:54:02.769068 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]). Expected version 3 got 0
I20260810 13:54:02.770138 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_7515aaeccfe14052b6fd5de21c880a9b" } modify_external_catalogs: true
I20260810 13:54:02.774523 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_7515aaeccfe14052b6fd5de21c880a9b" } modify_external_catalogs: true
I20260810 13:54:02.743216 13640 tablet_bootstrap.cc:492] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:02.767261 15419 raft_consensus.cc:493] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:02.777720 15419 raft_consensus.cc:515] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.779640 15419 leader_election.cc:290] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.789387 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 382) took 3079 ms. Trace:
I20260810 13:54:02.789726 15321 rpcz_store.cc:276] 0810 13:53:59.709544 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.709707 (+ 163us) service_pool.cc:224] Handling call
0810 13:54:02.788936 (+3079229us) ts_tablet_manager.cc:1151] Deleting tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4
0810 13:54:02.788995 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:02.789316 (+ 321us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3078558}
W20260810 13:54:02.791003 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 already in progress: creating tablet
I20260810 13:54:02.771162 15511 raft_consensus.cc:493] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:02.792673 15511 raft_consensus.cc:515] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.795063 15511 leader_election.cc:290] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.797061 15321 tablet_replica.cc:333] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:02.798282 15321 raft_consensus.cc:2243] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:02.799170 15419 raft_consensus.cc:493] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:02.799254 15321 pending_rounds.cc:70] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:54:02.799506 15321 pending_rounds.cc:77] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971679784058880 op_type: NO_OP noop_request { }
I20260810 13:54:02.799664 15419 raft_consensus.cc:515] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.800061 15321 raft_consensus.cc:2889] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:02.800411 15321 raft_consensus.cc:2272] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:02.801795 15419 leader_election.cc:290] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.805295 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 412) took 3380 ms. Trace:
I20260810 13:54:02.805655 15348 rpcz_store.cc:276] 0810 13:53:59.425228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.428363 (+ 3135us) service_pool.cc:224] Handling call
0810 13:54:01.894720 (+2466357us) ts_tablet_manager.cc:1151] Deleting tablet 0c4e37b80b7645c2a14f3ab0c5e919d2
0810 13:54:02.024839 (+130119us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:02.407562 (+382723us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.742320 (+334758us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:02.805237 (+ 62917us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169421,"tablet-delete.queue_time_us":2465830}
I20260810 13:54:02.816398 13215 tablet_service.cc:1511] Processing CreateTablet for tablet 73bc868e3bba4d8c80ac234e4be6b3a4 (DEFAULT_TABLE table=default.Table_7e2df1474a324a139e9e31ca581a4f34 [id=5b1484c8fdc64ee6a07bd203fa140fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.817699 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73bc868e3bba4d8c80ac234e4be6b3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.831792 15506 tablet.cc:1724] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:02.839169 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 14a19e0d12cf4582b0b5ec5c2fa25f49 (DEFAULT_TABLE table=default.Table_23cb4b4f896b48b1adc91079a7382c5c [id=a32ace7c7992464c8a5ef3f8169906b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.840401 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a19e0d12cf4582b0b5ec5c2fa25f49. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:02.841483 13167 leader_election.cc:343] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 17df06cad1404d96bda5822be6a6e995
I20260810 13:54:02.843608 15321 ts_tablet_manager.cc:1916] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:02.788589 13640 tablet_bootstrap.cc:654] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:02.850159 15348 tablet_replica.cc:333] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:02.855077 13639 tablet_bootstrap.cc:492] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:02.855499 13639 ts_tablet_manager.cc:1403] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.193s user 0.012s sys 0.000s
I20260810 13:54:02.856246 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 73bc868e3bba4d8c80ac234e4be6b3a4 (DEFAULT_TABLE table=default.Table_7e2df1474a324a139e9e31ca581a4f34 [id=5b1484c8fdc64ee6a07bd203fa140fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.858207 15348 raft_consensus.cc:2243] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:02.858879 15348 pending_rounds.cc:70] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: Trying to abort 1 pending ops.
I20260810 13:54:02.859141 15348 pending_rounds.cc:77] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971685128208384 op_type: NO_OP noop_request { }
I20260810 13:54:02.859527 15348 raft_consensus.cc:2889] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:02.860039 15348 raft_consensus.cc:2272] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:02.861263 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_26f372743d1f486d990e030f4f02dadd" } modify_external_catalogs: true
I20260810 13:54:02.861752 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_26f372743d1f486d990e030f4f02dadd" } modify_external_catalogs: true
I20260810 13:54:02.863519 13639 raft_consensus.cc:359] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.864152 13639 raft_consensus.cc:385] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:02.864418 13639 raft_consensus.cc:740] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:02.866117 15348 ts_tablet_manager.cc:1916] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:02.866922 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b33cb4c7a80141c49d306885213f30a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:02.868381 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b33cb4c7a80141c49d306885213f30a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:02.873188 13639 consensus_queue.cc:260] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.875414 13639 ts_tablet_manager.cc:1434] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
I20260810 13:54:02.876161 12998 tablet_service.cc:1511] Processing CreateTablet for tablet 14a19e0d12cf4582b0b5ec5c2fa25f49 (DEFAULT_TABLE table=default.Table_23cb4b4f896b48b1adc91079a7382c5c [id=a32ace7c7992464c8a5ef3f8169906b6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:02.887795 13382 consensus_peers.cc:597] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5dac7ad18d3c4fb58171ff8ab959d98a. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:02.888046 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_18833ebfc83a4c33a1a94a902b97ffaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:02.889640 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18833ebfc83a4c33a1a94a902b97ffaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:02.891882 13382 leader_election.cc:343] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:02.894670 13382 leader_election.cc:304] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:02.868609 15328 ts_tablet_manager.cc:1929] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:02.895522 15419 raft_consensus.cc:2804] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:02.895675 15328 log.cc:1199] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/ee27d158bd40425a8c6fa8cb068daa79
I20260810 13:54:02.895854 15419 raft_consensus.cc:493] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:02.896169 15419 raft_consensus.cc:3060] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:02.896389 15328 ts_tablet_manager.cc:1950] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:02.905174 12999 tablet_service.cc:1511] Processing CreateTablet for tablet ca26c63f9dc142318b648f456f111ebb (DEFAULT_TABLE table=default.Table_5d55900f1adf4aca973dbf4e94ca29c3 [id=63c1004ec7f44526929d7b9f809c0e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.908468 15419 raft_consensus.cc:515] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.909157 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 7a490fcb16164f968335f069129b3d71
I20260810 13:54:02.910511 15419 leader_election.cc:290] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:02.912701 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.914049 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.914655 13480 raft_consensus.cc:2393] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:02.915608 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:02.916141 13480 raft_consensus.cc:2393] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:02.917055 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.919085 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee27d158bd40425a8c6fa8cb068daa79" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:02.919569 13480 raft_consensus.cc:2468] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:02.921275 13012 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a490fcb16164f968335f069129b3d71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:02 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:02.922408 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 39fd2ebed17e4c1e946d7783c41d15e6 (DEFAULT_TABLE table=default.Table_de488738829d49dbb554c8fb0d854bd5 [id=df578063a2ef46849d506467bf6635dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.927111 13640 tablet_bootstrap.cc:492] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:02.927541 13640 ts_tablet_manager.cc:1403] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.185s user 0.009s sys 0.000s
I20260810 13:54:02.928114 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_bd72a75b5a4f4711bd19684dac743ea3" } new_table_name: "default.Table_7f2a0ec7817644299f02aabaf3f8b0a3" modify_external_catalogs: true
I20260810 13:54:02.931370 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73bc868e3bba4d8c80ac234e4be6b3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.932595 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a19e0d12cf4582b0b5ec5c2fa25f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.932967 13640 raft_consensus.cc:359] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:02.933563 13640 raft_consensus.cc:385] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:02.933822 13640 raft_consensus.cc:740] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:02.934037 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca26c63f9dc142318b648f456f111ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.937196 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:02.938975 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:02.941051 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fd2ebed17e4c1e946d7783c41d15e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.944866 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 (table default.Table_17e523ba6a3b40999d198d9649600be4 [id=8aed385284dd4b4db81ca50f1541807c]) successfully deleted
I20260810 13:54:02.947278 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet c4ecf9abd60848f993234e98284974e8
I20260810 13:54:02.948264 13382 leader_election.cc:304] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:02.949442 15419 raft_consensus.cc:2749] T 5836c2923aaf4c698e20b9652fcddc20 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:02.951748 13382 leader_election.cc:343] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:02.952139 13382 leader_election.cc:304] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:02.952975 15419 raft_consensus.cc:2749] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:02.954475 13012 tablet_service.cc:1558] Processing DeleteTablet for tablet c4ecf9abd60848f993234e98284974e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:02 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:02.955307 12951 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:02.956061 15501 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:02.958673 13421 tablet_service.cc:1511] Processing CreateTablet for tablet e828861d499a400c834b848acdb2afc5 (DEFAULT_TABLE table=default.Table_50a288b03da74905ac5286346bd7df20 [id=fb10a5d322514cbc98ef0f43ba16223e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.959671 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e828861d499a400c834b848acdb2afc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.960179 13417 tablet_service.cc:1558] Processing DeleteTablet for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:02.960602 12747 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]). Expected version 1 got 0
I20260810 13:54:02.960592 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 73bc868e3bba4d8c80ac234e4be6b3a4 (DEFAULT_TABLE table=default.Table_7e2df1474a324a139e9e31ca581a4f34 [id=5b1484c8fdc64ee6a07bd203fa140fcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.961514 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73bc868e3bba4d8c80ac234e4be6b3a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:02.963330 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 243702us
I20260810 13:54:02.963794 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_72d6991df9c54bd9a1427cb6b1e98570" } new_table_name: "default.Table_5747b50b5c334f3aa7aa899f363bad0a" modify_external_catalogs: true
I20260810 13:54:02.965402 13164 leader_election.cc:304] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:02.965241 15507 consensus_queue.cc:1048] T c0e45366954740528fb37c7cfdc639c6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:02.966853 15507 raft_consensus.cc:2804] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:02.967677 15507 raft_consensus.cc:493] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:02.967993 15507 raft_consensus.cc:3060] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:02.974582 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a1b35d369474ba9bee379089796bd3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:02.976413 13426 tablet_service.cc:1558] Processing DeleteTablet for tablet ca4c0fea312c418f8ebd5c0619e7e220 with delete_type TABLET_DATA_DELETED (replaced by tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:02.978020 13427 tablet_service.cc:1558] Processing DeleteTablet for tablet c4ecf9abd60848f993234e98284974e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:02 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:02.979372 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet 00a4341f5d274a9eb54cb030b47c9a91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:02.979858 13428 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a490fcb16164f968335f069129b3d71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:02 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:02.980873 13420 tablet_service.cc:1511] Processing CreateTablet for tablet ca26c63f9dc142318b648f456f111ebb (DEFAULT_TABLE table=default.Table_5d55900f1adf4aca973dbf4e94ca29c3 [id=63c1004ec7f44526929d7b9f809c0e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.982097 13638 ts_tablet_manager.cc:1434] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.781s user 0.008s sys 0.015s
W20260810 13:54:02.982412 13638 ts_tablet_manager.cc:1467] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: Tablet startup took 781ms
I20260810 13:54:02.982208 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 14a19e0d12cf4582b0b5ec5c2fa25f49 (DEFAULT_TABLE table=default.Table_23cb4b4f896b48b1adc91079a7382c5c [id=a32ace7c7992464c8a5ef3f8169906b6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:02.982635 13638 ts_tablet_manager.cc:1469] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: Trace:
0810 13:53:36.585077 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:36.586241 (+ 1164us) service_pool.cc:224] Handling call
0810 13:53:36.587503 (+ 1262us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:36.587581 (+ 78us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:36.658290 (+ 70709us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:37.204770 (+546480us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:37.207241 (+ 2471us) inbound_call.cc:177] Queueing success response
0810 13:54:01.691846 (+24484605us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:54:02.200525 (+508679us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:54:02.328865 (+128340us) tablet_replica.cc:261] Starting instrumentation
0810 13:54:02.329358 (+ 493us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":904,"raft.queue_time_us":26679,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":173,"tablet-open.queue_time_us":24484677,"thread_start_us":90707,"threads_started":1}
W20260810 13:54:02.990567 13167 consensus_peers.cc:597] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a83ddc3ea3e74b569385b289fe8cf469. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:02.958377 12951 leader_election.cc:343] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 0c4e37b80b7645c2a14f3ab0c5e919d2
I20260810 13:54:02.994427 12951 leader_election.cc:304] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:02.994994 12951 raft_consensus.cc:2686] T ee27d158bd40425a8c6fa8cb068daa79 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:54:02.995476 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca26c63f9dc142318b648f456f111ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:02.996160 13639 tablet_bootstrap.cc:492] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:02.997287 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet 7a490fcb16164f968335f069129b3d71 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:02 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:02.998662 13217 tablet_service.cc:1511] Processing CreateTablet for tablet 39fd2ebed17e4c1e946d7783c41d15e6 (DEFAULT_TABLE table=default.Table_de488738829d49dbb554c8fb0d854bd5 [id=df578063a2ef46849d506467bf6635dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:02.999827 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fd2ebed17e4c1e946d7783c41d15e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.001068 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet c4ecf9abd60848f993234e98284974e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:02 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:03.001251 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14a19e0d12cf4582b0b5ec5c2fa25f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.002200 15507 raft_consensus.cc:515] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.002444 13221 tablet_service.cc:1511] Processing CreateTablet for tablet a9721201403f458b92613d0c12fd3eba (DEFAULT_TABLE table=default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.003674 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9721201403f458b92613d0c12fd3eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.003695 13640 consensus_queue.cc:260] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.010370 13638 tablet_bootstrap.cc:492] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:03.030486 13639 tablet_bootstrap.cc:654] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:03.036751 12441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 100045us
I20260810 13:54:03.038704 13428 tablet_service.cc:1511] Processing CreateTablet for tablet 39fd2ebed17e4c1e946d7783c41d15e6 (DEFAULT_TABLE table=default.Table_de488738829d49dbb554c8fb0d854bd5 [id=df578063a2ef46849d506467bf6635dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.039800 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39fd2ebed17e4c1e946d7783c41d15e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:03.040943 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 74293us
I20260810 13:54:03.041766 13164 leader_election.cc:304] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:03.042920 13164 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:03.043678 15508 raft_consensus.cc:2749] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:03.044322 15508 raft_consensus.cc:2749] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:03.046126 13164 leader_election.cc:304] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:03.065809 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5967f54814d04534b6a591a3bf9a4e8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:03.067531 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5967f54814d04534b6a591a3bf9a4e8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:03.063128 13382 leader_election.cc:343] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 1b84bd35b02f4a1faf15ac9bc21e6146
W20260810 13:54:03.071262 13382 leader_election.cc:343] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:03.077387 13215 tablet_service.cc:1511] Processing CreateTablet for tablet ca26c63f9dc142318b648f456f111ebb (DEFAULT_TABLE table=default.Table_5d55900f1adf4aca973dbf4e94ca29c3 [id=63c1004ec7f44526929d7b9f809c0e04]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.082554 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:03.094362 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca26c63f9dc142318b648f456f111ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.096843 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet cb8aea1057f445a9b060d138952324ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:03.098500 13423 tablet_service.cc:1511] Processing CreateTablet for tablet a9721201403f458b92613d0c12fd3eba (DEFAULT_TABLE table=default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.099556 15419 raft_consensus.cc:493] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:03.099980 15419 raft_consensus.cc:515] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.101862 15419 leader_election.cc:290] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:03.105026 15505 raft_consensus.cc:2749] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:03.109624 13640 ts_tablet_manager.cc:1434] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.182s user 0.007s sys 0.000s
I20260810 13:54:03.115491 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca9ab174bc8461a9fccdc7a7d11b486 (DEFAULT_TABLE table=default.Table_230d8010fef046048e532692ee7681c8 [id=01dba6a69dec44aeb2f402dddb3e0cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.116430 13012 tablet_service.cc:1511] Processing CreateTablet for tablet a9721201403f458b92613d0c12fd3eba (DEFAULT_TABLE table=default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.122098 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9721201403f458b92613d0c12fd3eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.122246 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca9ab174bc8461a9fccdc7a7d11b486 (DEFAULT_TABLE table=default.Table_230d8010fef046048e532692ee7681c8 [id=01dba6a69dec44aeb2f402dddb3e0cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.128895 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca9ab174bc8461a9fccdc7a7d11b486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.128785 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 4793f262a5e44f9e804c27092b110921 (DEFAULT_TABLE table=default.Table_70b6f93d3d5b4c96a17ca2ffe2efe136 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.129258 13640 tablet_bootstrap.cc:492] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:03.137018 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4793f262a5e44f9e804c27092b110921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.138464 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca9ab174bc8461a9fccdc7a7d11b486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.146806 12750 master_service.cc:960] ReplaceTablet: received request to replace tablet 00a7bce2378f482d81d2ad08e9d15b0c from {username='slave'} at 127.0.0.1:48758
W20260810 13:54:03.152064 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 106017us
I20260810 13:54:03.152591 12743 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_51465ee8c49d4f90ab30de95dbda8bbc" } modify_external_catalogs: true
I20260810 13:54:03.153038 13164 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:03.153203 12743 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_51465ee8c49d4f90ab30de95dbda8bbc" } modify_external_catalogs: true
I20260810 13:54:03.153461 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1be07447c0034861a4616ab195eb8e46" } modify_external_catalogs: true
I20260810 13:54:03.153370 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5818235bc6094cb69999b2a6a1552d79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:03.153992 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1be07447c0034861a4616ab195eb8e46" } modify_external_catalogs: true
I20260810 13:54:03.154175 15505 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:03.155318 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5818235bc6094cb69999b2a6a1552d79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:03.155611 13164 leader_election.cc:304] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:03.169351 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:03.180469 13638 tablet_bootstrap.cc:654] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:03.181828 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 7ca9ab174bc8461a9fccdc7a7d11b486 (DEFAULT_TABLE table=default.Table_230d8010fef046048e532692ee7681c8 [id=01dba6a69dec44aeb2f402dddb3e0cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.183423 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 4793f262a5e44f9e804c27092b110921 (DEFAULT_TABLE table=default.Table_70b6f93d3d5b4c96a17ca2ffe2efe136 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.186153 15507 leader_election.cc:290] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:03.195293 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet ce9243eda3974532aff0425885f54166 with delete_type TABLET_DATA_DELETED (replaced by tablet f19e7aa805bd417eae45fb43ac18a66d) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:03.197114 15505 raft_consensus.cc:2749] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:03.200429 13167 leader_election.cc:343] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 4fc9bef2781f4046a30c5394fc5d5529
W20260810 13:54:03.202901 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47364.4us
I20260810 13:54:03.203636 13164 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:03.205018 13164 leader_election.cc:304] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:03.205881 15505 raft_consensus.cc:2749] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:03.207161 15505 raft_consensus.cc:2749] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:03.207204 13382 leader_election.cc:343] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 4fc9bef2781f4046a30c5394fc5d5529
W20260810 13:54:03.211771 13382 leader_election.cc:343] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:03.213275 13639 tablet_bootstrap.cc:492] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:03.074936 15348 ts_tablet_manager.cc:1929] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:03.217067 15348 log.cc:1199] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/eb5d7a695c694d1993c2d0c4d3127fca
I20260810 13:54:03.218367 15348 ts_tablet_manager.cc:1950] T eb5d7a695c694d1993c2d0c4d3127fca P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:03.218469 13639 ts_tablet_manager.cc:1403] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.222s user 0.008s sys 0.003s
W20260810 13:54:03.222608 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f668f6b35dc044a1a79f1d5852d39497 consensus state has no leader
I20260810 13:54:03.227384 15525 tablet.cc:1724] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:03.239259 13164 leader_election.cc:304] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:03.240463 15507 raft_consensus.cc:2804] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:03.240929 15507 raft_consensus.cc:493] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:03.241575 15507 raft_consensus.cc:3060] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:03.241804 13164 leader_election.cc:304] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:03.245002 15466 raft_consensus.cc:2804] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:03.245414 15466 raft_consensus.cc:493] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:03.245807 15466 raft_consensus.cc:3060] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:03.247445 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 4793f262a5e44f9e804c27092b110921 (DEFAULT_TABLE table=default.Table_70b6f93d3d5b4c96a17ca2ffe2efe136 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.248441 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4793f262a5e44f9e804c27092b110921. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:03.250159 15471 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 12749420330613191736) tablet 00000000000000000000000000000000 cur holder 0x7b5800043200
I20260810 13:54:03.252409 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_856a1bf64ef9498890c9b6d98edcc8ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:03.253917 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_856a1bf64ef9498890c9b6d98edcc8ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:03.259042 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 27036a9813b9404aa174f7af9d6e51e0 (DEFAULT_TABLE table=default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 [id=e992c0b15e564af7a0722b50e969adf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.260272 15526 tablet.cc:1724] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20260810 13:54:03.263080 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 75b8030450554de3b97266f348329ea6 consensus state has no leader
I20260810 13:54:03.265875 13639 raft_consensus.cc:359] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.266940 13639 raft_consensus.cc:385] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:03.267283 13639 raft_consensus.cc:740] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:03.267951 13639 consensus_queue.cc:260] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.270777 13639 ts_tablet_manager.cc:1434] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.052s user 0.002s sys 0.004s
I20260810 13:54:03.281154 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 413) took 3855 ms. Trace:
I20260810 13:54:03.286028 15348 rpcz_store.cc:276] 0810 13:53:59.425500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.428898 (+ 3398us) service_pool.cc:224] Handling call
0810 13:54:02.814941 (+3386043us) ts_tablet_manager.cc:1151] Deleting tablet eb5d7a695c694d1993c2d0c4d3127fca
0810 13:54:02.850026 (+ 35085us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:02.899565 (+ 49539us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:03.074801 (+175236us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:03.281078 (+206277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7032,"tablet-delete.queue_time_us":3385593}
I20260810 13:54:03.288714 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet eb5d7a695c694d1993c2d0c4d3127fca (table default.Table_11e70bf5f071476d8ba0b19c299040e5 [id=b11aa3e242c34bc79d6ccc2d2dcfcda2]) successfully deleted
W20260810 13:54:03.289316 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f668f6b35dc044a1a79f1d5852d39497 consensus state has no leader
I20260810 13:54:03.289373 15348 tablet_replica.cc:333] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:03.290757 15348 raft_consensus.cc:2243] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:03.291474 15348 raft_consensus.cc:2272] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:03.329506 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 51977.5us
I20260810 13:54:03.341553 15526 tablet.cc:1724] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:03.342108 15419 raft_consensus.cc:493] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:03.342577 15419 raft_consensus.cc:515] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.344578 13640 tablet_bootstrap.cc:654] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:03.349712 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bfb69a7ce74175b4f1f5f4db583aa9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:03.344632 15419 leader_election.cc:290] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:03.351214 13382 leader_election.cc:343] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:03.353034 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9721201403f458b92613d0c12fd3eba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.361343 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_586e39daebb14dfaa08b3cc251eeb18a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:03.362839 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_586e39daebb14dfaa08b3cc251eeb18a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:03.363332 13428 tablet_service.cc:1511] Processing CreateTablet for tablet 27036a9813b9404aa174f7af9d6e51e0 (DEFAULT_TABLE table=default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 [id=e992c0b15e564af7a0722b50e969adf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.365468 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27036a9813b9404aa174f7af9d6e51e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.365343 13004 tablet_service.cc:1511] Processing CreateTablet for tablet f3d299c668c444908ccdc2f36873ad24 (DEFAULT_TABLE table=default.Table_c4151a7b51d1422a91db569721e57895 [id=944d7f0374e343c39b2d2fb4aa5744b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.366293 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d299c668c444908ccdc2f36873ad24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.384121 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet ef59f7013ab4489dadd9084d065533a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57fc6408d6664e9887b150d1cb934a8d) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:03.395541 15328 tablet_replica.cc:333] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:03.395591 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet ee27d158bd40425a8c6fa8cb068daa79 (table default.Table_68361e8cbef04d1595cb882c8b2e25eb [id=cff2aea45beb46d3b2216174d77de8da]) successfully deleted
I20260810 13:54:03.396347 15328 raft_consensus.cc:2243] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:03.396819 15328 raft_consensus.cc:2272] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:03.398461 15328 ts_tablet_manager.cc:1916] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:03.401355 13420 tablet_service.cc:1511] Processing CreateTablet for tablet f3d299c668c444908ccdc2f36873ad24 (DEFAULT_TABLE table=default.Table_c4151a7b51d1422a91db569721e57895 [id=944d7f0374e343c39b2d2fb4aa5744b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.403267 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d299c668c444908ccdc2f36873ad24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.416096 15348 ts_tablet_manager.cc:1916] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:03.417233 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ca9ab174bc8461a9fccdc7a7d11b486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.421146 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4793f262a5e44f9e804c27092b110921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.422662 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27036a9813b9404aa174f7af9d6e51e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.423524 13639 tablet_bootstrap.cc:492] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:03.429551 13639 tablet_bootstrap.cc:654] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:03.432883 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9469abb9f34b40cba5b88a7cdc20aeb7" } new_table_name: "default.Table_faddfbc6bc0c46e48418e182f2f9d9e8" modify_external_catalogs: true
I20260810 13:54:03.441143 13008 tablet_service.cc:1511] Processing CreateTablet for tablet b0b44a300d4b4f41854371735ecbab1a (DEFAULT_TABLE table=default.Table_ad5024a6b14845a2aaf72b7f2f6fba8c [id=96c5b88b61a54feb89f881fcc1e270f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.442351 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b44a300d4b4f41854371735ecbab1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.450785 15531 raft_consensus.cc:493] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:03.451268 15531 raft_consensus.cc:515] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.454474 13638 tablet_bootstrap.cc:492] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:03.454897 13638 ts_tablet_manager.cc:1403] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.446s user 0.009s sys 0.009s
I20260810 13:54:03.464821 13445 tablet_service.cc:1511] Processing CreateTablet for tablet b0b44a300d4b4f41854371735ecbab1a (DEFAULT_TABLE table=default.Table_ad5024a6b14845a2aaf72b7f2f6fba8c [id=96c5b88b61a54feb89f881fcc1e270f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.467751 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8e6c5eec20c54d91b4021f43b8783007" } new_table_name: "default.Table_cc339254bace4b5e87544b721a6493a5" modify_external_catalogs: true
I20260810 13:54:03.468915 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b44a300d4b4f41854371735ecbab1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.473655 15532 tablet.cc:1724] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:03.477820 13639 tablet_bootstrap.cc:492] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:03.478257 13639 ts_tablet_manager.cc:1403] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.055s user 0.008s sys 0.000s
I20260810 13:54:03.481339 13639 raft_consensus.cc:359] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.481927 13639 raft_consensus.cc:385] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:03.482170 13639 raft_consensus.cc:740] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:03.487636 15507 raft_consensus.cc:515] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.489303 13221 tablet_service.cc:1511] Processing CreateTablet for tablet 27036a9813b9404aa174f7af9d6e51e0 (DEFAULT_TABLE table=default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 [id=e992c0b15e564af7a0722b50e969adf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.490700 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27036a9813b9404aa174f7af9d6e51e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.491010 15466 raft_consensus.cc:515] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.495847 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17df06cad1404d96bda5822be6a6e995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:03.496490 13480 raft_consensus.cc:2468] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:03.504122 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:03.511847 15321 ts_tablet_manager.cc:1929] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:03.512391 15321 log.cc:1199] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/063e3b74a9a248a1aa0c2de4b4b73a06
I20260810 13:54:03.513746 15321 ts_tablet_manager.cc:1950] T 063e3b74a9a248a1aa0c2de4b4b73a06 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:03.516043 13121 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:54:03.551781 12740 catalog_manager.cc:5719] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:03.553295 12740 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:54:03.556147 13640 tablet_bootstrap.cc:492] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:03.556819 13640 ts_tablet_manager.cc:1403] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.428s user 0.024s sys 0.001s
I20260810 13:54:03.557576 15501 raft_consensus.cc:493] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:03.558257 15501 raft_consensus.cc:515] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.560374 13640 raft_consensus.cc:359] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.561005 13640 raft_consensus.cc:385] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:03.557001 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 74427ad2017c46cd909973a4b8a83d04 (DEFAULT_TABLE table=default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.561262 13640 raft_consensus.cc:740] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:03.561942 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74427ad2017c46cd909973a4b8a83d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.561908 13640 consensus_queue.cc:260] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.570658 13004 tablet_service.cc:1511] Processing CreateTablet for tablet 995d901d22484799bd79fcad8103b8a5 (DEFAULT_TABLE table=default.Table_9930da7fdf244dd099a7b0c848073c55 [id=259774177e624a91ae4b4c0ad92edc2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.571480 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 5577bf52bd794919986e2bfa3f708efb (DEFAULT_TABLE table=default.Table_a0e9339c31fa470380def2ad49326176 [id=3e51b3dca7144d7b8494e0a36e61706a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.573732 15501 leader_election.cc:290] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:03.576726 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 74427ad2017c46cd909973a4b8a83d04 (DEFAULT_TABLE table=default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.577042 13423 tablet_service.cc:1511] Processing CreateTablet for tablet bcac39f031b44408bdbe043720dcae57 (DEFAULT_TABLE table=default.Table_86221744224e4ac4aeebf77dbd274d49 [id=fe2f8409777b4c94b59159a106e77e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.577709 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 01d42c8476514b71af3ce2fbc12270d0 (DEFAULT_TABLE table=default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.577889 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 995d901d22484799bd79fcad8103b8a5 (DEFAULT_TABLE table=default.Table_9930da7fdf244dd099a7b0c848073c55 [id=259774177e624a91ae4b4c0ad92edc2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.579751 13427 tablet_service.cc:1511] Processing CreateTablet for tablet 5577bf52bd794919986e2bfa3f708efb (DEFAULT_TABLE table=default.Table_a0e9339c31fa470380def2ad49326176 [id=3e51b3dca7144d7b8494e0a36e61706a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.581013 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995d901d22484799bd79fcad8103b8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.582542 15348 ts_tablet_manager.cc:1929] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:03.582971 15348 log.cc:1199] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/4fc9bef2781f4046a30c5394fc5d5529
I20260810 13:54:03.583706 15348 ts_tablet_manager.cc:1950] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:03.584654 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9243eda3974532aff0425885f54166" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:03.585378 13467 raft_consensus.cc:2468] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:03.588928 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcac39f031b44408bdbe043720dcae57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.590881 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5577bf52bd794919986e2bfa3f708efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.594154 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d42c8476514b71af3ce2fbc12270d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.483399 13639 consensus_queue.cc:260] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.602087 12951 leader_election.cc:304] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:03.603263 15501 raft_consensus.cc:2804] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:03.603729 15501 raft_consensus.cc:493] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:03.604208 15501 raft_consensus.cc:3060] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:03.609238 15512 raft_consensus.cc:493] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:03.609754 15512 raft_consensus.cc:515] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.610646 12750 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 00a7bce2378f482d81d2ad08e9d15b0c
I20260810 13:54:03.612164 12750 catalog_manager.cc:6807] ReplaceTablet: tablet 00a7bce2378f482d81d2ad08e9d15b0c deleted and replaced by tablet a10f8466fc2844608eec8e781fc2e8a0
I20260810 13:54:03.612123 15512 leader_election.cc:290] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:03.618273 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 00a7bce2378f482d81d2ad08e9d15b0c with delete_type TABLET_DATA_DELETED (replaced by tablet a10f8466fc2844608eec8e781fc2e8a0) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:03.618959 13639 ts_tablet_manager.cc:1434] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.140s user 0.008s sys 0.000s
I20260810 13:54:03.627454 13640 ts_tablet_manager.cc:1434] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.070s user 0.005s sys 0.001s
I20260810 13:54:03.628427 13640 tablet_bootstrap.cc:492] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:03.629932 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet 00a7bce2378f482d81d2ad08e9d15b0c with delete_type TABLET_DATA_DELETED (replaced by tablet a10f8466fc2844608eec8e781fc2e8a0) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:03.642089 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8aea1057f445a9b060d138952324ca" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:03.650210 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995d901d22484799bd79fcad8103b8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.653340 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74427ad2017c46cd909973a4b8a83d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.654012 13427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5577bf52bd794919986e2bfa3f708efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.654528 13012 tablet_service.cc:1511] Processing CreateTablet for tablet bcac39f031b44408bdbe043720dcae57 (DEFAULT_TABLE table=default.Table_86221744224e4ac4aeebf77dbd274d49 [id=fe2f8409777b4c94b59159a106e77e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.659538 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 01d42c8476514b71af3ce2fbc12270d0 (DEFAULT_TABLE table=default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.673278 13224 tablet_service.cc:1511] Processing CreateTablet for tablet f3d299c668c444908ccdc2f36873ad24 (DEFAULT_TABLE table=default.Table_c4151a7b51d1422a91db569721e57895 [id=944d7f0374e343c39b2d2fb4aa5744b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.674778 13217 tablet_service.cc:1511] Processing CreateTablet for tablet b0b44a300d4b4f41854371735ecbab1a (DEFAULT_TABLE table=default.Table_ad5024a6b14845a2aaf72b7f2f6fba8c [id=96c5b88b61a54feb89f881fcc1e270f3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:03.554356 15525 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.231s user 0.002s sys 0.002s
I20260810 13:54:03.678165 13215 tablet_service.cc:1511] Processing CreateTablet for tablet 74427ad2017c46cd909973a4b8a83d04 (DEFAULT_TABLE table=default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.679594 13640 tablet_bootstrap.cc:654] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:03.680781 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 414) took 4255 ms. Trace:
I20260810 13:54:03.681702 13639 tablet_bootstrap.cc:492] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:03.686165 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcac39f031b44408bdbe043720dcae57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.692010 13639 tablet_bootstrap.cc:654] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:03.693773 13382 leader_election.cc:343] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:03.704272 13233 tablet_service.cc:1511] Processing CreateTablet for tablet bcac39f031b44408bdbe043720dcae57 (DEFAULT_TABLE table=default.Table_86221744224e4ac4aeebf77dbd274d49 [id=fe2f8409777b4c94b59159a106e77e7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.718473 15542 raft_consensus.cc:493] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:03.681306 15348 rpcz_store.cc:276] 0810 13:53:59.425777 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.429376 (+ 3599us) service_pool.cc:224] Handling call
0810 13:54:03.289132 (+3859756us) ts_tablet_manager.cc:1151] Deleting tablet 4fc9bef2781f4046a30c5394fc5d5529
0810 13:54:03.289218 (+ 86us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:03.571593 (+282375us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:03.582403 (+ 10810us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:03.680699 (+ 98296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792,"tablet-delete.queue_time_us":3859285}
I20260810 13:54:03.719348 15542 raft_consensus.cc:515] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.733356 15542 leader_election.cc:290] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:03.736481 15531 leader_election.cc:290] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:03.738607 15507 leader_election.cc:290] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:03.741963 12743 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet bf672d15f88c4f0dbdf2fdb6aefa1108
I20260810 13:54:03.743880 15466 leader_election.cc:290] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:03.752579 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_209ee5a105144c7e871214eaafcd0cbe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:03.754222 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_209ee5a105144c7e871214eaafcd0cbe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:03.754199 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 392) took 3782 ms. Trace:
I20260810 13:54:03.754578 15321 rpcz_store.cc:276] 0810 13:53:59.971584 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.971757 (+ 173us) service_pool.cc:224] Handling call
0810 13:54:02.796849 (+2825092us) ts_tablet_manager.cc:1151] Deleting tablet 063e3b74a9a248a1aa0c2de4b4b73a06
0810 13:54:02.796902 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:03.070776 (+273874us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:03.448835 (+378059us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:03.754124 (+305289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157012,"tablet-delete.queue_time_us":2824417}
I20260810 13:54:03.758700 15501 raft_consensus.cc:515] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.761202 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3d299c668c444908ccdc2f36873ad24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.762596 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet d5aa1374d37a4918af34a5e9b15c16b3
I20260810 13:54:03.771771 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0b44a300d4b4f41854371735ecbab1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.773638 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74427ad2017c46cd909973a4b8a83d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.774389 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcac39f031b44408bdbe043720dcae57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.776105 13210 tablet_service.cc:1511] Processing CreateTablet for tablet 995d901d22484799bd79fcad8103b8a5 (DEFAULT_TABLE table=default.Table_9930da7fdf244dd099a7b0c848073c55 [id=259774177e624a91ae4b4c0ad92edc2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.776496 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 5577bf52bd794919986e2bfa3f708efb (DEFAULT_TABLE table=default.Table_a0e9339c31fa470380def2ad49326176 [id=3e51b3dca7144d7b8494e0a36e61706a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.778187 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 01d42c8476514b71af3ce2fbc12270d0 (DEFAULT_TABLE table=default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:03.778481 13213 tablet_service.cc:1558] Processing DeleteTablet for tablet 00a7bce2378f482d81d2ad08e9d15b0c with delete_type TABLET_DATA_DELETED (replaced by tablet a10f8466fc2844608eec8e781fc2e8a0) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:03.780042 13213 tablet_service.cc:1558] Processing DeleteTablet for tablet bf672d15f88c4f0dbdf2fdb6aefa1108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:03.781243 13227 tablet_service.cc:1558] Processing DeleteTablet for tablet d5aa1374d37a4918af34a5e9b15c16b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:03.782186 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5577bf52bd794919986e2bfa3f708efb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.784814 13638 raft_consensus.cc:359] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.785490 13638 raft_consensus.cc:385] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:03.785789 13638 raft_consensus.cc:740] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:03.786422 13638 consensus_queue.cc:260] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.725409 13640 tablet_bootstrap.cc:492] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:03.787494 13640 ts_tablet_manager.cc:1403] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.159s user 0.002s sys 0.012s
I20260810 13:54:03.787755 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 995d901d22484799bd79fcad8103b8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.787665 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 4fc9bef2781f4046a30c5394fc5d5529 (table default.Table_1efc108552b047538e81a19f9d985680 [id=b0c2c10c7abb49c0b0026662e9edba2a]) successfully deleted
I20260810 13:54:03.748507 13428 tablet_service.cc:1558] Processing DeleteTablet for tablet bf672d15f88c4f0dbdf2fdb6aefa1108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:03.766350 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef59f7013ab4489dadd9084d065533a8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:03.768302 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet d5aa1374d37a4918af34a5e9b15c16b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:03.769064 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9243eda3974532aff0425885f54166" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:03.790153 13465 raft_consensus.cc:2468] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:03.790894 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d42c8476514b71af3ce2fbc12270d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:03.790190 13474 raft_consensus.cc:3060] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:03.790795 13640 raft_consensus.cc:359] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:03.791441 13640 raft_consensus.cc:385] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:03.791719 13640 raft_consensus.cc:740] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:03.796923 13640 consensus_queue.cc:260] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:03.806316 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet bf672d15f88c4f0dbdf2fdb6aefa1108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:03.803156 15501 leader_election.cc:290] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:03.812250 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 063e3b74a9a248a1aa0c2de4b4b73a06 (table default.Table_1023c03a20e448b4abaa7920a9ae09d9 [id=e1f370bc63c248378875a3361c4e28e3]) successfully deleted
I20260810 13:54:03.774992 15321 tablet_replica.cc:333] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:03.817894 13640 ts_tablet_manager.cc:1434] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.030s user 0.006s sys 0.000s
I20260810 13:54:03.819145 13640 tablet_bootstrap.cc:492] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:03.823078 13638 ts_tablet_manager.cc:1434] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.368s user 0.009s sys 0.001s
I20260810 13:54:03.835950 13640 tablet_bootstrap.cc:654] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:03.845996 15348 tablet_replica.cc:333] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:03.851686 13474 raft_consensus.cc:2468] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:03.854787 15328 ts_tablet_manager.cc:1929] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:03.855173 15328 log.cc:1199] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/0c4e37b80b7645c2a14f3ab0c5e919d2
I20260810 13:54:03.855911 15328 ts_tablet_manager.cc:1950] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:03.857223 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet d5aa1374d37a4918af34a5e9b15c16b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:03.859174 15348 raft_consensus.cc:2243] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:03.859784 15348 raft_consensus.cc:2272] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:03.863080 15348 ts_tablet_manager.cc:1916] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:03.864286 12951 leader_election.cc:304] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:03.865154 12951 leader_election.cc:304] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:03.865857 15547 raft_consensus.cc:2804] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:03.866309 15547 raft_consensus.cc:493] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:03.866771 15547 raft_consensus.cc:3060] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:03.874997 13209 consensus_meta.cc:287] T 4793f262a5e44f9e804c27092b110921 P 218e946161f64d1d92427684ac15e4fb: Time spent flushing consensus metadata: real 0.554s user 0.006s sys 0.002s
I20260810 13:54:03.876933 15501 raft_consensus.cc:2804] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:03.878048 15501 raft_consensus.cc:697] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:03.879246 15501 consensus_queue.cc:237] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.891464 15547 raft_consensus.cc:515] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.901317 13638 tablet_bootstrap.cc:492] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:03.909199 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef59f7013ab4489dadd9084d065533a8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:03.910061 13640 tablet_bootstrap.cc:492] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:03.910545 13640 ts_tablet_manager.cc:1403] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.092s user 0.009s sys 0.004s
I20260810 13:54:03.910135 13474 raft_consensus.cc:3060] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:03.914824 15507 raft_consensus.cc:493] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:03.915757 15507 raft_consensus.cc:515] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:03.917857 15547 leader_election.cc:290] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:03.918344 15507 leader_election.cc:290] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:03.950103 13640 raft_consensus.cc:359] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:03.950361 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_71513d2e5b514e3689dd3832681e181c" } modify_external_catalogs: true
I20260810 13:54:03.950766 13640 raft_consensus.cc:385] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:03.954059 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_72fd7834d8574cb1a74c1d08699d1f7e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:03.955729 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72fd7834d8574cb1a74c1d08699d1f7e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:03.958734 13640 raft_consensus.cc:740] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:03.961032 13640 consensus_queue.cc:260] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:03.971103 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:03.978255 13640 ts_tablet_manager.cc:1434] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.067s user 0.004s sys 0.004s
W20260810 13:54:03.984526 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 35317d87beb24a01b8df52b1cbba375c has no consensus state
I20260810 13:54:03.985778 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c04efa0403424fbcb37f7215ea9dcd8b" } modify_external_catalogs: true
I20260810 13:54:03.986435 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c04efa0403424fbcb37f7215ea9dcd8b" } modify_external_catalogs: true
I20260810 13:54:03.988435 15321 raft_consensus.cc:2243] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:03.988977 15321 raft_consensus.cc:2272] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:03.989637 13640 tablet_bootstrap.cc:492] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:03.990862 15321 ts_tablet_manager.cc:1916] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:03.993947 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_71513d2e5b514e3689dd3832681e181c" } modify_external_catalogs: true
I20260810 13:54:04.000639 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d42c8476514b71af3ce2fbc12270d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:04.009879 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4e37b80b7645c2a14f3ab0c5e919d2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:04.011435 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4cd2e5c73e467eb1bc4623e5d5e831" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:04.012048 13037 raft_consensus.cc:3060] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:04.022083 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.044245 13639 tablet_bootstrap.cc:492] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:04.050431 13639 ts_tablet_manager.cc:1403] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.369s user 0.006s sys 0.007s
I20260810 13:54:04.055891 13639 raft_consensus.cc:359] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.076215 15512 raft_consensus.cc:493] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:04.076851 15512 raft_consensus.cc:515] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:04.088246 15512 leader_election.cc:290] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.097718 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:04.098618 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.098896 13268 raft_consensus.cc:2393] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
W20260810 13:54:04.122349 13167 leader_election.cc:343] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: Tablet not RUNNING: SHUTDOWN
W20260810 13:54:04.123196 13167 leader_election.cc:343] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: ee27d158bd40425a8c6fa8cb068daa79
W20260810 13:54:04.124752 13167 leader_election.cc:343] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: eb5d7a695c694d1993c2d0c4d3127fca
I20260810 13:54:04.126390 15533 consensus_queue.cc:1048] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:04.108330 13474 raft_consensus.cc:2468] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:04.132753 15348 ts_tablet_manager.cc:1929] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:04.133251 15348 log.cc:1199] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/17df06cad1404d96bda5822be6a6e995
I20260810 13:54:04.134013 15348 ts_tablet_manager.cc:1950] T 17df06cad1404d96bda5822be6a6e995 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:04.131203 15505 consensus_queue.cc:1048] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:04.134907 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 410) took 4710 ms. Trace:
I20260810 13:54:04.135236 15348 rpcz_store.cc:276] 0810 13:53:59.424546 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.429546 (+ 5000us) service_pool.cc:224] Handling call
0810 13:54:03.845710 (+4416164us) ts_tablet_manager.cc:1151] Deleting tablet 17df06cad1404d96bda5822be6a6e995
0810 13:54:03.845804 (+ 94us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:03.956998 (+111194us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.096330 (+139332us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.134852 (+ 38522us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11445,"tablet-delete.queue_time_us":4406703}
I20260810 13:54:04.136850 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 17df06cad1404d96bda5822be6a6e995 (table default.Table_f101d8577cc1452ea2515229ebad2441 [id=eb2b695cdb5c4ee78dc155df3cc8e21f]) successfully deleted
I20260810 13:54:04.141124 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 409) took 4716 ms. Trace:
I20260810 13:54:04.149655 15525 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:42314 (request call id 430) took 1412 ms. Trace:
I20260810 13:54:04.152784 15348 rpcz_store.cc:276] 0810 13:53:59.424217 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.429958 (+ 5741us) service_pool.cc:224] Handling call
0810 13:54:04.140875 (+4710917us) ts_tablet_manager.cc:1151] Deleting tablet c4db9d7e82414cab8a69618effe89b40
0810 13:54:04.140914 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.141071 (+ 157us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4710272}
I20260810 13:54:04.150300 15525 rpcz_store.cc:276] 0810 13:54:02.733987 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.736793 (+ 2806us) service_pool.cc:224] Handling call
0810 13:54:04.145339 (+1408546us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:02.738021 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:02.738362 (+ 341us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:02.738404 (+ 42us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:02.738488 (+ 84us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:02.738607 (+ 119us) alter_schema_op.cc:128] START. Timestamp: 1786370042738496
0810 13:54:02.738626 (+ 19us) op_driver.cc:348] REPLICATION: starting
0810 13:54:02.739288 (+ 662us) log.cc:844] Serialized 173 byte log entry
0810 13:54:03.199676 (+460388us) op_driver.cc:464] REPLICATION: finished
0810 13:54:03.226661 (+ 26985us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:03.485643 (+258982us) log.cc:844] Serialized 5 byte log entry
0810 13:54:03.974942 (+489299us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:03.976319 (+ 1377us) log.cc:844] Serialized 14 byte log entry
0810 13:54:04.064562 (+ 88243us) alter_schema_op.cc:73] Released schema lock
0810 13:54:04.101245 (+ 36683us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":26692,"prepare.queue_time_us":223,"prepare.run_cpu_time_us":12529,"prepare.run_wall_time_us":74951,"replication_time_us":460816,"thread_start_us":81917,"threads_started":2,"wal-append.queue_time_us":217309}]]}
W20260810 13:54:04.157450 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet c4db9d7e82414cab8a69618effe89b40 because the tablet was not found. No further retry: Not found: Tablet not found: c4db9d7e82414cab8a69618effe89b40
I20260810 13:54:04.144397 13640 tablet_bootstrap.cc:654] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:04.159475 15348 tablet_replica.cc:333] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:04.176946 12739 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e] alter complete (version 3)
I20260810 13:54:04.064114 13037 raft_consensus.cc:2468] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:04.071400 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 427) took 1395 ms. Trace:
I20260810 13:54:04.087422 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:04.130740 12951 leader_election.cc:304] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:04.171572 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:52 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:04.198575 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 67915.8us
I20260810 13:54:04.200909 15501 raft_consensus.cc:2804] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:04.201599 15501 raft_consensus.cc:697] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:04.202849 15501 consensus_queue.cc:237] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:04.205073 13382 leader_election.cc:343] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.192082 15328 rpcz_store.cc:276] 0810 13:54:02.675990 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.676118 (+ 128us) service_pool.cc:224] Handling call
0810 13:54:03.395387 (+719269us) ts_tablet_manager.cc:1151] Deleting tablet 0c4e37b80b7645c2a14f3ab0c5e919d2
0810 13:54:03.395425 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:03.486701 (+ 91276us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:03.854572 (+367871us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.071339 (+216767us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":718717}
I20260810 13:54:04.191987 13639 raft_consensus.cc:385] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:04.208923 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 (table default.Table_17e523ba6a3b40999d198d9649600be4 [id=8aed385284dd4b4db81ca50f1541807c]) successfully deleted
I20260810 13:54:04.209007 13639 raft_consensus.cc:740] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:04.211977 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 431) took 1291 ms. Trace:
I20260810 13:54:04.212307 15328 rpcz_store.cc:276] 0810 13:54:02.920653 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.921109 (+ 456us) service_pool.cc:224] Handling call
0810 13:54:04.206151 (+1285042us) ts_tablet_manager.cc:1151] Deleting tablet 7a490fcb16164f968335f069129b3d71
0810 13:54:04.206200 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.211911 (+ 5711us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1284422}
I20260810 13:54:04.213716 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 433) took 1259 ms. Trace:
I20260810 13:54:04.214006 15328 rpcz_store.cc:276] 0810 13:54:02.954190 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.954303 (+ 113us) service_pool.cc:224] Handling call
0810 13:54:04.213315 (+1259012us) ts_tablet_manager.cc:1151] Deleting tablet c4ecf9abd60848f993234e98284974e8
0810 13:54:04.213361 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.213665 (+ 304us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1258388}
I20260810 13:54:04.215099 15328 tablet_replica.cc:333] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:04.215974 15328 raft_consensus.cc:2243] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
W20260810 13:54:04.218575 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 7a490fcb16164f968335f069129b3d71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a490fcb16164f968335f069129b3d71 already in progress: creating tablet
W20260810 13:54:04.219424 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet c4ecf9abd60848f993234e98284974e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4ecf9abd60848f993234e98284974e8 already in progress: creating tablet
I20260810 13:54:04.219496 15328 pending_rounds.cc:70] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:54:04.219892 15328 pending_rounds.cc:77] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971699832864768 op_type: NO_OP noop_request { }
I20260810 13:54:04.220285 15328 raft_consensus.cc:2889] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:04.220674 15328 raft_consensus.cc:2272] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:04.222908 15321 ts_tablet_manager.cc:1929] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:04.224553 15348 raft_consensus.cc:2243] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:04.225137 15348 raft_consensus.cc:2272] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:04.226037 15328 ts_tablet_manager.cc:1916] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:04.226908 15348 ts_tablet_manager.cc:1916] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:04.227521 13639 consensus_queue.cc:260] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.234701 13639 ts_tablet_manager.cc:1434] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.182s user 0.005s sys 0.001s
I20260810 13:54:04.236857 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ad5024a6b14845a2aaf72b7f2f6fba8c" } new_table_name: "default.Table_8eb7d73e845b48b6a2356ad6c1004d1f" modify_external_catalogs: true
I20260810 13:54:04.238610 15321 log.cc:1199] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/eb5d7a695c694d1993c2d0c4d3127fca
I20260810 13:54:04.239481 15321 ts_tablet_manager.cc:1950] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:04.239953 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 39ff3a48af494009bb53ee8d4e2a08cd
I20260810 13:54:04.250612 13421 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ff3a48af494009bb53ee8d4e2a08cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:54:04.259449 15471 lock_manager.cc:585] Waited 2 seconds to obtain row lock on key '<redacted>' (key hash 12749420330613191736) tablet 00000000000000000000000000000000 cur holder 0x7b5800043200
I20260810 13:54:04.265744 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9067fca42e9747aa95a4c21c97b3bb7f" } new_table_name: "default.Table_6652dc376ef94ce5bafda8bda3b043f2" modify_external_catalogs: true
I20260810 13:54:04.266594 13640 tablet_bootstrap.cc:492] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:04.267141 13640 ts_tablet_manager.cc:1403] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.278s user 0.005s sys 0.013s
I20260810 13:54:04.269904 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_87c087a440044f9483716cce60bb4777"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:04.271324 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87c087a440044f9483716cce60bb4777 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:04.273629 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ff3a48af494009bb53ee8d4e2a08cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:04.264104 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_8606de06b2994b3291a5ee1e28ad7100"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:04.279389 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8606de06b2994b3291a5ee1e28ad7100 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:04.285470 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 73ad47d29d61456891478a9544594a94
I20260810 13:54:04.290205 13427 tablet_service.cc:1558] Processing DeleteTablet for tablet 73ad47d29d61456891478a9544594a94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:04.293689 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet 73ad47d29d61456891478a9544594a94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:04.294880 15348 ts_tablet_manager.cc:1929] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:04.295428 15348 log.cc:1199] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/03c640dce5dd4fc8a49f07fb983c50eb
I20260810 13:54:04.296113 15348 ts_tablet_manager.cc:1950] T 03c640dce5dd4fc8a49f07fb983c50eb P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:54:04.299508 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b0b44a300d4b4f41854371735ecbab1a consensus state has no leader
I20260810 13:54:04.304637 13640 raft_consensus.cc:359] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:04.317922 13639 tablet_bootstrap.cc:492] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:04.332968 13640 raft_consensus.cc:385] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:04.334612 13640 raft_consensus.cc:740] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:04.335161 12995 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 32) took 1164 ms. Trace:
I20260810 13:54:04.335944 13640 consensus_queue.cc:260] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:04.324000 13167 leader_election.cc:304] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:04.336843 12995 rpcz_store.cc:276] 0810 13:54:03.171022 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.171216 (+ 194us) service_pool.cc:224] Handling call
0810 13:54:04.000552 (+829336us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b5400194a28. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f192822eb41 00007f19282bad1c 00007f1928ed84c0 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:04.207018 (+206466us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54001711d4. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:04.335091 (+128073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315477120}
I20260810 13:54:04.322391 15512 raft_consensus.cc:493] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:04.340000 15512 raft_consensus.cc:515] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.340504 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet 73ad47d29d61456891478a9544594a94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:04.307268 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 416) took 4881 ms. Trace:
I20260810 13:54:04.341363 15348 rpcz_store.cc:276] 0810 13:53:59.426295 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.430137 (+ 3842us) service_pool.cc:224] Handling call
0810 13:54:04.159310 (+4729173us) ts_tablet_manager.cc:1151] Deleting tablet 03c640dce5dd4fc8a49f07fb983c50eb
0810 13:54:04.159350 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.268864 (+109514us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.294709 (+ 25845us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.307204 (+ 12495us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64209,"tablet-delete.queue_time_us":4728627}
I20260810 13:54:04.342542 15348 tablet_replica.cc:333] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:04.342429 15512 leader_election.cc:290] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.343570 15348 raft_consensus.cc:2243] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:04.344013 15348 raft_consensus.cc:2272] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:04.344224 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 03c640dce5dd4fc8a49f07fb983c50eb (table default.Table_5306ac6359cd4033b2c54ad5db69828c [id=66a8a9b05b3a45f681081deace48b4a9]) successfully deleted
I20260810 13:54:04.345676 15348 ts_tablet_manager.cc:1916] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:54:04.349858 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet b0b44a300d4b4f41854371735ecbab1a (table default.Table_8eb7d73e845b48b6a2356ad6c1004d1f [id=96c5b88b61a54feb89f881fcc1e270f3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b0b44a300d4b4f41854371735ecbab1a consensus state has no leader
W20260810 13:54:04.355744 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d891e763a1854b6a8bda1071448fd8e0 consensus state has no leader
I20260810 13:54:04.358016 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ff3a48af494009bb53ee8d4e2a08cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:04.361529 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e93928dcb94ae296590c4dedfd1781" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:04.363996 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 393) took 4360 ms. Trace:
I20260810 13:54:04.364349 15321 rpcz_store.cc:276] 0810 13:53:59.989500 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.989673 (+ 173us) service_pool.cc:224] Handling call
0810 13:54:03.755834 (+3766161us) ts_tablet_manager.cc:1151] Deleting tablet eb5d7a695c694d1993c2d0c4d3127fca
0810 13:54:03.774877 (+ 19043us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.026184 (+251307us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.222771 (+196587us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.349625 (+126854us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207345,"tablet-delete.queue_time_us":3765417}
I20260810 13:54:04.366163 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet eb5d7a695c694d1993c2d0c4d3127fca (table default.Table_11e70bf5f071476d8ba0b19c299040e5 [id=b11aa3e242c34bc79d6ccc2d2dcfcda2]) successfully deleted
I20260810 13:54:04.367561 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.374833 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_09a6fde1eefc4ce0a591129d6ab65e3a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:04.376406 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09a6fde1eefc4ce0a591129d6ab65e3a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:04.350178 15466 raft_consensus.cc:2804] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
W20260810 13:54:04.386113 15568 log.cc:927] Time spent T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.073s user 0.001s sys 0.000s
I20260810 13:54:04.388953 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 394) took 4362 ms. Trace:
I20260810 13:54:04.389272 15321 rpcz_store.cc:276] 0810 13:54:00.026523 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.027517 (+ 994us) service_pool.cc:224] Handling call
0810 13:54:04.365355 (+4337838us) ts_tablet_manager.cc:1151] Deleting tablet c4db9d7e82414cab8a69618effe89b40
0810 13:54:04.368080 (+ 2725us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.388894 (+ 20814us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4337190}
I20260810 13:54:04.393759 15466 raft_consensus.cc:697] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:04.394647 15466 consensus_queue.cc:237] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.402946 13639 tablet_bootstrap.cc:654] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:04.423552 15525 tablet.cc:1724] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:04.432901 15321 tablet_replica.cc:333] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:04.433748 15321 raft_consensus.cc:2243] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:04.434271 15321 raft_consensus.cc:2272] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:04.436107 15321 ts_tablet_manager.cc:1916] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:04.438683 15328 ts_tablet_manager.cc:1929] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:04.439075 15328 log.cc:1199] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/ce9243eda3974532aff0425885f54166
I20260810 13:54:04.439740 15328 ts_tablet_manager.cc:1950] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:54:04.440937 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet c4db9d7e82414cab8a69618effe89b40 because the tablet was not found. No further retry: Not found: Tablet not found: c4db9d7e82414cab8a69618effe89b40
I20260810 13:54:04.450557 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c8b2a7d2d3d346898424ac950b04204b" } modify_external_catalogs: true
I20260810 13:54:04.451136 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c8b2a7d2d3d346898424ac950b04204b" } modify_external_catalogs: true
I20260810 13:54:04.463411 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2901b91576984ac4a165471a90e86a8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:04.464941 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2901b91576984ac4a165471a90e86a8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:04.452185 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.453075 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bfb69a7ce74175b4f1f5f4db583aa9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.453794 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8aea1057f445a9b060d138952324ca" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.366466 13640 ts_tablet_manager.cc:1434] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.099s user 0.005s sys 0.004s
W20260810 13:54:04.409862 13382 leader_election.cc:343] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:04.488036 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 78215.9us
I20260810 13:54:04.474579 15512 raft_consensus.cc:493] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:04.488905 15512 raft_consensus.cc:515] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:04.490737 15512 leader_election.cc:290] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.491973 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0683f961d4714cc28fd3d3401e967335" } modify_external_catalogs: true
I20260810 13:54:04.492480 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0683f961d4714cc28fd3d3401e967335" } modify_external_catalogs: true
I20260810 13:54:04.492954 13421 tablet_service.cc:1558] Processing DeleteTablet for tablet b820c99b33264add8df5fd443981d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:04.493080 13427 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e93928dcb94ae296590c4dedfd1781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:04.510484 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e93928dcb94ae296590c4dedfd1781" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.513124 15512 raft_consensus.cc:493] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:04.513871 15512 raft_consensus.cc:515] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.520042 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fc9bef2781f4046a30c5394fc5d5529" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:04.521440 13264 raft_consensus.cc:2393] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:04.523391 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.526654 13221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42314 (request call id 441) took 1068 ms. Trace:
I20260810 13:54:04.527940 15512 leader_election.cc:290] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.533625 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c4e37b80b7645c2a14f3ab0c5e919d2" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.544126 13260 raft_consensus.cc:2468] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:04.540506 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9243eda3974532aff0425885f54166" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:04.541018 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee27d158bd40425a8c6fa8cb068daa79" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.541963 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef59f7013ab4489dadd9084d065533a8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:04.545244 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4cd2e5c73e467eb1bc4623e5d5e831" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:04.545907 13468 raft_consensus.cc:3060] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:04.546321 13264 raft_consensus.cc:2393] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:04.547020 13221 rpcz_store.cc:276] 0810 13:54:03.458476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.488268 (+ 29792us) service_pool.cc:224] Handling call
0810 13:54:03.490127 (+ 1859us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:03.490236 (+ 109us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:04.028144 (+537908us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.526211 (+498067us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:04.526593 (+ 382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:04.554225 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef59f7013ab4489dadd9084d065533a8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.556177 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9243eda3974532aff0425885f54166" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.567423 13468 raft_consensus.cc:2468] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:04.568060 15512 raft_consensus.cc:493] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:04.568939 15512 raft_consensus.cc:515] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.587268 13639 tablet_bootstrap.cc:492] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:04.588192 13639 ts_tablet_manager.cc:1403] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.270s user 0.006s sys 0.007s
I20260810 13:54:04.592999 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee27d158bd40425a8c6fa8cb068daa79" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:04.597026 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:04.596773 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:04.600881 15501 raft_consensus.cc:493] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:04.596766 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:04.601595 15501 raft_consensus.cc:515] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.603674 13043 raft_consensus.cc:2468] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:04.607162 15501 leader_election.cc:290] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.614583 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 437) took 1419 ms. Trace:
I20260810 13:54:04.615090 15328 rpcz_store.cc:276] 0810 13:54:03.195059 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.195167 (+ 108us) service_pool.cc:224] Handling call
0810 13:54:04.214921 (+1019754us) ts_tablet_manager.cc:1151] Deleting tablet ce9243eda3974532aff0425885f54166
0810 13:54:04.214967 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.346948 (+131981us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.438555 (+ 91607us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.614524 (+175969us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1019220}
I20260810 13:54:04.616669 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet ce9243eda3974532aff0425885f54166 (table default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]) successfully deleted
I20260810 13:54:04.622519 15512 leader_election.cc:290] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.630918 15328 tablet_replica.cc:333] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:04.631138 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:04.632042 13474 raft_consensus.cc:2468] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:54:04.638973 13382 leader_election.cc:343] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.639714 13640 tablet_bootstrap.cc:492] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:04.639816 13382 leader_election.cc:343] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.642146 13382 leader_election.cc:304] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:04.646134 15419 raft_consensus.cc:2804] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:04.646498 15419 raft_consensus.cc:493] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:04.646904 15419 raft_consensus.cc:3060] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:04.651584 15328 raft_consensus.cc:2243] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:04.652351 15328 pending_rounds.cc:70] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:54:04.652604 15328 pending_rounds.cc:77] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971701117571072 op_type: NO_OP noop_request { }
I20260810 13:54:04.653064 15328 raft_consensus.cc:2889] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:04.653594 15328 raft_consensus.cc:2272] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:04.657351 13640 tablet_bootstrap.cc:654] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:04.658324 13382 leader_election.cc:304] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:04.660225 13382 leader_election.cc:343] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 1b84bd35b02f4a1faf15ac9bc21e6146
I20260810 13:54:04.592836 13639 raft_consensus.cc:359] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.661223 13639 raft_consensus.cc:385] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:04.644084 15580 tablet.cc:1724] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:04.663107 13382 leader_election.cc:304] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.664037 15512 raft_consensus.cc:2749] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:04.660730 15581 raft_consensus.cc:2749] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:04.661567 13639 raft_consensus.cc:740] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:04.664376 13382 leader_election.cc:343] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.667148 13639 consensus_queue.cc:260] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.669005 15419 raft_consensus.cc:515] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.670744 15574 tablet.cc:1724] T a0bfa7b61a334886b0bc1583c7d7fee9 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:04.674611 15525 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:42314 (request call id 438) took 1568 ms. Trace:
I20260810 13:54:04.675155 15525 rpcz_store.cc:276] 0810 13:54:03.106137 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.224630 (+118493us) service_pool.cc:224] Handling call
0810 13:54:04.674540 (+1449910us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:03.705589 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:03.706121 (+ 532us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:03.706153 (+ 32us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:03.706263 (+ 110us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:03.706444 (+ 181us) alter_schema_op.cc:128] START. Timestamp: 1786370043704964
0810 13:54:03.706473 (+ 29us) op_driver.cc:348] REPLICATION: starting
0810 13:54:03.707259 (+ 786us) log.cc:844] Serialized 173 byte log entry
0810 13:54:04.421965 (+714706us) op_driver.cc:464] REPLICATION: finished
0810 13:54:04.423432 (+ 1467us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:04.425976 (+ 2544us) log.cc:844] Serialized 5 byte log entry
0810 13:54:04.638024 (+212048us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.673481 (+ 35457us) log.cc:844] Serialized 14 byte log entry
0810 13:54:04.674380 (+ 899us) alter_schema_op.cc:73] Released schema lock
0810 13:54:04.674420 (+ 40us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1185,"prepare.queue_time_us":394881,"prepare.run_cpu_time_us":11405,"prepare.run_wall_time_us":310722,"replication_time_us":715311,"thread_start_us":307526,"threads_started":1,"wal-append.queue_time_us":295894}]]}
I20260810 13:54:04.682410 13639 ts_tablet_manager.cc:1434] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.094s user 0.007s sys 0.000s
I20260810 13:54:04.683182 15328 ts_tablet_manager.cc:1916] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:04.685213 15419 leader_election.cc:290] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.688627 12952 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:04.689484 15501 raft_consensus.cc:2749] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:04.689929 12952 leader_election.cc:304] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:04.690450 12952 raft_consensus.cc:2686] T 4fc9bef2781f4046a30c5394fc5d5529 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:54:04.694671 13639 tablet_bootstrap.cc:492] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:04.695789 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_cca21ae655de4f49a5b7db97db5814ac" } new_table_name: "default.Table_f98e5920f7d54537a56376403e71a0aa" modify_external_catalogs: true
I20260810 13:54:04.700806 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5d23780a98384a6e9889134a379e4570" } new_table_name: "default.Table_0e5dd5b3fe41426192ac5ea2177f974f" modify_external_catalogs: true
I20260810 13:54:04.702498 15580 tablet.cc:1724] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:04.711902 12740 master_service.cc:960] ReplaceTablet: received request to replace tablet 34b2314b771f41188bc8101c5ddffaf4 from {username='slave'} at 127.0.0.1:48758
I20260810 13:54:04.729753 12745 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c
I20260810 13:54:04.733047 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:04 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:04.736407 13221 tablet_service.cc:1558] Processing DeleteTablet for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:04 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:04.671703 15578 tablet.cc:1724] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:04.667820 13382 leader_election.cc:304] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:04.738555 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47159.4us
W20260810 13:54:04.739298 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 74941.4us
I20260810 13:54:04.740365 13164 leader_election.cc:304] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.742189 15419 raft_consensus.cc:2749] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:04.687531 15321 ts_tablet_manager.cc:1929] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:04.763681 15321 log.cc:1199] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/17df06cad1404d96bda5822be6a6e995
I20260810 13:54:04.764420 13382 leader_election.cc:304] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:04.765146 13382 raft_consensus.cc:2686] T 4fc9bef2781f4046a30c5394fc5d5529 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:54:04.767261 13382 leader_election.cc:304] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.767554 13639 tablet_bootstrap.cc:654] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:04.768016 15419 raft_consensus.cc:2749] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:04.769493 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_890e94f5e2914f4e9e3994ab8bc4075c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:04.771066 15321 ts_tablet_manager.cc:1950] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
W20260810 13:54:04.771224 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_890e94f5e2914f4e9e3994ab8bc4075c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:04.773202 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ec6618cc34614272b810138cd50001a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:04.774544 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec6618cc34614272b810138cd50001a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:04.777570 13382 leader_election.cc:343] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.777935 13382 leader_election.cc:304] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.778560 15419 raft_consensus.cc:2749] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:04.780844 13164 raft_consensus.cc:2686] T 17df06cad1404d96bda5822be6a6e995 P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:54:04.781550 13382 leader_election.cc:343] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:04.783038 13164 leader_election.cc:343] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: Tablet not RUNNING: STOPPED
I20260810 13:54:04.783053 13382 leader_election.cc:304] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.783509 13164 leader_election.cc:304] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.783660 15419 raft_consensus.cc:2749] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:04.784683 13382 leader_election.cc:343] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.784533 15535 raft_consensus.cc:2749] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:04.785161 13382 leader_election.cc:304] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.786087 15419 raft_consensus.cc:2749] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:04.787209 13382 leader_election.cc:343] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.787564 13382 leader_election.cc:304] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.788494 15587 raft_consensus.cc:2749] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:04.789665 13382 leader_election.cc:343] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.790134 13382 leader_election.cc:304] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.790619 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 395) took 4763 ms. Trace:
I20260810 13:54:04.790970 15321 rpcz_store.cc:276] 0810 13:54:00.026993 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.028827 (+ 1834us) service_pool.cc:224] Handling call
0810 13:54:04.412501 (+4383674us) ts_tablet_manager.cc:1151] Deleting tablet 17df06cad1404d96bda5822be6a6e995
0810 13:54:04.432780 (+ 20279us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.568624 (+135844us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.687417 (+118793us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.790554 (+103137us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4383094}
I20260810 13:54:04.792428 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 17df06cad1404d96bda5822be6a6e995 (table default.Table_f101d8577cc1452ea2515229ebad2441 [id=eb2b695cdb5c4ee78dc155df3cc8e21f]) successfully deleted
I20260810 13:54:04.793531 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 400) took 4170 ms. Trace:
I20260810 13:54:04.796463 15587 raft_consensus.cc:2749] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:04.798231 12951 leader_election.cc:304] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:04.799039 15501 raft_consensus.cc:2804] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:04.799431 15501 raft_consensus.cc:493] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:04.799950 15501 raft_consensus.cc:3060] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:04.808182 15501 raft_consensus.cc:515] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.811714 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:04.812476 13041 raft_consensus.cc:2393] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
W20260810 13:54:04.817773 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a17d73c65f544b7c8566fd874ee87a25 consensus state has no leader
I20260810 13:54:04.820317 13427 tablet_service.cc:1558] Processing DeleteTablet for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:04 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:04.821538 15501 leader_election.cc:290] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.837808 15348 ts_tablet_manager.cc:1929] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:04.837885 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:04.838277 15348 log.cc:1199] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/ee27d158bd40425a8c6fa8cb068daa79
I20260810 13:54:04.838846 13467 raft_consensus.cc:2393] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:04.839067 15348 ts_tablet_manager.cc:1950] T ee27d158bd40425a8c6fa8cb068daa79 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:04.839847 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 417) took 5413 ms. Trace:
I20260810 13:54:04.809059 13638 tablet_bootstrap.cc:654] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:04.844405 15321 rpcz_store.cc:276] 0810 13:54:00.622934 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.677866 (+ 54932us) service_pool.cc:224] Handling call
0810 13:54:04.793148 (+4115282us) ts_tablet_manager.cc:1151] Deleting tablet 48a059240c0f48ee958ef728acfcae92
0810 13:54:04.793192 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.793482 (+ 290us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4114702}
I20260810 13:54:04.845757 13639 tablet_bootstrap.cc:492] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
W20260810 13:54:04.845942 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 48a059240c0f48ee958ef728acfcae92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48a059240c0f48ee958ef728acfcae92 already in progress: creating tablet
I20260810 13:54:04.846184 13639 ts_tablet_manager.cc:1403] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.152s user 0.010s sys 0.003s
I20260810 13:54:04.848920 13639 raft_consensus.cc:359] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.849651 13639 raft_consensus.cc:385] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:04.849952 13639 raft_consensus.cc:740] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:04.824460 15328 ts_tablet_manager.cc:1929] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:04.850701 15328 log.cc:1199] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/ef59f7013ab4489dadd9084d065533a8
I20260810 13:54:04.851490 15328 ts_tablet_manager.cc:1950] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:54:04.836117 13164 leader_election.cc:343] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 0c4e37b80b7645c2a14f3ab0c5e919d2
I20260810 13:54:04.851933 13164 leader_election.cc:304] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.852726 15535 raft_consensus.cc:2749] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:04.852321 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 440) took 1468 ms. Trace:
I20260810 13:54:04.861344 15321 tablet_replica.cc:333] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:04.860936 15328 rpcz_store.cc:276] 0810 13:54:03.383864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.383989 (+ 125us) service_pool.cc:224] Handling call
0810 13:54:04.630728 (+1246739us) ts_tablet_manager.cc:1151] Deleting tablet ef59f7013ab4489dadd9084d065533a8
0810 13:54:04.630779 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.763491 (+132712us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.824324 (+ 60833us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.852264 (+ 27940us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1246162}
I20260810 13:54:04.862353 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet ef59f7013ab4489dadd9084d065533a8 (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]) successfully deleted
I20260810 13:54:04.863252 13639 consensus_queue.cc:260] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.865460 15321 raft_consensus.cc:2243] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:04.869330 13638 tablet_bootstrap.cc:492] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:04.869777 13638 ts_tablet_manager.cc:1403] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.969s user 0.011s sys 0.007s
I20260810 13:54:04.871557 13639 ts_tablet_manager.cc:1434] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.025s user 0.007s sys 0.000s
I20260810 13:54:04.872892 15535 consensus_queue.cc:1048] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:54:04.875554 13164 leader_election.cc:343] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: Tablet not RUNNING: STOPPED
I20260810 13:54:04.875986 13164 leader_election.cc:304] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:04.885098 15533 raft_consensus.cc:2749] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:04.886157 13638 raft_consensus.cc:359] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.886839 13638 raft_consensus.cc:385] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:04.887099 13638 raft_consensus.cc:740] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:04.887795 13638 consensus_queue.cc:260] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.890882 13638 ts_tablet_manager.cc:1434] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.021s user 0.004s sys 0.002s
I20260810 13:54:04.891873 13638 tablet_bootstrap.cc:492] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:04.897655 15321 raft_consensus.cc:2272] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:04.900008 15321 ts_tablet_manager.cc:1916] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:04.854374 13640 tablet_bootstrap.cc:492] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:04.867940 15587 raft_consensus.cc:493] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:04.900875 15587 raft_consensus.cc:515] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:04.903250 15587 leader_election.cc:290] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.903940 13640 ts_tablet_manager.cc:1403] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.264s user 0.008s sys 0.008s
I20260810 13:54:04.903829 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ff3a48af494009bb53ee8d4e2a08cd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:04.905563 13382 leader_election.cc:343] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.918691 15501 raft_consensus.cc:493] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:04.919137 15501 raft_consensus.cc:515] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.921212 15501 leader_election.cc:290] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.925073 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:04.907133 13164 leader_election.cc:343] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: eb5d7a695c694d1993c2d0c4d3127fca
I20260810 13:54:04.925889 13467 raft_consensus.cc:2468] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:04.926275 13164 leader_election.cc:304] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:04.926941 13164 raft_consensus.cc:2686] T eb5d7a695c694d1993c2d0c4d3127fca P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:54:04.927947 12951 leader_election.cc:304] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:04.928114 12994 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 33) took 1033 ms. Trace:
I20260810 13:54:04.928809 15535 consensus_queue.cc:1048] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:04.920148 13640 raft_consensus.cc:359] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:04.929450 13640 raft_consensus.cc:385] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:04.929692 13640 raft_consensus.cc:740] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:04.930341 15501 raft_consensus.cc:2804] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:04.930735 15501 raft_consensus.cc:493] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:04.930315 13640 consensus_queue.cc:260] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:04.930945 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.931167 15501 raft_consensus.cc:3060] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:04.932364 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.933830 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:04.939052 15512 raft_consensus.cc:493] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:04.939510 15512 raft_consensus.cc:515] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.941457 15512 leader_election.cc:290] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.943598 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:04.944921 13382 leader_election.cc:343] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:04.949173 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 447) took 1331 ms. Trace:
I20260810 13:54:04.949582 15328 rpcz_store.cc:276] 0810 13:54:03.617946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.618086 (+ 140us) service_pool.cc:224] Handling call
0810 13:54:04.870296 (+1252210us) ts_tablet_manager.cc:1151] Deleting tablet 00a7bce2378f482d81d2ad08e9d15b0c
0810 13:54:04.948697 (+ 78401us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.949112 (+ 415us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1251596}
W20260810 13:54:04.951409 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 00a7bce2378f482d81d2ad08e9d15b0c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00a7bce2378f482d81d2ad08e9d15b0c already in progress: creating tablet
I20260810 13:54:04.955051 15580 tablet.cc:1724] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:04.959172 13638 tablet_bootstrap.cc:654] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:04.900370 15348 rpcz_store.cc:276] 0810 13:53:59.426568 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.430669 (+ 4101us) service_pool.cc:224] Handling call
0810 13:54:04.342378 (+4911709us) ts_tablet_manager.cc:1151] Deleting tablet ee27d158bd40425a8c6fa8cb068daa79
0810 13:54:04.342431 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.612666 (+270235us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.837686 (+225020us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:04.839800 (+ 2114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4911252}
I20260810 13:54:04.960470 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet ee27d158bd40425a8c6fa8cb068daa79 (table default.Table_68361e8cbef04d1595cb882c8b2e25eb [id=cff2aea45beb46d3b2216174d77de8da]) successfully deleted
I20260810 13:54:04.928561 12994 rpcz_store.cc:276] 0810 13:54:03.894998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.895125 (+ 127us) service_pool.cc:224] Handling call
0810 13:54:04.928044 (+1032919us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816}
I20260810 13:54:04.964800 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_40ebe892a09b471581cb322124cf7630"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:04.966298 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40ebe892a09b471581cb322124cf7630 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:04.969344 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_da87a4b83c12422e999c5b88c825d890"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:04.970804 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da87a4b83c12422e999c5b88c825d890 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:04.971464 15594 tablet.cc:1724] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:04.972808 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:04.974525 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_12828de8d2fe4b32bf5d775a9ad9019b" } modify_external_catalogs: true
I20260810 13:54:04.948406 15501 raft_consensus.cc:515] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:04.975088 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_12828de8d2fe4b32bf5d775a9ad9019b" } modify_external_catalogs: true
I20260810 13:54:04.977483 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 448) took 1211 ms. Trace:
I20260810 13:54:04.977790 15328 rpcz_store.cc:276] 0810 13:54:03.766131 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.766241 (+ 110us) service_pool.cc:224] Handling call
0810 13:54:04.950622 (+1184381us) ts_tablet_manager.cc:1151] Deleting tablet bf672d15f88c4f0dbdf2fdb6aefa1108
0810 13:54:04.977112 (+ 26490us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:04.977424 (+ 312us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1143891}
W20260810 13:54:04.979645 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet bf672d15f88c4f0dbdf2fdb6aefa1108 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf672d15f88c4f0dbdf2fdb6aefa1108 already in progress: creating tablet
I20260810 13:54:04.979895 15501 leader_election.cc:290] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:04.980279 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:04.980959 13467 raft_consensus.cc:3060] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:04.988250 13467 raft_consensus.cc:2468] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:04.989698 12951 leader_election.cc:304] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:04.990561 15501 raft_consensus.cc:2804] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:04.990967 15348 tablet_replica.cc:333] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:04.991273 15501 raft_consensus.cc:697] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:04.992002 15348 raft_consensus.cc:2243] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:04.992089 15501 consensus_queue.cc:237] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.008263 12952 leader_election.cc:304] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:05.008975 12952 raft_consensus.cc:2686] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 88ed04d733ec447583fc897e233dd4b3: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:54:05.009698 12952 leader_election.cc:343] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:05.010452 12952 leader_election.cc:343] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.017102 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8dc89b56ec51450ab5cde9cd49f3c526" } new_table_name: "default.Table_ecf31f9a869a44ecad98460873c65372" modify_external_catalogs: true
W20260810 13:54:05.018733 12952 leader_election.cc:343] T ef59f7013ab4489dadd9084d065533a8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:05.020335 12952 leader_election.cc:343] T ce9243eda3974532aff0425885f54166 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.021948 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_579f9018ca714115bc18b1407243895e" } new_table_name: "default.Table_a59b3f3ad0b748d4a4fb33551877207c" modify_external_catalogs: true
I20260810 13:54:05.051846 15512 raft_consensus.cc:493] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:05.052302 15512 raft_consensus.cc:515] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:05.054348 15512 leader_election.cc:290] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:05.057124 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:05.060344 13382 leader_election.cc:343] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:05.064092 13382 leader_election.cc:343] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.064549 13382 leader_election.cc:304] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:05.065582 15587 raft_consensus.cc:2749] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:05.066068 13382 leader_election.cc:343] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:05.067482 13382 leader_election.cc:343] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.067866 13382 leader_election.cc:304] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:05.068979 15587 raft_consensus.cc:2749] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:05.069073 13640 ts_tablet_manager.cc:1434] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.165s user 0.002s sys 0.005s
W20260810 13:54:05.069947 13382 leader_election.cc:343] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.070194 13640 tablet_bootstrap.cc:492] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:05.070384 13382 leader_election.cc:304] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:05.071094 15587 raft_consensus.cc:2749] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:05.074306 12749 master_service.cc:960] ReplaceTablet: received request to replace tablet 39fd2ebed17e4c1e946d7783c41d15e6 from {username='slave'} at 127.0.0.1:48758
I20260810 13:54:05.075985 13640 tablet_bootstrap.cc:654] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:05.092856 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 449) took 1236 ms. Trace:
I20260810 13:54:05.093196 15328 rpcz_store.cc:276] 0810 13:54:03.856960 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.857073 (+ 113us) service_pool.cc:224] Handling call
0810 13:54:04.978649 (+1121576us) ts_tablet_manager.cc:1151] Deleting tablet d5aa1374d37a4918af34a5e9b15c16b3
0810 13:54:05.092455 (+113806us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.092792 (+ 337us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1120969}
I20260810 13:54:05.094904 15328 tablet_replica.cc:333] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:05.095685 15328 raft_consensus.cc:2243] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:05.096195 15328 raft_consensus.cc:2272] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:05.097357 13639 tablet_bootstrap.cc:492] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:05.097456 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:05.097558 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:05.098510 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:05.098821 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:05.091781 15535 raft_consensus.cc:493] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:05.099502 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:05.099874 15535 raft_consensus.cc:515] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:05.101109 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet d5aa1374d37a4918af34a5e9b15c16b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5aa1374d37a4918af34a5e9b15c16b3 already in progress: creating tablet
I20260810 13:54:05.101836 15535 leader_election.cc:290] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:05.101845 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 39ff3a48af494009bb53ee8d4e2a08cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39ff3a48af494009bb53ee8d4e2a08cd already in progress: creating tablet
I20260810 13:54:05.104354 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:05.083978 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ff3a48af494009bb53ee8d4e2a08cd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:05.105773 15574 tablet.cc:1724] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:05.105996 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c640dce5dd4fc8a49f07fb983c50eb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:05.108237 13041 raft_consensus.cc:2468] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:05.109522 13167 leader_election.cc:304] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:05.107535 15328 ts_tablet_manager.cc:1916] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:05.111899 15533 raft_consensus.cc:2804] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:05.112362 15533 raft_consensus.cc:493] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:05.112715 15533 raft_consensus.cc:3060] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:05.120021 15533 raft_consensus.cc:515] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:05.124486 12952 leader_election.cc:343] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.131880 13638 tablet_bootstrap.cc:492] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:05.132357 13638 ts_tablet_manager.cc:1403] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.241s user 0.016s sys 0.018s
W20260810 13:54:05.141732 12952 leader_election.cc:343] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.142432 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c640dce5dd4fc8a49f07fb983c50eb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:05.142977 13041 raft_consensus.cc:3060] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:05.143445 12952 leader_election.cc:343] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.147078 15321 ts_tablet_manager.cc:1929] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260810 13:54:05.147446 15321 log.cc:1199] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/5dac7ad18d3c4fb58171ff8ab959d98a
I20260810 13:54:05.148175 15321 ts_tablet_manager.cc:1950] T 5dac7ad18d3c4fb58171ff8ab959d98a P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:05.159185 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 403) took 4405 ms. Trace:
I20260810 13:54:05.159529 15321 rpcz_store.cc:276] 0810 13:54:00.753864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.754019 (+ 155us) service_pool.cc:224] Handling call
0810 13:54:04.846888 (+4092869us) ts_tablet_manager.cc:1151] Deleting tablet 5dac7ad18d3c4fb58171ff8ab959d98a
0810 13:54:04.861170 (+ 14282us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.043929 (+182759us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.146947 (+103018us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.159124 (+ 12177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31602,"tablet-delete.queue_time_us":4091918}
I20260810 13:54:05.160861 15321 tablet_replica.cc:333] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:05.161624 15321 raft_consensus.cc:2243] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:05.162127 15321 raft_consensus.cc:2272] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:05.163727 13638 raft_consensus.cc:359] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.164467 13638 raft_consensus.cc:385] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:05.169971 13638 raft_consensus.cc:740] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:05.170809 13638 consensus_queue.cc:260] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.177897 15321 ts_tablet_manager.cc:1916] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:05.179004 13638 ts_tablet_manager.cc:1434] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.046s user 0.008s sys 0.000s
I20260810 13:54:05.179989 13638 tablet_bootstrap.cc:492] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:05.103747 13639 tablet_bootstrap.cc:654] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:05.197350 15321 ts_tablet_manager.cc:1929] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:05.197708 15321 log.cc:1199] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/4fc9bef2781f4046a30c5394fc5d5529
I20260810 13:54:05.198429 15321 ts_tablet_manager.cc:1950] T 4fc9bef2781f4046a30c5394fc5d5529 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:05.207858 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 411) took 4169 ms. Trace:
I20260810 13:54:05.208214 15321 rpcz_store.cc:276] 0810 13:54:01.038465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.038643 (+ 178us) service_pool.cc:224] Handling call
0810 13:54:05.160615 (+4121972us) ts_tablet_manager.cc:1151] Deleting tablet 4fc9bef2781f4046a30c5394fc5d5529
0810 13:54:05.160714 (+ 99us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.187022 (+ 26308us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.197219 (+ 10197us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.207735 (+ 10516us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4120849}
I20260810 13:54:05.208643 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ecb9a9595610488796d066d45e53880a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:05.209475 15321 tablet_replica.cc:333] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:05.210203 15321 raft_consensus.cc:2243] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
W20260810 13:54:05.210505 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ecb9a9595610488796d066d45e53880a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:05.210949 15321 raft_consensus.cc:2272] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:05.217898 15533 leader_election.cc:290] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:05.218382 15321 ts_tablet_manager.cc:1916] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:05.238490 13041 raft_consensus.cc:2468] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
W20260810 13:54:05.242285 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe4755e4fcfd4af087ce5831a4e02022 consensus state has no leader
I20260810 13:54:05.250759 13167 leader_election.cc:304] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:05.262460 15471 lock_manager.cc:585] Waited 3 seconds to obtain row lock on key '<redacted>' (key hash 12749420330613191736) tablet 00000000000000000000000000000000 cur holder 0x7b5800043200
I20260810 13:54:05.265101 15466 raft_consensus.cc:2804] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:05.265537 15466 raft_consensus.cc:697] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:05.266248 15466 consensus_queue.cc:237] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.269745 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_0cd1166b3e534639918d41544e409ec7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:05.271184 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0cd1166b3e534639918d41544e409ec7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:05.276546 12952 leader_election.cc:343] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.277036 12952 leader_election.cc:304] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:05.279443 15501 raft_consensus.cc:2749] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:05.293057 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_5d1526181af947a2ae46e8e9e2718688 [id=9a3a9159f7634bc999c5c10834eb41d3]) successfully deleted
I20260810 13:54:05.293748 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 4fc9bef2781f4046a30c5394fc5d5529 (table default.Table_1efc108552b047538e81a19f9d985680 [id=b0c2c10c7abb49c0b0026662e9edba2a]) successfully deleted
I20260810 13:54:05.297484 13638 tablet_bootstrap.cc:654] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:05.298172 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d7ffb0f96e744a4bb734aba7f3d82995 consensus state has no leader
I20260810 13:54:05.075893 15594 tablet.cc:1724] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:05.081676 15348 raft_consensus.cc:2272] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:05.312485 13639 tablet_bootstrap.cc:492] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:05.312899 13639 ts_tablet_manager.cc:1403] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.216s user 0.017s sys 0.002s
I20260810 13:54:05.313023 15348 ts_tablet_manager.cc:1916] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:05.104139 15578 tablet.cc:1724] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 13:54:05.086942 13382 consensus_peers.cc:597] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:05.321821 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 250351us
W20260810 13:54:05.329557 13382 leader_election.cc:343] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.330057 13382 leader_election.cc:304] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:05.330776 15419 raft_consensus.cc:2749] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:05.338652 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_98fbef24cbef43679502dae9e67e35cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:05.339679 13382 leader_election.cc:343] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:05.340185 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98fbef24cbef43679502dae9e67e35cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:05.340214 13382 leader_election.cc:304] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:05.345889 15321 ts_tablet_manager.cc:1929] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:05.346395 15321 log.cc:1199] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/69a3a4d2724b42da83a523e208b5714b
I20260810 13:54:05.348044 15321 ts_tablet_manager.cc:1950] T 69a3a4d2724b42da83a523e208b5714b P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:05.349328 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 412) took 4242 ms. Trace:
I20260810 13:54:05.349624 15321 rpcz_store.cc:276] 0810 13:54:01.106641 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.106820 (+ 179us) service_pool.cc:224] Handling call
0810 13:54:05.209268 (+4102448us) ts_tablet_manager.cc:1151] Deleting tablet 69a3a4d2724b42da83a523e208b5714b
0810 13:54:05.209369 (+ 101us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.280538 (+ 71169us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.345703 (+ 65165us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.349273 (+ 3570us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4101379}
I20260810 13:54:05.351027 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 69a3a4d2724b42da83a523e208b5714b (table default.Table_85163b830b37444787dfe92a72503b29 [id=e4f461aca0304a8dba850e8d24b89841]) successfully deleted
I20260810 13:54:05.357568 13638 tablet_bootstrap.cc:492] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:05.358072 13638 ts_tablet_manager.cc:1403] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.178s user 0.015s sys 0.007s
W20260810 13:54:05.358052 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7ffb0f96e744a4bb734aba7f3d82995 consensus state has no leader
I20260810 13:54:05.358752 15419 raft_consensus.cc:2749] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:05.360208 13382 leader_election.cc:343] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:05.361946 13382 leader_election.cc:304] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:05.364908 15419 raft_consensus.cc:2749] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:05.378018 13639 raft_consensus.cc:359] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.378732 13639 raft_consensus.cc:385] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:05.379025 13639 raft_consensus.cc:740] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:05.379673 13639 consensus_queue.cc:260] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:05.382529 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 84621us
I20260810 13:54:05.384339 13638 raft_consensus.cc:359] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.385087 13638 raft_consensus.cc:385] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:05.385397 13638 raft_consensus.cc:740] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:05.386080 13638 consensus_queue.cc:260] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.388988 15328 ts_tablet_manager.cc:1929] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:54:05.389838 15328 log.cc:1199] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/73ad47d29d61456891478a9544594a94
I20260810 13:54:05.390691 13638 ts_tablet_manager.cc:1434] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260810 13:54:05.390719 15328 ts_tablet_manager.cc:1950] T 73ad47d29d61456891478a9544594a94 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:05.391650 15328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 451) took 1098 ms. Trace:
I20260810 13:54:05.392024 15328 rpcz_store.cc:276] 0810 13:54:04.293275 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.293434 (+ 159us) service_pool.cc:224] Handling call
0810 13:54:05.094757 (+801323us) ts_tablet_manager.cc:1151] Deleting tablet 73ad47d29d61456891478a9544594a94
0810 13:54:05.094795 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.231629 (+136834us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.388841 (+157212us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.391594 (+ 2753us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":800557}
I20260810 13:54:05.393890 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 73ad47d29d61456891478a9544594a94 (table default.Table_c04efa0403424fbcb37f7215ea9dcd8b [id=41ab72dabf7e4cbaaa1c8010766780c4]) successfully deleted
W20260810 13:54:05.394735 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c already in progress: creating tablet
I20260810 13:54:05.396431 13638 tablet_bootstrap.cc:492] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:05.404911 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5388dd61e30949a5a2b9c07a35637080"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:05.406387 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5388dd61e30949a5a2b9c07a35637080 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:05.423131 13638 tablet_bootstrap.cc:654] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:05.424683 13640 tablet_bootstrap.cc:492] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:05.425385 13640 ts_tablet_manager.cc:1403] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.355s user 0.006s sys 0.005s
I20260810 13:54:05.426707 13639 ts_tablet_manager.cc:1434] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.114s user 0.004s sys 0.001s
I20260810 13:54:05.427721 13639 tablet_bootstrap.cc:492] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:05.431979 15535 consensus_queue.cc:1048] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:05.437721 13640 raft_consensus.cc:359] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:05.442734 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 74951.9us
W20260810 13:54:05.447196 13164 leader_election.cc:343] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 03c640dce5dd4fc8a49f07fb983c50eb
W20260810 13:54:05.448280 13164 leader_election.cc:343] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 03c640dce5dd4fc8a49f07fb983c50eb
I20260810 13:54:05.454862 13640 raft_consensus.cc:385] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:05.456849 13640 raft_consensus.cc:740] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:05.459110 13640 consensus_queue.cc:260] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:05.454464 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 414) took 4346 ms. Trace:
I20260810 13:54:05.466022 15321 rpcz_store.cc:276] 0810 13:54:01.107620 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.107733 (+ 113us) service_pool.cc:224] Handling call
0810 13:54:05.449073 (+4341340us) ts_tablet_manager.cc:1151] Deleting tablet cab5c35fa6b440a7bc4ebe2709fbfc60
0810 13:54:05.453880 (+ 4807us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.454405 (+ 525us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4340803}
W20260810 13:54:05.467694 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet cab5c35fa6b440a7bc4ebe2709fbfc60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cab5c35fa6b440a7bc4ebe2709fbfc60 already in progress: creating tablet
I20260810 13:54:05.477134 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 419) took 4299 ms. Trace:
I20260810 13:54:05.478085 15321 rpcz_store.cc:276] 0810 13:54:01.177290 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.177395 (+ 105us) service_pool.cc:224] Handling call
0810 13:54:05.468713 (+4291318us) ts_tablet_manager.cc:1151] Deleting tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2
0810 13:54:05.476712 (+ 7999us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.477073 (+ 361us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4290671}
I20260810 13:54:05.483547 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b83389f8c6794e7bbfa97ae916d990cd" } new_table_name: "default.Table_71249f4d7f1441569904285eb7dc50e8" modify_external_catalogs: true
I20260810 13:54:05.486284 13640 ts_tablet_manager.cc:1434] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.061s user 0.007s sys 0.001s
I20260810 13:54:05.482815 13638 tablet_bootstrap.cc:492] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:05.491567 13638 ts_tablet_manager.cc:1403] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.095s user 0.006s sys 0.012s
W20260810 13:54:05.492029 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 already in progress: creating tablet
I20260810 13:54:05.493484 15608 raft_consensus.cc:493] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:05.494096 15608 raft_consensus.cc:515] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.495688 13638 raft_consensus.cc:359] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.496429 13638 raft_consensus.cc:385] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:05.497530 15608 leader_election.cc:290] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:05.500525 15574 tablet.cc:1724] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:05.507463 13640 tablet_bootstrap.cc:492] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:05.508139 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:05.505443 13638 raft_consensus.cc:740] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:05.509518 13638 consensus_queue.cc:260] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.512050 13638 ts_tablet_manager.cc:1434] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.020s user 0.003s sys 0.003s
I20260810 13:54:05.517143 13049 raft_consensus.cc:2393] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:05.553471 13639 tablet_bootstrap.cc:654] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:05.555477 13638 tablet_bootstrap.cc:492] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:05.581406 12739 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 92) took 1094 ms (client timeout 1000 ms). Trace:
W20260810 13:54:05.581789 12739 rpcz_store.cc:269] 0810 13:54:04.487067 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.487182 (+ 115us) service_pool.cc:224] Handling call
0810 13:54:05.581330 (+1094148us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260810 13:54:05.582715 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:54:05.583706 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 2e5ad84fe2604dd2959768db31f66e7c (table default.Table_76e484f1a993422f9e6916f20d5cab02 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]). Expected version 1 got 0
W20260810 13:54:05.595988 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 96242.4us
I20260810 13:54:05.461694 15348 ts_tablet_manager.cc:1929] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:05.602794 15348 log.cc:1199] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/69a3a4d2724b42da83a523e208b5714b
I20260810 13:54:05.604013 15348 ts_tablet_manager.cc:1950] T 69a3a4d2724b42da83a523e208b5714b P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:05.612540 13007 tablet_service.cc:1511] Processing CreateTablet for tablet d0e488e3e89047b18178c9cb64d74bef (DEFAULT_TABLE table=default.Table_5818235bc6094cb69999b2a6a1552d79 [id=5746ef7caeef407f98af956e742d7343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.613852 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e488e3e89047b18178c9cb64d74bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.618037 12745 catalog_manager.cc:5719] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:05.619472 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_76e484f1a993422f9e6916f20d5cab02" } new_table_name: "default.Table_e5c2c6ef6f4646a88704beb1cd464c47" modify_external_catalogs: true
I20260810 13:54:05.619480 12745 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet fe4755e4fcfd4af087ce5831a4e02022 (table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9]). Expected version 1 got 0
I20260810 13:54:05.621585 13639 tablet_bootstrap.cc:492] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:05.622449 13639 ts_tablet_manager.cc:1403] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.195s user 0.008s sys 0.011s
I20260810 13:54:05.623437 12745 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:54:05.635315 13221 tablet_service.cc:1511] Processing CreateTablet for tablet d0e488e3e89047b18178c9cb64d74bef (DEFAULT_TABLE table=default.Table_5818235bc6094cb69999b2a6a1552d79 [id=5746ef7caeef407f98af956e742d7343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.636438 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e488e3e89047b18178c9cb64d74bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.640005 13012 tablet_service.cc:1558] Processing DeleteTablet for tablet ce9243eda3974532aff0425885f54166 with delete_type TABLET_DATA_DELETED (replaced by tablet f19e7aa805bd417eae45fb43ac18a66d) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:05.640262 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 with delete_type TABLET_DATA_DELETED (replaced by tablet 97015b4984c74a4682b6dedd47dc6650) from {username='slave'} at 127.0.0.1:50548
W20260810 13:54:05.641216 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3f4b863f701471ab173b68049b1a602 consensus state has no leader
I20260810 13:54:05.642421 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet ef59f7013ab4489dadd9084d065533a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57fc6408d6664e9887b150d1cb934a8d) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:05.642421 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_bc50dbac8249499e90b8d763fd7041f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:05.644984 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc50dbac8249499e90b8d763fd7041f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:05.645149 15328 tablet_replica.cc:333] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:05.646271 15328 raft_consensus.cc:2243] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 13:54:05.646907 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ce9243eda3974532aff0425885f54166 because the tablet was not found. No further retry: Not found: Tablet not found: ce9243eda3974532aff0425885f54166
I20260810 13:54:05.646936 15328 raft_consensus.cc:2272] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:05.654713 15328 ts_tablet_manager.cc:1916] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:05.655457 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5616cea29148a49ac6db261351f460 (DEFAULT_TABLE table=default.Table_5967f54814d04534b6a591a3bf9a4e8e [id=fd3f5c353a584a6b9d955543762bb8c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.656520 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5616cea29148a49ac6db261351f460. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:05.680444 12750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 94) took 1268 ms (client timeout 1000 ms). Trace:
W20260810 13:54:05.681042 12750 rpcz_store.cc:269] 0810 13:54:04.412275 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.412463 (+ 188us) service_pool.cc:224] Handling call
0810 13:54:05.680367 (+1267904us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":6}
I20260810 13:54:05.686877 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b9529457562e49f380c06dc35ced9cfd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:05.689782 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 34b2314b771f41188bc8101c5ddffaf4
I20260810 13:54:05.691480 12744 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 602) took 1200 ms. Trace:
I20260810 13:54:05.693708 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 39fd2ebed17e4c1e946d7783c41d15e6
I20260810 13:54:05.691836 12744 rpcz_store.cc:276] 0810 13:54:04.491567 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.491692 (+ 125us) service_pool.cc:224] Handling call
0810 13:54:04.492913 (+ 1221us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:54:04.493454 (+ 541us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:54:04.493616 (+ 162us) catalog_manager.cc:2850] Locking tablets
0810 13:54:05.584996 (+1091380us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:54:05.685229 (+100233us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:54:05.685448 (+ 219us) catalog_manager.cc:2898] Committing in-memory state
0810 13:54:05.685546 (+ 98us) catalog_manager.cc:2902] Aborting table tasks
0810 13:54:05.691426 (+ 5880us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:05.647673 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:05.648013 (+ 340us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:05.648035 (+ 22us) write_op.cc:435] Acquired schema lock
0810 13:54:05.648047 (+ 12us) tablet.cc:662] Decoding operations
0810 13:54:05.648397 (+ 350us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:05.648448 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:05.648470 (+ 22us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:05.648980 (+ 510us) tablet.cc:701] Row locks acquired
0810 13:54:05.648994 (+ 14us) write_op.cc:260] PREPARE: finished
0810 13:54:05.649115 (+ 121us) write_op.cc:270] Start()
0810 13:54:05.649207 (+ 92us) write_op.cc:276] Timestamp: P: 1786370045649079 usec, L: 0
0810 13:54:05.649231 (+ 24us) op_driver.cc:348] REPLICATION: starting
0810 13:54:05.649863 (+ 632us) log.cc:844] Serialized 756 byte log entry
0810 13:54:05.664219 (+ 14356us) op_driver.cc:464] REPLICATION: finished
0810 13:54:05.677870 (+ 13651us) write_op.cc:301] APPLY: starting
0810 13:54:05.677945 (+ 75us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:05.678108 (+ 163us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:05.678235 (+ 127us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:05.678702 (+ 467us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:05.679124 (+ 422us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:54:05.679193 (+ 69us) write_op.cc:312] APPLY: finished
0810 13:54:05.679456 (+ 263us) log.cc:844] Serialized 29 byte log entry
0810 13:54:05.682770 (+ 3314us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:05.682894 (+ 124us) write_op.cc:454] Released schema lock
0810 13:54:05.682951 (+ 57us) write_op.cc:341] FINISH: Updating metrics
0810 13:54:05.685867 (+ 2916us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:05.685926 (+ 59us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4119,"child_traces":[["op",{"apply.queue_time_us":13389,"apply.run_cpu_time_us":2389,"apply.run_wall_time_us":8004,"num_ops":2,"prepare.queue_time_us":60698,"prepare.run_cpu_time_us":2219,"prepare.run_wall_time_us":2468,"raft.queue_time_us":1073,"raft.run_cpu_time_us":1243,"raft.run_wall_time_us":26300,"replication_time_us":14847}]]}
I20260810 13:54:05.695399 12749 catalog_manager.cc:6807] ReplaceTablet: tablet 39fd2ebed17e4c1e946d7783c41d15e6 deleted and replaced by tablet 5642cf1c59e240b7885317c4482a7704
W20260810 13:54:05.688545 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9529457562e49f380c06dc35ced9cfd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:05.707015 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 421) took 4525 ms. Trace:
I20260810 13:54:05.707257 13638 tablet_bootstrap.cc:654] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:05.707406 15321 rpcz_store.cc:276] 0810 13:54:01.181907 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.182024 (+ 117us) service_pool.cc:224] Handling call
0810 13:54:05.502965 (+4320941us) ts_tablet_manager.cc:1151] Deleting tablet 6406062bb0934eadae901502806178b5
0810 13:54:05.540767 (+ 37802us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.706942 (+166175us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4317464}
W20260810 13:54:05.708484 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 102414us
W20260810 13:54:05.725064 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 6406062bb0934eadae901502806178b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6406062bb0934eadae901502806178b5 already in progress: creating tablet
I20260810 13:54:05.728279 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5616cea29148a49ac6db261351f460 (DEFAULT_TABLE table=default.Table_5967f54814d04534b6a591a3bf9a4e8e [id=fd3f5c353a584a6b9d955543762bb8c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.731053 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5616cea29148a49ac6db261351f460. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.732666 13012 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b2314b771f41188bc8101c5ddffaf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:04 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:05.737468 15321 tablet_replica.cc:333] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:05.734045 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 30a5adc9446543eb91f5a1c0f0859c31 (DEFAULT_TABLE table=default.Table_b33cb4c7a80141c49d306885213f30a9 [id=7dff57e81c064728a8160d5c02c11de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.739173 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet 39fd2ebed17e4c1e946d7783c41d15e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5642cf1c59e240b7885317c4482a7704) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:05.740422 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a5adc9446543eb91f5a1c0f0859c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.745759 13215 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b2314b771f41188bc8101c5ddffaf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:04 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:05.747740 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet 39fd2ebed17e4c1e946d7783c41d15e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5642cf1c59e240b7885317c4482a7704) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:05.684894 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a7e503c1cea04f7dbe5a53f7237e60c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:05.754614 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:05.718622 15535 consensus_queue.cc:1048] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260810 13:54:05.771339 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 30a5adc9446543eb91f5a1c0f0859c31 (DEFAULT_TABLE table=default.Table_b33cb4c7a80141c49d306885213f30a9 [id=7dff57e81c064728a8160d5c02c11de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.772464 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a5adc9446543eb91f5a1c0f0859c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.778439 13215 tablet_service.cc:1511] Processing CreateTablet for tablet ae74d69055ee4aa395c0f628864242e3 (DEFAULT_TABLE table=default.Table_6964fe82ae0c4d96a86d800f82062b3e [id=83fc760e794d422d8614bf728e3e47df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.779455 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae74d69055ee4aa395c0f628864242e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.787724 13639 raft_consensus.cc:359] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.788497 13639 raft_consensus.cc:385] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:05.788826 13639 raft_consensus.cc:740] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:05.789523 13639 consensus_queue.cc:260] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.734115 15501 raft_consensus.cc:493] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:05.791363 15501 raft_consensus.cc:515] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.793567 15501 leader_election.cc:290] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:05.798928 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 171381us
W20260810 13:54:05.804837 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 94857.4us
I20260810 13:54:05.818576 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:05.819243 13261 raft_consensus.cc:2468] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:05.819610 15321 raft_consensus.cc:2243] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:05.820909 12952 leader_election.cc:304] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:05.821035 15466 raft_consensus.cc:493] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:05.821473 15466 raft_consensus.cc:515] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.821985 15321 raft_consensus.cc:2272] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:05.822923 13639 ts_tablet_manager.cc:1434] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.142s user 0.005s sys 0.004s
I20260810 13:54:05.823640 15466 leader_election.cc:290] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:05.823969 13639 tablet_bootstrap.cc:492] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:05.828483 13638 tablet_bootstrap.cc:492] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
W20260810 13:54:05.828732 13167 leader_election.cc:343] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: ce9243eda3974532aff0425885f54166
I20260810 13:54:05.828969 13638 ts_tablet_manager.cc:1403] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.274s user 0.008s sys 0.013s
I20260810 13:54:05.831175 15633 raft_consensus.cc:2804] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:05.831533 15633 raft_consensus.cc:493] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:05.831566 13004 tablet_service.cc:1511] Processing CreateTablet for tablet ae74d69055ee4aa395c0f628864242e3 (DEFAULT_TABLE table=default.Table_6964fe82ae0c4d96a86d800f82062b3e [id=83fc760e794d422d8614bf728e3e47df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.831900 15633 raft_consensus.cc:3060] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:05.832810 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae74d69055ee4aa395c0f628864242e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.833613 15321 ts_tablet_manager.cc:1916] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:05.831710 13638 raft_consensus.cc:359] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.842206 13638 raft_consensus.cc:385] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:05.847234 13639 tablet_bootstrap.cc:654] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:05.847643 13638 raft_consensus.cc:740] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:54:05.848173 12952 consensus_peers.cc:597] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:05.854950 13638 consensus_queue.cc:260] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.857174 13638 ts_tablet_manager.cc:1434] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.028s user 0.004s sys 0.002s
I20260810 13:54:05.857921 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet a7fb3f80f940435a902c355cb699b434
I20260810 13:54:05.868476 15321 ts_tablet_manager.cc:1929] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:05.869055 15321 log.cc:1199] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/ab4cd2e5c73e467eb1bc4623e5d5e831
I20260810 13:54:05.869877 15321 ts_tablet_manager.cc:1950] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:05.871160 15328 ts_tablet_manager.cc:1929] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:05.871572 15328 log.cc:1199] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/ab4cd2e5c73e467eb1bc4623e5d5e831
I20260810 13:54:05.872428 15328 ts_tablet_manager.cc:1950] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:05.874105 13012 tablet_service.cc:1558] Processing DeleteTablet for tablet a7fb3f80f940435a902c355cb699b434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:04 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:05.874831 13216 tablet_service.cc:1558] Processing DeleteTablet for tablet a7fb3f80f940435a902c355cb699b434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:04 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:05.876740 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 9752c50dac794b3f9e6430e982d9cbe2 (DEFAULT_TABLE table=default.Table_f835565354f042368700f4252335e8eb [id=84ca48404db8439697f8035aa3bc34d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.877760 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 9752c50dac794b3f9e6430e982d9cbe2 (DEFAULT_TABLE table=default.Table_f835565354f042368700f4252335e8eb [id=84ca48404db8439697f8035aa3bc34d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.895054 13342 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:54:05.876217 15633 raft_consensus.cc:515] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:05.900251 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 298905us
I20260810 13:54:05.905189 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 422) took 4722 ms. Trace:
I20260810 13:54:05.905828 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752c50dac794b3f9e6430e982d9cbe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.906316 13638 tablet_bootstrap.cc:492] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:05.905562 15321 rpcz_store.cc:276] 0810 13:54:01.182388 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.182491 (+ 103us) service_pool.cc:224] Handling call
0810 13:54:05.730547 (+4548056us) ts_tablet_manager.cc:1151] Deleting tablet ab4cd2e5c73e467eb1bc4623e5d5e831
0810 13:54:05.737258 (+ 6711us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.821357 (+ 84099us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b54000c4254. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f911eaac951 00007f911eb4b742 00007f911ef8bd2c 00007f911fbf341a 00007f911fc240e0 00007f911fc0a64d 00007f911fc0a5f9 00007f911fc0a589 00007f911fc0a551 00007f911fc0977d 00000000005bd8c4
0810 13:54:05.861193 (+ 39836us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.868354 (+ 7161us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.905106 (+ 36752us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21360,"spinlock_wait_cycles":137642752,"tablet-delete.queue_time_us":4532196}
I20260810 13:54:05.908674 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 423) took 4725 ms. Trace:
I20260810 13:54:05.909008 15321 rpcz_store.cc:276] 0810 13:54:01.262103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.297725 (+ 35622us) service_pool.cc:224] Handling call
0810 13:54:05.908203 (+4610478us) ts_tablet_manager.cc:1151] Deleting tablet 674599456f9a49dc98d8d089c166ca89
0810 13:54:05.908266 (+ 63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.908617 (+ 351us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4609727}
I20260810 13:54:05.910013 15321 tablet_replica.cc:333] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:05.910786 15321 raft_consensus.cc:2243] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:05.911784 15321 raft_consensus.cc:2272] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:05.913540 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet ab4cd2e5c73e467eb1bc4623e5d5e831 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]) successfully deleted
W20260810 13:54:05.914304 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 674599456f9a49dc98d8d089c166ca89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 674599456f9a49dc98d8d089c166ca89 already in progress: creating tablet
I20260810 13:54:05.924451 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 411) took 6499 ms. Trace:
I20260810 13:54:05.925046 15348 rpcz_store.cc:276] 0810 13:53:59.424911 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.431261 (+ 6350us) service_pool.cc:224] Handling call
0810 13:54:04.990733 (+5559472us) ts_tablet_manager.cc:1151] Deleting tablet 69a3a4d2724b42da83a523e208b5714b
0810 13:54:04.990784 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.327516 (+336732us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.461567 (+134051us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:05.924074 (+462507us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":314402,"tablet-delete.queue_time_us":5472333}
I20260810 13:54:05.930936 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 405) took 6547 ms. Trace:
I20260810 13:54:05.931488 15348 rpcz_store.cc:276] 0810 13:53:59.383708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.385146 (+ 1438us) service_pool.cc:224] Handling call
0810 13:54:05.927641 (+6542495us) ts_tablet_manager.cc:1151] Deleting tablet 4dea61b84b614ead8830873568f9b7c4
0810 13:54:05.927779 (+ 138us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:05.930860 (+ 3081us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6384159}
I20260810 13:54:05.933071 15348 tablet_replica.cc:333] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:05.933123 15611 raft_consensus.cc:493] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:05.933647 15611 raft_consensus.cc:515] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.936378 15611 leader_election.cc:290] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:05.938088 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:05.950042 15321 ts_tablet_manager.cc:1916] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:05.951172 13638 tablet_bootstrap.cc:654] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:05.951478 13121 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:54:05.945935 15611 raft_consensus.cc:493] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:05.952075 15611 raft_consensus.cc:515] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:05.960103 13639 tablet_bootstrap.cc:492] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:05.964028 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_de488738829d49dbb554c8fb0d854bd5" } modify_external_catalogs: true
I20260810 13:54:05.964607 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_de488738829d49dbb554c8fb0d854bd5" } modify_external_catalogs: true
I20260810 13:54:05.969692 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_640c451fefef49f3a4960de11632ca5a" } new_table_name: "default.Table_afeb77a530a74b35991ae4d4400af3e3" modify_external_catalogs: true
I20260810 13:54:05.973511 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ec24cdc578624353b8936b6a7add0b7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:05.975114 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec24cdc578624353b8936b6a7add0b7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:05.978667 15611 leader_election.cc:290] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:05.983760 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet ab4cd2e5c73e467eb1bc4623e5d5e831 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]) successfully deleted
W20260810 13:54:05.985716 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ef59f7013ab4489dadd9084d065533a8 because the tablet was not found. No further retry: Not found: Tablet not found: ef59f7013ab4489dadd9084d065533a8
W20260810 13:54:05.987237 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 34b2314b771f41188bc8101c5ddffaf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34b2314b771f41188bc8101c5ddffaf4 already in progress: creating tablet
I20260810 13:54:05.940208 13640 tablet_bootstrap.cc:654] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:05.982353 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:05.997797 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:05.998373 13261 raft_consensus.cc:3060] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:05.998944 13221 tablet_service.cc:1511] Processing CreateTablet for tablet 7a07cf0ebb0f4bc6816c119a4b2af17f (DEFAULT_TABLE table=default.Table_51b05316075a49bc898ede0e35031c70 [id=359af78e1c844299a56756c90613d641]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:05.999820 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 39fd2ebed17e4c1e946d7783c41d15e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39fd2ebed17e4c1e946d7783c41d15e6 already in progress: creating tablet
W20260810 13:54:06.000598 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet a7fb3f80f940435a902c355cb699b434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7fb3f80f940435a902c355cb699b434 already in progress: creating tablet
I20260810 13:54:06.003485 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 788ac374894c437fa8644493b7678747 (DEFAULT_TABLE table=default.Table_c752da6252ce4541be9cef2bce47bfe3 [id=178f273145a74eb2a2de7da53f248126]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.006373 13261 raft_consensus.cc:2468] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:06.007993 13465 raft_consensus.cc:2468] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:06.008229 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:06.008934 13467 raft_consensus.cc:3060] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:06.010396 12739 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:54:06.012482 12747 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_76e484f1a993422f9e6916f20d5cab02 [id=5dfc52d4cd2c46c784bb2d99146b4dd0] alter complete (version 1)
I20260810 13:54:06.019960 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a07cf0ebb0f4bc6816c119a4b2af17f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:06.020534 12747 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 91) took 1010 ms (client timeout 1000 ms). Trace:
W20260810 13:54:06.024732 12747 rpcz_store.cc:269] 0810 13:54:05.009759 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:05.009901 (+ 142us) service_pool.cc:224] Handling call
0810 13:54:06.020466 (+1010565us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:05.652200 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:05.652537 (+ 337us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:05.652559 (+ 22us) write_op.cc:435] Acquired schema lock
0810 13:54:05.652570 (+ 11us) tablet.cc:662] Decoding operations
0810 13:54:05.707533 (+ 54963us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:05.707582 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:05.707604 (+ 22us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:54:05.707768 (+ 164us) tablet.cc:701] Row locks acquired
0810 13:54:05.707781 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:54:05.707912 (+ 131us) write_op.cc:270] Start()
0810 13:54:05.708006 (+ 94us) write_op.cc:276] Timestamp: P: 1786370045707865 usec, L: 0
0810 13:54:05.708025 (+ 19us) op_driver.cc:348] REPLICATION: starting
0810 13:54:05.708862 (+ 837us) log.cc:844] Serialized 356 byte log entry
0810 13:54:05.766381 (+ 57519us) op_driver.cc:464] REPLICATION: finished
0810 13:54:05.769679 (+ 3298us) write_op.cc:301] APPLY: starting
0810 13:54:05.769793 (+ 114us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:05.769926 (+ 133us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:05.770083 (+ 157us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:05.770282 (+ 199us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:05.770476 (+ 194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:54:05.770575 (+ 99us) write_op.cc:312] APPLY: finished
0810 13:54:05.770799 (+ 224us) log.cc:844] Serialized 23 byte log entry
0810 13:54:05.770964 (+ 165us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:05.771035 (+ 71us) write_op.cc:454] Released schema lock
0810 13:54:05.771082 (+ 47us) write_op.cc:341] FINISH: Updating metrics
0810 13:54:05.771390 (+ 308us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:05.771443 (+ 53us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":3063,"apply.run_cpu_time_us":1640,"apply.run_wall_time_us":1641,"num_ops":1,"prepare.queue_time_us":47451,"prepare.run_cpu_time_us":2239,"prepare.run_wall_time_us":57144,"raft.queue_time_us":1892,"raft.run_cpu_time_us":1342,"raft.run_wall_time_us":1344,"replication_time_us":58227}]]}
I20260810 13:54:06.028954 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:06.031025 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:06.031942 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788ac374894c437fa8644493b7678747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.032517 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet 69a3a4d2724b42da83a523e208b5714b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:06.033602 12552 debug-util.cc:398] Leaking SignalData structure 0x7b08000bacc0 after lost signal to thread 12450
I20260810 13:54:06.034070 13209 tablet_service.cc:1558] Processing DeleteTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 with delete_type TABLET_DATA_DELETED (replaced by tablet 97015b4984c74a4682b6dedd47dc6650) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:06.034435 12552 debug-util.cc:398] Leaking SignalData structure 0x7b08000bb240 after lost signal to thread 12557
I20260810 13:54:06.037711 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 3641ae594b104131bb55005bc1f61027 (DEFAULT_TABLE table=default.Table_d028580c0c154a01a3d21e5c767d23eb [id=e174379ca8054f089a7bc02b2b24dd12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.039448 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3641ae594b104131bb55005bc1f61027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.965010 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:06.048218 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_eebc498aa5734ab8b23c00b74d896ba9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:06.049193 13639 ts_tablet_manager.cc:1403] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.225s user 0.010s sys 0.001s
I20260810 13:54:05.975617 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 7a07cf0ebb0f4bc6816c119a4b2af17f (DEFAULT_TABLE table=default.Table_51b05316075a49bc898ede0e35031c70 [id=359af78e1c844299a56756c90613d641]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:05.982223 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752c50dac794b3f9e6430e982d9cbe2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:06.049969 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eebc498aa5734ab8b23c00b74d896ba9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:06.050238 13167 leader_election.cc:343] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:06.053504 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a07cf0ebb0f4bc6816c119a4b2af17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:05.994107 15633 leader_election.cc:290] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:06.002890 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 788ac374894c437fa8644493b7678747 (DEFAULT_TABLE table=default.Table_c752da6252ce4541be9cef2bce47bfe3 [id=178f273145a74eb2a2de7da53f248126]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.073071 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788ac374894c437fa8644493b7678747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.075146 13639 raft_consensus.cc:359] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.075793 13639 raft_consensus.cc:385] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.076030 13639 raft_consensus.cc:740] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.007567 12952 leader_election.cc:304] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:06.076814 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 69350.1us
I20260810 13:54:06.076929 15633 raft_consensus.cc:2804] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:06.077409 15633 raft_consensus.cc:697] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:06.078215 15633 consensus_queue.cc:237] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.083922 13638 tablet_bootstrap.cc:492] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:06.076611 13639 consensus_queue.cc:260] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.084465 13638 ts_tablet_manager.cc:1403] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.178s user 0.012s sys 0.001s
I20260810 13:54:06.046373 13004 tablet_service.cc:1511] Processing CreateTablet for tablet 3641ae594b104131bb55005bc1f61027 (DEFAULT_TABLE table=default.Table_d028580c0c154a01a3d21e5c767d23eb [id=e174379ca8054f089a7bc02b2b24dd12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.085866 13639 ts_tablet_manager.cc:1434] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.036s user 0.005s sys 0.000s
I20260810 13:54:06.086176 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3641ae594b104131bb55005bc1f61027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.086699 13639 tablet_bootstrap.cc:492] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:06.100855 15501 raft_consensus.cc:493] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:06.101293 15501 raft_consensus.cc:515] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.103049 13639 tablet_bootstrap.cc:654] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:06.103334 15501 leader_election.cc:290] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:06.105260 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:06.105867 13261 raft_consensus.cc:2468] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:06.106943 12952 leader_election.cc:304] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:06.109011 15501 raft_consensus.cc:2804] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:06.109323 15501 raft_consensus.cc:493] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:06.109618 15501 raft_consensus.cc:3060] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:06.140614 12746 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 5642cf1c59e240b7885317c4482a7704
I20260810 13:54:06.141899 12747 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6652dc376ef94ce5bafda8bda3b043f2" } modify_external_catalogs: true
I20260810 13:54:06.142436 12747 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_6652dc376ef94ce5bafda8bda3b043f2" } modify_external_catalogs: true
I20260810 13:54:06.145742 13551 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:54:06.155314 13638 raft_consensus.cc:359] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.155519 13427 tablet_service.cc:1511] Processing CreateTablet for tablet d0e488e3e89047b18178c9cb64d74bef (DEFAULT_TABLE table=default.Table_5818235bc6094cb69999b2a6a1552d79 [id=5746ef7caeef407f98af956e742d7343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.156052 13638 raft_consensus.cc:385] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.156304 13638 raft_consensus.cc:740] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.156898 13427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0e488e3e89047b18178c9cb64d74bef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.157090 13638 consensus_queue.cc:260] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:06.162724 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce84eacbab61417a9497f8770b4da511 consensus state has no leader
I20260810 13:54:06.174494 15348 raft_consensus.cc:2243] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:06.175038 15348 raft_consensus.cc:2272] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:06.177240 15348 ts_tablet_manager.cc:1916] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:06.182789 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 009307ae14cf4e7db54b2146c0c4d143 (DEFAULT_TABLE table=default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.185387 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 009307ae14cf4e7db54b2146c0c4d143 (DEFAULT_TABLE table=default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.186403 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009307ae14cf4e7db54b2146c0c4d143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.186734 13003 tablet_service.cc:1511] Processing CreateTablet for tablet b3cbbc9bee4843dea818b514d42d42df (DEFAULT_TABLE table=default.Table_2416e07beb8d42a6a48de9dab42936cf [id=39551fb5d1804467bb58d5b00de27be4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.187625 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3cbbc9bee4843dea818b514d42d42df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.189759 13638 ts_tablet_manager.cc:1434] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.105s user 0.005s sys 0.000s
I20260810 13:54:06.119590 15501 raft_consensus.cc:515] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.199518 15501 leader_election.cc:290] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:06.200076 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:06.200584 13261 raft_consensus.cc:3060] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:06.205268 15635 raft_consensus.cc:493] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:06.205783 15635 raft_consensus.cc:515] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:06.208323 13261 raft_consensus.cc:2468] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:06.207908 15635 leader_election.cc:290] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:06.213195 13467 raft_consensus.cc:2468] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:06.214327 12952 leader_election.cc:304] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:06.215051 15633 raft_consensus.cc:2804] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:06.215495 15633 raft_consensus.cc:697] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:06.216259 15633 consensus_queue.cc:237] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.223824 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009307ae14cf4e7db54b2146c0c4d143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.214605 13421 tablet_service.cc:1558] Processing DeleteTablet for tablet 34b2314b771f41188bc8101c5ddffaf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:04 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:06.218926 13419 tablet_service.cc:1558] Processing DeleteTablet for tablet 39fd2ebed17e4c1e946d7783c41d15e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5642cf1c59e240b7885317c4482a7704) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:06.226547 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 2e5616cea29148a49ac6db261351f460 (DEFAULT_TABLE table=default.Table_5967f54814d04534b6a591a3bf9a4e8e [id=fd3f5c353a584a6b9d955543762bb8c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.227231 13638 tablet_bootstrap.cc:492] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:06.227691 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e5616cea29148a49ac6db261351f460. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:06.235378 13334 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9ea0 after lost signal to thread 13136
W20260810 13:54:06.236564 13334 debug-util.cc:398] Leaking SignalData structure 0x7b0800112520 after lost signal to thread 13338
I20260810 13:54:06.242594 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_7c263dc08783483d941121c9c3cafdc6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:06.242915 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 30a5adc9446543eb91f5a1c0f0859c31 (DEFAULT_TABLE table=default.Table_b33cb4c7a80141c49d306885213f30a9 [id=7dff57e81c064728a8160d5c02c11de5]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:06.243995 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c263dc08783483d941121c9c3cafdc6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:06.246757 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a5adc9446543eb91f5a1c0f0859c31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.248617 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_54ea5af3ae44427eb0031a29dd62e663"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:06.250102 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_54ea5af3ae44427eb0031a29dd62e663 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:06.263603 15471 lock_manager.cc:585] Waited 4 seconds to obtain row lock on key '<redacted>' (key hash 12749420330613191736) tablet 00000000000000000000000000000000 cur holder 0x7b5800043200
I20260810 13:54:06.270231 15466 consensus_queue.cc:1048] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:06.271354 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2e5ad84fe2604dd2959768db31f66e7c (table default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]). Expected version 2 got 1
I20260810 13:54:06.272503 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:54:06.273469 13421 tablet_service.cc:1511] Processing CreateTablet for tablet ae74d69055ee4aa395c0f628864242e3 (DEFAULT_TABLE table=default.Table_6964fe82ae0c4d96a86d800f82062b3e [id=83fc760e794d422d8614bf728e3e47df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.273818 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
I20260810 13:54:06.274657 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet fe4755e4fcfd4af087ce5831a4e02022 (table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9]). Expected version 1 got 0
I20260810 13:54:06.276254 15321 ts_tablet_manager.cc:1929] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:06.276614 15321 log.cc:1199] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/a83ddc3ea3e74b569385b289fe8cf469
I20260810 13:54:06.277386 15321 ts_tablet_manager.cc:1950] T a83ddc3ea3e74b569385b289fe8cf469 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:06.279564 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 424) took 4799 ms. Trace:
I20260810 13:54:06.279959 15321 rpcz_store.cc:276] 0810 13:54:01.480465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.484035 (+ 3570us) service_pool.cc:224] Handling call
0810 13:54:05.909808 (+4425773us) ts_tablet_manager.cc:1151] Deleting tablet a83ddc3ea3e74b569385b289fe8cf469
0810 13:54:05.909905 (+ 97us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.125143 (+215238us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:06.276123 (+150980us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:06.279490 (+ 3367us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4408921}
I20260810 13:54:06.283591 13236 tablet_service.cc:1511] Processing CreateTablet for tablet b3cbbc9bee4843dea818b514d42d42df (DEFAULT_TABLE table=default.Table_2416e07beb8d42a6a48de9dab42936cf [id=39551fb5d1804467bb58d5b00de27be4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.285387 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3cbbc9bee4843dea818b514d42d42df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.286367 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet a7fb3f80f940435a902c355cb699b434 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:04 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:06.287261 13209 tablet_service.cc:1511] Processing CreateTablet for tablet e1e8e52e3605464fb40b78ab3d104ce8 (DEFAULT_TABLE table=default.Table_d3680fc81fed4821bc9a2eccc77c35d8 [id=c9181e9bcc3546a5ac7aed13b663deaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.288247 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e8e52e3605464fb40b78ab3d104ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.289392 13007 tablet_service.cc:1511] Processing CreateTablet for tablet e1e8e52e3605464fb40b78ab3d104ce8 (DEFAULT_TABLE table=default.Table_d3680fc81fed4821bc9a2eccc77c35d8 [id=c9181e9bcc3546a5ac7aed13b663deaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.297628 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e8e52e3605464fb40b78ab3d104ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.299228 13420 tablet_service.cc:1511] Processing CreateTablet for tablet 9752c50dac794b3f9e6430e982d9cbe2 (DEFAULT_TABLE table=default.Table_f835565354f042368700f4252335e8eb [id=84ca48404db8439697f8035aa3bc34d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.319818 12739 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_f98e5920f7d54537a56376403e71a0aa [id=82f67714ca3b4e6aab8557bd0f53d264] alter complete (version 2)
I20260810 13:54:06.321563 13428 tablet_service.cc:1511] Processing CreateTablet for tablet 7a07cf0ebb0f4bc6816c119a4b2af17f (DEFAULT_TABLE table=default.Table_51b05316075a49bc898ede0e35031c70 [id=359af78e1c844299a56756c90613d641]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.333889 13640 tablet_bootstrap.cc:492] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:06.334451 13640 ts_tablet_manager.cc:1403] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.827s user 0.004s sys 0.023s
I20260810 13:54:06.337266 13640 raft_consensus.cc:359] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:06.337973 13640 raft_consensus.cc:385] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.338268 13640 raft_consensus.cc:740] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.339104 13640 consensus_queue.cc:260] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:06.355386 13638 tablet_bootstrap.cc:700] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: Time spent opening tablet: real 0.124s user 0.003s sys 0.000s
I20260810 13:54:06.356086 13638 tablet_bootstrap.cc:654] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:06.358477 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_4a0d9399ab4c468fab4289955631b20f" } modify_external_catalogs: true
I20260810 13:54:06.358989 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_4a0d9399ab4c468fab4289955631b20f" } modify_external_catalogs: true
I20260810 13:54:06.361312 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9ec2734c1c43472ca16731c99911a350"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:06.362712 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ec2734c1c43472ca16731c99911a350 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:06.367259 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_066011dcc620407a8cd316bb975b735b" } new_table_name: "default.Table_dc897ab302154802b021987cd5daf577" modify_external_catalogs: true
I20260810 13:54:06.377353 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 8e11d3197c5146e19dcbc2ca5015d224 (DEFAULT_TABLE table=default.Table_dd910306a7864aeb9230c62730dc3ff4 [id=ee077cecabdd48809356d55acc5604a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.378065 13221 tablet_service.cc:1511] Processing CreateTablet for tablet b4be757a47e3434081eef61dfd746be1 (DEFAULT_TABLE table=default.Table_dfe60ded8ca240529710962e7f530298 [id=b4ce0aca49834e698812644caf8b8a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.378443 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e11d3197c5146e19dcbc2ca5015d224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.379179 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4be757a47e3434081eef61dfd746be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.379196 13639 tablet_bootstrap.cc:492] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:06.379632 13639 ts_tablet_manager.cc:1403] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.293s user 0.060s sys 0.078s
I20260810 13:54:06.384855 13003 tablet_service.cc:1511] Processing CreateTablet for tablet b4be757a47e3434081eef61dfd746be1 (DEFAULT_TABLE table=default.Table_dfe60ded8ca240529710962e7f530298 [id=b4ce0aca49834e698812644caf8b8a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.387451 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae74d69055ee4aa395c0f628864242e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.388098 13639 raft_consensus.cc:359] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.388747 13639 raft_consensus.cc:385] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.388991 13639 raft_consensus.cc:740] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.389577 13639 consensus_queue.cc:260] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.391460 13639 ts_tablet_manager.cc:1434] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20260810 13:54:06.393278 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9752c50dac794b3f9e6430e982d9cbe2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:06.396665 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cb4dcad38c1a4269b4740a8e5247a867 consensus state has no leader
I20260810 13:54:06.397205 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a07cf0ebb0f4bc6816c119a4b2af17f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.397717 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4be757a47e3434081eef61dfd746be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.398264 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]) successfully deleted
I20260810 13:54:06.399278 15321 tablet_replica.cc:333] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:06.400043 15321 raft_consensus.cc:2243] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:06.407307 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 788ac374894c437fa8644493b7678747 (DEFAULT_TABLE table=default.Table_c752da6252ce4541be9cef2bce47bfe3 [id=178f273145a74eb2a2de7da53f248126]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.408377 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788ac374894c437fa8644493b7678747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.415037 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 62aabe97aca9485fb2b40d67c989c210 (DEFAULT_TABLE table=default.Table_ee42df273bce4386bbf8edb282c2059a [id=8d115ba01bfd4ed7b90f6531e9ef66c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.416006 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62aabe97aca9485fb2b40d67c989c210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.420343 15321 raft_consensus.cc:2272] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:06.428295 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 3641ae594b104131bb55005bc1f61027 (DEFAULT_TABLE table=default.Table_d028580c0c154a01a3d21e5c767d23eb [id=e174379ca8054f089a7bc02b2b24dd12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.429517 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3641ae594b104131bb55005bc1f61027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.430138 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 8e11d3197c5146e19dcbc2ca5015d224 (DEFAULT_TABLE table=default.Table_dd910306a7864aeb9230c62730dc3ff4 [id=ee077cecabdd48809356d55acc5604a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.437211 15321 ts_tablet_manager.cc:1916] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:06.438030 13426 tablet_service.cc:1511] Processing CreateTablet for tablet 009307ae14cf4e7db54b2146c0c4d143 (DEFAULT_TABLE table=default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.439139 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 009307ae14cf4e7db54b2146c0c4d143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.443306 13448 tablet_service.cc:1511] Processing CreateTablet for tablet b3cbbc9bee4843dea818b514d42d42df (DEFAULT_TABLE table=default.Table_2416e07beb8d42a6a48de9dab42936cf [id=39551fb5d1804467bb58d5b00de27be4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.443830 13215 tablet_service.cc:1511] Processing CreateTablet for tablet 62aabe97aca9485fb2b40d67c989c210 (DEFAULT_TABLE table=default.Table_ee42df273bce4386bbf8edb282c2059a [id=8d115ba01bfd4ed7b90f6531e9ef66c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.444321 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3cbbc9bee4843dea818b514d42d42df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.449972 13417 tablet_service.cc:1511] Processing CreateTablet for tablet e1e8e52e3605464fb40b78ab3d104ce8 (DEFAULT_TABLE table=default.Table_d3680fc81fed4821bc9a2eccc77c35d8 [id=c9181e9bcc3546a5ac7aed13b663deaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.450320 13639 tablet_bootstrap.cc:492] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:06.450958 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1e8e52e3605464fb40b78ab3d104ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.451583 13638 tablet_bootstrap.cc:492] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:06.452227 13638 ts_tablet_manager.cc:1403] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.225s user 0.006s sys 0.005s
I20260810 13:54:06.452709 13233 tablet_service.cc:1511] Processing CreateTablet for tablet fd1a9d7bb08b45b780137e7acf8111bb (DEFAULT_TABLE table=default.Table_9d26366e03454a73ae877683e6700ff0 [id=3587a6d27d294470ac7551a3bb96a701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.454069 13425 tablet_service.cc:1511] Processing CreateTablet for tablet b4be757a47e3434081eef61dfd746be1 (DEFAULT_TABLE table=default.Table_dfe60ded8ca240529710962e7f530298 [id=b4ce0aca49834e698812644caf8b8a94]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.455102 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4be757a47e3434081eef61dfd746be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.463007 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet d891e763a1854b6a8bda1071448fd8e0
I20260810 13:54:06.466310 13638 raft_consensus.cc:359] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.466964 13638 raft_consensus.cc:385] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.467196 13638 raft_consensus.cc:740] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.467825 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet d891e763a1854b6a8bda1071448fd8e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:06 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:06.467898 13638 consensus_queue.cc:260] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.470945 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet d891e763a1854b6a8bda1071448fd8e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:06 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:54:06.472565 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet d891e763a1854b6a8bda1071448fd8e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d891e763a1854b6a8bda1071448fd8e0 already in progress: creating tablet
I20260810 13:54:06.473978 13004 tablet_service.cc:1511] Processing CreateTablet for tablet fd1a9d7bb08b45b780137e7acf8111bb (DEFAULT_TABLE table=default.Table_9d26366e03454a73ae877683e6700ff0 [id=3587a6d27d294470ac7551a3bb96a701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.474996 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1a9d7bb08b45b780137e7acf8111bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.475399 13639 tablet_bootstrap.cc:654] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:06.477263 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 8d860c257b794cce8f215ca7e871d6b0 (DEFAULT_TABLE table=default.Table_004ad2bd15214f94a0c183ec75f725ca [id=240ee1976c8f40c59438f7f22839e297]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.478183 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d860c257b794cce8f215ca7e871d6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.484848 13215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62aabe97aca9485fb2b40d67c989c210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.488031 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 8e11d3197c5146e19dcbc2ca5015d224 (DEFAULT_TABLE table=default.Table_dd910306a7864aeb9230c62730dc3ff4 [id=ee077cecabdd48809356d55acc5604a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.489091 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e11d3197c5146e19dcbc2ca5015d224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.489197 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1a9d7bb08b45b780137e7acf8111bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.493991 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e11d3197c5146e19dcbc2ca5015d224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.498452 13638 ts_tablet_manager.cc:1434] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.046s user 0.005s sys 0.000s
I20260810 13:54:06.498440 13442 tablet_service.cc:1511] Processing CreateTablet for tablet fd1a9d7bb08b45b780137e7acf8111bb (DEFAULT_TABLE table=default.Table_9d26366e03454a73ae877683e6700ff0 [id=3587a6d27d294470ac7551a3bb96a701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.499402 13638 tablet_bootstrap.cc:492] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:06.499439 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1a9d7bb08b45b780137e7acf8111bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.514178 13639 tablet_bootstrap.cc:492] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:06.514654 13639 ts_tablet_manager.cc:1403] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.065s user 0.006s sys 0.003s
I20260810 13:54:06.507558 13436 tablet_service.cc:1558] Processing DeleteTablet for tablet d891e763a1854b6a8bda1071448fd8e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:06 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:06.503254 13640 ts_tablet_manager.cc:1434] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.168s user 0.005s sys 0.001s
I20260810 13:54:06.518478 13640 tablet_bootstrap.cc:492] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:06.529079 13639 raft_consensus.cc:359] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.529752 13639 raft_consensus.cc:385] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.530010 13639 raft_consensus.cc:740] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.530627 13639 consensus_queue.cc:260] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:06.536504 13171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:06.540046 13639 ts_tablet_manager.cc:1434] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.025s user 0.002s sys 0.005s
I20260810 13:54:06.553582 13639 tablet_bootstrap.cc:492] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:06.519181 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:06.565246 13467 raft_consensus.cc:2393] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:06.375164 15348 ts_tablet_manager.cc:1929] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:06.565755 15348 log.cc:1199] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/ab4cd2e5c73e467eb1bc4623e5d5e831
I20260810 13:54:06.566591 15348 ts_tablet_manager.cc:1950] T ab4cd2e5c73e467eb1bc4623e5d5e831 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:06.545318 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9243eda3974532aff0425885f54166" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:06.567253 13465 raft_consensus.cc:2393] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:06.570218 13638 tablet_bootstrap.cc:654] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:06.576968 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 8d860c257b794cce8f215ca7e871d6b0 (DEFAULT_TABLE table=default.Table_004ad2bd15214f94a0c183ec75f725ca [id=240ee1976c8f40c59438f7f22839e297]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.581247 15321 ts_tablet_manager.cc:1929] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:06.581640 15321 log.cc:1199] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/ee27d158bd40425a8c6fa8cb068daa79
I20260810 13:54:06.583994 13011 tablet_service.cc:1511] Processing CreateTablet for tablet ec0c424fdefb4d38a9946203c6521012 (DEFAULT_TABLE table=default.Table_18833ebfc83a4c33a1a94a902b97ffaf [id=bb2789ba0fd043c2a44479f23111dcbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.585268 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0c424fdefb4d38a9946203c6521012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.585012 12740 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ebcd04452c3c454e93961b5a321e40d1" } new_table_name: "default.Table_6c443ac64289437d8c7dcf5ea44469dd" modify_external_catalogs: true
I20260810 13:54:06.589099 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:06.589924 13468 raft_consensus.cc:2393] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:06.590253 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:06.590948 13465 raft_consensus.cc:2468] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:06.594048 13639 tablet_bootstrap.cc:654] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:06.595975 13217 tablet_service.cc:1511] Processing CreateTablet for tablet ec0c424fdefb4d38a9946203c6521012 (DEFAULT_TABLE table=default.Table_18833ebfc83a4c33a1a94a902b97ffaf [id=bb2789ba0fd043c2a44479f23111dcbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.604610 13008 tablet_service.cc:1511] Processing CreateTablet for tablet f1dd212fa9cc4ce388968cc236201a39 (DEFAULT_TABLE table=default.Table_1c8d47b92e21464d98e32ae2ac93fb9b [id=24d83ed87348421e9eed6f5fe761b31a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.606190 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1dd212fa9cc4ce388968cc236201a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.612804 13210 tablet_service.cc:1511] Processing CreateTablet for tablet f1dd212fa9cc4ce388968cc236201a39 (DEFAULT_TABLE table=default.Table_1c8d47b92e21464d98e32ae2ac93fb9b [id=24d83ed87348421e9eed6f5fe761b31a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.619822 15321 ts_tablet_manager.cc:1950] T ee27d158bd40425a8c6fa8cb068daa79 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:06.621011 15466 raft_consensus.cc:493] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:06.621558 15466 raft_consensus.cc:515] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.624786 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7bce2378f482d81d2ad08e9d15b0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:06.625191 15466 leader_election.cc:290] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:06.625464 13043 raft_consensus.cc:2468] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:06.626880 13167 leader_election.cc:304] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:06.627765 15466 raft_consensus.cc:2804] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:06.628262 15466 raft_consensus.cc:493] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:06.628729 15466 raft_consensus.cc:3060] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:06.640085 13640 tablet_bootstrap.cc:654] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:06.647460 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 62aabe97aca9485fb2b40d67c989c210 (DEFAULT_TABLE table=default.Table_ee42df273bce4386bbf8edb282c2059a [id=8d115ba01bfd4ed7b90f6531e9ef66c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.648509 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62aabe97aca9485fb2b40d67c989c210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.655956 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 415) took 7229 ms. Trace:
I20260810 13:54:06.656287 15348 rpcz_store.cc:276] 0810 13:53:59.426038 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.429840 (+ 3802us) service_pool.cc:224] Handling call
0810 13:54:05.932831 (+6502991us) ts_tablet_manager.cc:1151] Deleting tablet ab4cd2e5c73e467eb1bc4623e5d5e831
0810 13:54:05.932895 (+ 64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.241230 (+308335us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:06.375032 (+133802us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:06.655895 (+280863us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142129,"tablet-delete.queue_time_us":6213978}
I20260810 13:54:06.657420 15348 tablet_replica.cc:333] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:06.658164 15348 raft_consensus.cc:2243] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:06.659652 15348 raft_consensus.cc:2272] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:06.660288 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 77173us
I20260810 13:54:06.661746 15348 ts_tablet_manager.cc:1916] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:06.675794 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_cca9d32f9bad4ec9b60a5dfeafdd4e33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:06.680820 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 69a3a4d2724b42da83a523e208b5714b (table default.Table_85163b830b37444787dfe92a72503b29 [id=e4f461aca0304a8dba850e8d24b89841]) successfully deleted
W20260810 13:54:06.681979 12717 catalog_manager.cc:5017] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 4dea61b84b614ead8830873568f9b7c4 because the tablet was not found. No further retry: Not found: Tablet not found: 4dea61b84b614ead8830873568f9b7c4
I20260810 13:54:06.683779 13227 tablet_service.cc:1511] Processing CreateTablet for tablet 1a82b2b44e0247f982294e5180842db3 (DEFAULT_TABLE table=default.Table_0b822e65634b4fa6bbd83563bb9227dd [id=56bf1840eb56445d82664d41b663ecc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.686373 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 96f66a5c6837404b96e1937a73aa1f19 (DEFAULT_TABLE table=default.Table_dfe0fd41b106448e8a729e593ac63e5a [id=342af46254364715a3eb6166299c7275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.687922 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 0f422b17b9a24f609b06625837947e64 (DEFAULT_TABLE table=default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.689648 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 2be6cc62ea1e4299b8b243b70700d064 (DEFAULT_TABLE table=default.Table_def78e8fb6b74845bf2ef24bcef6691b [id=42af124147fe44c1875a9803af2e97a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.690510 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 1a82b2b44e0247f982294e5180842db3 (DEFAULT_TABLE table=default.Table_0b822e65634b4fa6bbd83563bb9227dd [id=56bf1840eb56445d82664d41b663ecc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.691525 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a82b2b44e0247f982294e5180842db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.691455 13231 tablet_service.cc:1511] Processing CreateTablet for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (DEFAULT_TABLE table=default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.696092 12999 tablet_service.cc:1511] Processing CreateTablet for tablet 96f66a5c6837404b96e1937a73aa1f19 (DEFAULT_TABLE table=default.Table_dfe0fd41b106448e8a729e593ac63e5a [id=342af46254364715a3eb6166299c7275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.696717 12998 tablet_service.cc:1511] Processing CreateTablet for tablet 0f422b17b9a24f609b06625837947e64 (DEFAULT_TABLE table=default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.697069 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f66a5c6837404b96e1937a73aa1f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.698601 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 2be6cc62ea1e4299b8b243b70700d064 (DEFAULT_TABLE table=default.Table_def78e8fb6b74845bf2ef24bcef6691b [id=42af124147fe44c1875a9803af2e97a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.699805 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f422b17b9a24f609b06625837947e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.700364 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be6cc62ea1e4299b8b243b70700d064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.701524 13021 tablet_service.cc:1511] Processing CreateTablet for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (DEFAULT_TABLE table=default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.701797 13208 tablet_service.cc:1511] Processing CreateTablet for tablet a10f8466fc2844608eec8e781fc2e8a0 (DEFAULT_TABLE table=default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.702440 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.708916 13639 tablet_bootstrap.cc:492] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:06.709375 13639 ts_tablet_manager.cc:1403] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.156s user 0.010s sys 0.012s
I20260810 13:54:06.710690 13018 tablet_service.cc:1511] Processing CreateTablet for tablet a10f8466fc2844608eec8e781fc2e8a0 (DEFAULT_TABLE table=default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.711645 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f8466fc2844608eec8e781fc2e8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.714156 13206 tablet_service.cc:1511] Processing CreateTablet for tablet 35317d87beb24a01b8df52b1cbba375c (DEFAULT_TABLE table=default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.714387 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 35317d87beb24a01b8df52b1cbba375c (DEFAULT_TABLE table=default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.715303 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35317d87beb24a01b8df52b1cbba375c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.716493 13639 raft_consensus.cc:359] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.717415 13639 raft_consensus.cc:385] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.718547 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 5f518df5c1414edba15ad72983c7f362 (DEFAULT_TABLE table=default.Table_fe0baa9629ad42fbb05cfbc004e62688 [id=907a4591204d4db697b44488fef76406]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.717718 13639 raft_consensus.cc:740] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.720498 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 5f518df5c1414edba15ad72983c7f362 (DEFAULT_TABLE table=default.Table_fe0baa9629ad42fbb05cfbc004e62688 [id=907a4591204d4db697b44488fef76406]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.721974 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f518df5c1414edba15ad72983c7f362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.725011 13639 consensus_queue.cc:260] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.728931 13639 ts_tablet_manager.cc:1434] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260810 13:54:06.729907 13639 tablet_bootstrap.cc:492] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:06.742602 13638 tablet_bootstrap.cc:492] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:06.743083 13638 ts_tablet_manager.cc:1403] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.244s user 0.004s sys 0.008s
I20260810 13:54:06.745931 13638 raft_consensus.cc:359] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.746692 13638 raft_consensus.cc:385] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.747018 13638 raft_consensus.cc:740] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.747738 13638 consensus_queue.cc:260] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.750792 13638 ts_tablet_manager.cc:1434] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 13:54:06.762818 15348 ts_tablet_manager.cc:1929] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:06.785527 15633 consensus_queue.cc:1048] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:06.787788 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d860c257b794cce8f215ca7e871d6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.793195 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0c424fdefb4d38a9946203c6521012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.797194 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1dd212fa9cc4ce388968cc236201a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.797123 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 425) took 5040 ms. Trace:
I20260810 13:54:06.797500 15321 rpcz_store.cc:276] 0810 13:54:01.756617 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.756858 (+ 241us) service_pool.cc:224] Handling call
0810 13:54:06.399086 (+4642228us) ts_tablet_manager.cc:1151] Deleting tablet ee27d158bd40425a8c6fa8cb068daa79
0810 13:54:06.399141 (+ 55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.511233 (+112092us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:06.581088 (+ 69855us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:06.797065 (+215977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16068,"tablet-delete.queue_time_us":4640870}
I20260810 13:54:06.798830 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 426) took 4252 ms. Trace:
I20260810 13:54:06.799106 15321 rpcz_store.cc:276] 0810 13:54:02.546801 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.547030 (+ 229us) service_pool.cc:224] Handling call
0810 13:54:06.798479 (+4251449us) ts_tablet_manager.cc:1151] Deleting tablet 00a4341f5d274a9eb54cb030b47c9a91
0810 13:54:06.798520 (+ 41us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.798778 (+ 258us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4250553}
I20260810 13:54:06.800231 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 428) took 4087 ms. Trace:
I20260810 13:54:06.800623 15321 rpcz_store.cc:276] 0810 13:54:02.712836 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.713069 (+ 233us) service_pool.cc:224] Handling call
0810 13:54:06.799920 (+4086851us) ts_tablet_manager.cc:1151] Deleting tablet ca4c0fea312c418f8ebd5c0619e7e220
0810 13:54:06.799956 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.800177 (+ 221us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4086146}
I20260810 13:54:06.801206 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a82b2b44e0247f982294e5180842db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.801679 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 427) took 4101 ms. Trace:
I20260810 13:54:06.801952 15321 rpcz_store.cc:276] 0810 13:54:02.707721 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.713868 (+ 6147us) service_pool.cc:224] Handling call
0810 13:54:06.801403 (+4087535us) ts_tablet_manager.cc:1151] Deleting tablet 3a1b35d369474ba9bee379089796bd3c
0810 13:54:06.801441 (+ 38us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.801635 (+ 194us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4087003}
I20260810 13:54:06.803161 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 434) took 3811 ms. Trace:
I20260810 13:54:06.803434 15321 rpcz_store.cc:276] 0810 13:54:02.992093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.997000 (+ 4907us) service_pool.cc:224] Handling call
0810 13:54:06.802715 (+3805715us) ts_tablet_manager.cc:1151] Deleting tablet 7a490fcb16164f968335f069129b3d71
0810 13:54:06.802903 (+ 188us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.803116 (+ 213us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3804998}
I20260810 13:54:06.805190 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f66a5c6837404b96e1937a73aa1f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.805303 15633 raft_consensus.cc:493] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:06.805727 15633 raft_consensus.cc:515] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.808028 15633 leader_election.cc:290] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:06.809297 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f422b17b9a24f609b06625837947e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.812532 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8aea1057f445a9b060d138952324ca" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:06.813194 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be6cc62ea1e4299b8b243b70700d064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.816454 13639 tablet_bootstrap.cc:654] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:06.817085 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f518df5c1414edba15ad72983c7f362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.820220 15348 log.cc:1199] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/1b84bd35b02f4a1faf15ac9bc21e6146
I20260810 13:54:06.821089 15348 ts_tablet_manager.cc:1950] T 1b84bd35b02f4a1faf15ac9bc21e6146 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:06.766640 13640 tablet_bootstrap.cc:492] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:06.821993 13640 ts_tablet_manager.cc:1403] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.304s user 0.011s sys 0.000s
I20260810 13:54:06.824501 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa729726a7f4603b0f5085a56cf89f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:06.804872 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 436) took 3812 ms. Trace:
I20260810 13:54:06.832927 15321 rpcz_store.cc:276] 0810 13:54:02.992678 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.000834 (+ 8156us) service_pool.cc:224] Handling call
0810 13:54:06.804565 (+3803731us) ts_tablet_manager.cc:1151] Deleting tablet c4ecf9abd60848f993234e98284974e8
0810 13:54:06.804600 (+ 35us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.804825 (+ 225us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3803096}
I20260810 13:54:06.834659 13640 raft_consensus.cc:359] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:06.835386 13640 raft_consensus.cc:385] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.835690 13640 raft_consensus.cc:740] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.836529 13640 consensus_queue.cc:260] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:06.872357 15611 raft_consensus.cc:493] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:06.872864 15611 raft_consensus.cc:515] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.873376 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f8466fc2844608eec8e781fc2e8a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.875779 15635 raft_consensus.cc:493] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:06.876257 15635 raft_consensus.cc:515] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:06.876986 15611 leader_election.cc:290] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:06.878203 15635 leader_election.cc:290] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:06.881443 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bfb69a7ce74175b4f1f5f4db583aa9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:06.882016 13049 raft_consensus.cc:2468] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:06.883211 13167 leader_election.cc:304] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:06.884196 15611 raft_consensus.cc:2804] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:06.884601 15611 raft_consensus.cc:493] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:06.885062 15611 raft_consensus.cc:3060] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:06.885262 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa729726a7f4603b0f5085a56cf89f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:06.886494 13259 raft_consensus.cc:3060] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:06.892099 15611 raft_consensus.cc:515] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:06.893034 13638 tablet_bootstrap.cc:492] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:06.893200 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35317d87beb24a01b8df52b1cbba375c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.896003 13640 ts_tablet_manager.cc:1434] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.074s user 0.005s sys 0.000s
I20260810 13:54:06.909888 15321 tablet_replica.cc:333] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:06.910395 13639 tablet_bootstrap.cc:492] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:06.910916 13639 ts_tablet_manager.cc:1403] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.181s user 0.011s sys 0.000s
I20260810 13:54:06.913264 13639 raft_consensus.cc:359] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:06.914017 13639 raft_consensus.cc:385] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:06.914278 13639 raft_consensus.cc:740] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:06.920609 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet ee27d158bd40425a8c6fa8cb068daa79 (table default.Table_68361e8cbef04d1595cb882c8b2e25eb [id=cff2aea45beb46d3b2216174d77de8da]) successfully deleted
W20260810 13:54:06.921662 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 00a4341f5d274a9eb54cb030b47c9a91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00a4341f5d274a9eb54cb030b47c9a91 already in progress: creating tablet
I20260810 13:54:06.921813 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 406) took 7498 ms. Trace:
W20260810 13:54:06.922470 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ca4c0fea312c418f8ebd5c0619e7e220 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca4c0fea312c418f8ebd5c0619e7e220 already in progress: creating tablet
I20260810 13:54:06.922221 15348 rpcz_store.cc:276] 0810 13:53:59.423222 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.427487 (+ 4265us) service_pool.cc:224] Handling call
0810 13:54:06.657228 (+7229741us) ts_tablet_manager.cc:1151] Deleting tablet 1b84bd35b02f4a1faf15ac9bc21e6146
0810 13:54:06.657302 (+ 74us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.671526 (+ 14224us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:06.762695 (+ 91169us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:06.921734 (+159039us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6938156}
W20260810 13:54:06.923241 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 3a1b35d369474ba9bee379089796bd3c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3a1b35d369474ba9bee379089796bd3c already in progress: creating tablet
I20260810 13:54:06.924039 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 419) took 6433 ms. Trace:
W20260810 13:54:06.924162 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 7a490fcb16164f968335f069129b3d71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a490fcb16164f968335f069129b3d71 already in progress: creating tablet
I20260810 13:54:06.924386 15348 rpcz_store.cc:276] 0810 13:54:00.490521 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.494715 (+ 4194us) service_pool.cc:224] Handling call
0810 13:54:06.923672 (+6428957us) ts_tablet_manager.cc:1151] Deleting tablet 0a6893b0b32646f6aeb72c866251a112
0810 13:54:06.923722 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.923988 (+ 266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6386324}
W20260810 13:54:06.924947 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet c4ecf9abd60848f993234e98284974e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4ecf9abd60848f993234e98284974e8 already in progress: creating tablet
I20260810 13:54:06.925957 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 421) took 6430 ms. Trace:
I20260810 13:54:06.926280 15348 rpcz_store.cc:276] 0810 13:54:00.495757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.495877 (+ 120us) service_pool.cc:224] Handling call
0810 13:54:06.925587 (+6429710us) ts_tablet_manager.cc:1151] Deleting tablet 452978fbf3b74e3c9b16756b9f394be7
0810 13:54:06.925634 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.925900 (+ 266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6376645}
I20260810 13:54:06.927553 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 422) took 6431 ms. Trace:
I20260810 13:54:06.927906 15348 rpcz_store.cc:276] 0810 13:54:00.496071 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.496334 (+ 263us) service_pool.cc:224] Handling call
0810 13:54:06.927201 (+6430867us) ts_tablet_manager.cc:1151] Deleting tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4
0810 13:54:06.927248 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:06.927511 (+ 263us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6378041}
I20260810 13:54:06.928956 15348 tablet_replica.cc:333] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:06.930284 13640 tablet_bootstrap.cc:492] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:06.935916 13640 tablet_bootstrap.cc:654] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:06.937899 13164 leader_election.cc:304] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:06.943030 12747 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:54:06.945417 12747 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 2e5ad84fe2604dd2959768db31f66e7c (table default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]). Expected version 2 got 1
I20260810 13:54:06.950352 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:06.952919 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet ab4cd2e5c73e467eb1bc4623e5d5e831 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]) successfully deleted
W20260810 13:54:06.953792 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cca9d32f9bad4ec9b60a5dfeafdd4e33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:06.961006 13639 consensus_queue.cc:260] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:06.948614 15348 raft_consensus.cc:2243] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:06.966439 15348 raft_consensus.cc:2272] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:06.968576 15348 ts_tablet_manager.cc:1916] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:06.974685 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:06.975314 13467 raft_consensus.cc:2468] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:06.978891 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:06.979444 13467 raft_consensus.cc:3060] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:06.984875 13639 ts_tablet_manager.cc:1434] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.074s user 0.006s sys 0.000s
I20260810 13:54:06.986773 13467 raft_consensus.cc:2468] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:06.994745 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8aea1057f445a9b060d138952324ca" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:06.995330 13472 raft_consensus.cc:2468] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:07.007498 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 8d860c257b794cce8f215ca7e871d6b0 (DEFAULT_TABLE table=default.Table_004ad2bd15214f94a0c183ec75f725ca [id=240ee1976c8f40c59438f7f22839e297]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.011430 13425 tablet_service.cc:1511] Processing CreateTablet for tablet ec0c424fdefb4d38a9946203c6521012 (DEFAULT_TABLE table=default.Table_18833ebfc83a4c33a1a94a902b97ffaf [id=bb2789ba0fd043c2a44479f23111dcbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.013873 13640 tablet_bootstrap.cc:492] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:07.014343 13640 ts_tablet_manager.cc:1403] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.084s user 0.009s sys 0.001s
I20260810 13:54:07.016674 13445 tablet_service.cc:1511] Processing CreateTablet for tablet f1dd212fa9cc4ce388968cc236201a39 (DEFAULT_TABLE table=default.Table_1c8d47b92e21464d98e32ae2ac93fb9b [id=24d83ed87348421e9eed6f5fe761b31a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:06.736438 15466 raft_consensus.cc:515] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.020846 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 1a82b2b44e0247f982294e5180842db3 (DEFAULT_TABLE table=default.Table_0b822e65634b4fa6bbd83563bb9227dd [id=56bf1840eb56445d82664d41b663ecc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.017403 13640 raft_consensus.cc:359] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.022145 12745 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_cc339254bace4b5e87544b721a6493a5 [id=685e6bce7ba5467693e2b0e1c739897b] alter complete (version 2)
I20260810 13:54:07.027770 15633 raft_consensus.cc:493] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:07.027940 12739 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 93) took 1522 ms (client timeout 1000 ms). Trace:
I20260810 13:54:07.028312 15633 raft_consensus.cc:515] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.030505 15633 leader_election.cc:290] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:07.024304 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 96f66a5c6837404b96e1937a73aa1f19 (DEFAULT_TABLE table=default.Table_dfe0fd41b106448e8a729e593ac63e5a [id=342af46254364715a3eb6166299c7275]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.025297 13420 tablet_service.cc:1511] Processing CreateTablet for tablet 0f422b17b9a24f609b06625837947e64 (DEFAULT_TABLE table=default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.026412 13426 tablet_service.cc:1511] Processing CreateTablet for tablet 2be6cc62ea1e4299b8b243b70700d064 (DEFAULT_TABLE table=default.Table_def78e8fb6b74845bf2ef24bcef6691b [id=42af124147fe44c1875a9803af2e97a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.030267 13438 tablet_service.cc:1511] Processing CreateTablet for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (DEFAULT_TABLE table=default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.033257 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d860c257b794cce8f215ca7e871d6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:07.033795 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:07.034463 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0c424fdefb4d38a9946203c6521012. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:07.037137 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1dd212fa9cc4ce388968cc236201a39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:07.041600 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a82b2b44e0247f982294e5180842db3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:07.042166 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be6cc62ea1e4299b8b243b70700d064. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:07.043725 12745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 95) took 1620 ms (client timeout 1000 ms). Trace:
I20260810 13:54:07.044972 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96f66a5c6837404b96e1937a73aa1f19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:07.046311 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f422b17b9a24f609b06625837947e64. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:07.028298 12739 rpcz_store.cc:269] 0810 13:54:05.505375 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:05.582608 (+ 77233us) service_pool.cc:224] Handling call
0810 13:54:05.625881 (+ 43273us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:54:07.027720 (+1401839us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:06.306854 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:06.307249 (+ 395us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:06.307273 (+ 24us) write_op.cc:435] Acquired schema lock
0810 13:54:06.307286 (+ 13us) tablet.cc:662] Decoding operations
0810 13:54:06.307547 (+ 261us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:06.307588 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:06.307611 (+ 23us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:54:06.307767 (+ 156us) tablet.cc:701] Row locks acquired
0810 13:54:06.307780 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:54:06.307886 (+ 106us) write_op.cc:270] Start()
0810 13:54:06.307969 (+ 83us) write_op.cc:276] Timestamp: P: 1786370046307812 usec, L: 0
0810 13:54:06.307986 (+ 17us) op_driver.cc:348] REPLICATION: starting
0810 13:54:06.308478 (+ 492us) log.cc:844] Serialized 356 byte log entry
0810 13:54:06.317632 (+ 9154us) op_driver.cc:464] REPLICATION: finished
0810 13:54:06.318139 (+ 507us) write_op.cc:301] APPLY: starting
0810 13:54:06.318220 (+ 81us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:06.318342 (+ 122us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:06.318478 (+ 136us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:06.318690 (+ 212us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:06.318884 (+ 194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:54:06.318946 (+ 62us) write_op.cc:312] APPLY: finished
0810 13:54:06.319172 (+ 226us) log.cc:844] Serialized 23 byte log entry
0810 13:54:06.319361 (+ 189us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:06.319449 (+ 88us) write_op.cc:454] Released schema lock
0810 13:54:06.319491 (+ 42us) write_op.cc:341] FINISH: Updating metrics
0810 13:54:06.380870 (+ 61379us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:06.380899 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":90569088,"child_traces":[["op",{"apply.queue_time_us":306,"apply.run_cpu_time_us":1571,"apply.run_wall_time_us":1571,"num_ops":1,"prepare.queue_time_us":267453,"prepare.run_cpu_time_us":2027,"prepare.run_wall_time_us":73966,"raft.queue_time_us":133,"raft.run_cpu_time_us":681,"raft.run_wall_time_us":681,"replication_time_us":9526}]]}
I20260810 13:54:07.079639 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 with delete_type TABLET_DATA_DELETED (replaced by tablet 97015b4984c74a4682b6dedd47dc6650) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:07.087103 15321 raft_consensus.cc:2243] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260810 13:54:07.036455 12746 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 92) took 874 ms (client timeout 1000 ms). Trace:
W20260810 13:54:07.088913 12746 rpcz_store.cc:269] 0810 13:54:06.162124 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.162249 (+ 125us) service_pool.cc:224] Handling call
0810 13:54:06.258449 (+ 96200us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:54:07.036255 (+777806us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":16,"spinlock_wait_cycles":176222976}
I20260810 13:54:07.090163 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:07.033257 13640 raft_consensus.cc:385] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:07.096910 13640 raft_consensus.cc:740] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:07.099570 15321 raft_consensus.cc:2272] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:07.104880 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 185708us
I20260810 13:54:07.109684 15611 leader_election.cc:290] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:07.111083 15611 raft_consensus.cc:3060] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:07.112151 13640 consensus_queue.cc:260] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.113587 15466 leader_election.cc:290] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:07.116231 15321 ts_tablet_manager.cc:1916] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:07.123049 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet a83ddc3ea3e74b569385b289fe8cf469 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:07.123787 13638 tablet_bootstrap.cc:654] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:07.125797 13640 ts_tablet_manager.cc:1434] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.111s user 0.005s sys 0.000s
I20260810 13:54:07.126778 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet ce9243eda3974532aff0425885f54166 with delete_type TABLET_DATA_DELETED (replaced by tablet f19e7aa805bd417eae45fb43ac18a66d) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:07.139384 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bfb69a7ce74175b4f1f5f4db583aa9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:07.139978 13041 raft_consensus.cc:3060] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:07.143556 13640 tablet_bootstrap.cc:492] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:07.147267 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7bce2378f482d81d2ad08e9d15b0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:07.147799 13049 raft_consensus.cc:3060] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:07.158996 13049 raft_consensus.cc:2468] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:07.161330 13638 tablet_bootstrap.cc:492] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:07.161599 15348 ts_tablet_manager.cc:1929] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:07.161919 13638 ts_tablet_manager.cc:1403] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.269s user 0.006s sys 0.007s
I20260810 13:54:07.165230 13167 leader_election.cc:304] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:07.166013 13167 raft_consensus.cc:2686] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:54:07.165314 13041 raft_consensus.cc:2468] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:07.169018 15348 log.cc:1199] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/ce9243eda3974532aff0425885f54166
I20260810 13:54:07.170456 15611 raft_consensus.cc:2749] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:07.174113 15348 ts_tablet_manager.cc:1950] T ce9243eda3974532aff0425885f54166 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:07.180050 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 439) took 6523 ms. Trace:
I20260810 13:54:07.182240 13417 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:07.184792 13420 tablet_service.cc:1558] Processing DeleteTablet for tablet ba05f4940220459f951adf3491f60b93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:07.184967 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7bce2378f482d81d2ad08e9d15b0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:07.193012 13467 raft_consensus.cc:2468] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:07.185748 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 35317d87beb24a01b8df52b1cbba375c (DEFAULT_TABLE table=default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.194918 13639 tablet_bootstrap.cc:492] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:07.197296 12747 master_service.cc:960] ReplaceTablet: received request to replace tablet 1a4fe8abad5649f2a42686c00148d957 from {username='slave'} at 127.0.0.1:48758
I20260810 13:54:07.204001 13639 tablet_bootstrap.cc:654] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:07.186676 13448 tablet_service.cc:1511] Processing CreateTablet for tablet a10f8466fc2844608eec8e781fc2e8a0 (DEFAULT_TABLE table=default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.210708 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10f8466fc2844608eec8e781fc2e8a0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:07.044085 12745 rpcz_store.cc:269] 0810 13:54:05.423206 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:05.436804 (+ 13598us) service_pool.cc:224] Handling call
0810 13:54:05.448092 (+ 11288us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:54:07.043642 (+1595550us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:05.850821 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:05.851261 (+ 440us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:05.851288 (+ 27us) write_op.cc:435] Acquired schema lock
0810 13:54:05.851301 (+ 13us) tablet.cc:662] Decoding operations
0810 13:54:05.851645 (+ 344us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:05.851738 (+ 93us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:05.851762 (+ 24us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:54:05.852028 (+ 266us) tablet.cc:701] Row locks acquired
0810 13:54:05.852046 (+ 18us) write_op.cc:260] PREPARE: finished
0810 13:54:05.852151 (+ 105us) write_op.cc:270] Start()
0810 13:54:05.852257 (+ 106us) write_op.cc:276] Timestamp: P: 1786370045852109 usec, L: 0
0810 13:54:05.852275 (+ 18us) op_driver.cc:348] REPLICATION: starting
0810 13:54:05.852828 (+ 553us) log.cc:844] Serialized 527 byte log entry
0810 13:54:05.987633 (+134805us) op_driver.cc:464] REPLICATION: finished
0810 13:54:05.988035 (+ 402us) write_op.cc:301] APPLY: starting
0810 13:54:05.988099 (+ 64us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:05.988209 (+ 110us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:05.988302 (+ 93us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:05.988514 (+ 212us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:05.988671 (+ 157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:54:05.988749 (+ 78us) write_op.cc:312] APPLY: finished
0810 13:54:05.988955 (+ 206us) log.cc:844] Serialized 23 byte log entry
0810 13:54:05.989115 (+ 160us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:05.989186 (+ 71us) write_op.cc:454] Released schema lock
0810 13:54:05.989221 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0810 13:54:05.989473 (+ 252us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:05.989507 (+ 34us) write_op.cc:454] Released schema lock
Related trace 'op':
0810 13:54:06.678105 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:06.678451 (+ 346us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:06.678473 (+ 22us) write_op.cc:435] Acquired schema lock
0810 13:54:06.678485 (+ 12us) tablet.cc:662] Decoding operations
0810 13:54:06.678791 (+ 306us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:06.678847 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:06.678890 (+ 43us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:54:06.679071 (+ 181us) tablet.cc:701] Row locks acquired
0810 13:54:06.679090 (+ 19us) write_op.cc:260] PREPARE: finished
0810 13:54:06.679226 (+ 136us) write_op.cc:270] Start()
0810 13:54:06.679334 (+ 108us) write_op.cc:276] Timestamp: P: 1786370046679148 usec, L: 0
0810 13:54:06.679355 (+ 21us) op_driver.cc:348] REPLICATION: starting
0810 13:54:06.679791 (+ 436us) log.cc:844] Serialized 356 byte log entry
0810 13:54:06.984904 (+305113us) op_driver.cc:464] REPLICATION: finished
0810 13:54:07.018646 (+ 33742us) write_op.cc:301] APPLY: starting
0810 13:54:07.018763 (+ 117us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:07.018906 (+ 143us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:07.019031 (+ 125us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:07.019293 (+ 262us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:07.019522 (+ 229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:54:07.019576 (+ 54us) write_op.cc:312] APPLY: finished
0810 13:54:07.019879 (+ 303us) log.cc:844] Serialized 23 byte log entry
0810 13:54:07.020069 (+ 190us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:07.020168 (+ 99us) write_op.cc:454] Released schema lock
0810 13:54:07.020208 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0810 13:54:07.020550 (+ 342us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:07.020573 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":21145344,"child_traces":[["op",{"apply.queue_time_us":219,"apply.run_cpu_time_us":1408,"apply.run_wall_time_us":1408,"mutex_wait_us":27409,"num_ops":1,"prepare.queue_time_us":225402,"prepare.run_cpu_time_us":2292,"prepare.run_wall_time_us":2291,"raft.queue_time_us":1752,"raft.run_cpu_time_us":773,"raft.run_wall_time_us":773,"replication_time_us":135260,"spinlock_wait_cycles":63872}],["op",{"apply.queue_time_us":33258,"apply.run_cpu_time_us":1886,"apply.run_wall_time_us":1887,"num_ops":1,"prepare.queue_time_us":420774,"prepare.run_cpu_time_us":2067,"prepare.run_wall_time_us":95942,"raft.queue_time_us":96,"raft.run_cpu_time_us":738,"raft.run_wall_time_us":739,"replication_time_us":305380,"spinlock_wait_cycles":363904}]]}
I20260810 13:54:07.222908 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35317d87beb24a01b8df52b1cbba375c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:07.187714 13426 tablet_service.cc:1511] Processing CreateTablet for tablet 5f518df5c1414edba15ad72983c7f362 (DEFAULT_TABLE table=default.Table_fe0baa9629ad42fbb05cfbc004e62688 [id=907a4591204d4db697b44488fef76406]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:07.225663 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f518df5c1414edba15ad72983c7f362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:07.231412 13639 tablet_bootstrap.cc:492] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:07.231894 13639 ts_tablet_manager.cc:1403] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.006s
I20260810 13:54:07.234732 15348 rpcz_store.cc:276] 0810 13:54:00.656914 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.657024 (+ 110us) service_pool.cc:224] Handling call
0810 13:54:06.928811 (+6271787us) ts_tablet_manager.cc:1151] Deleting tablet ce9243eda3974532aff0425885f54166
0810 13:54:06.928860 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.010867 (+ 82007us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.148603 (+137736us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.179990 (+ 31387us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18709,"spinlock_wait_cycles":8064,"tablet-delete.queue_time_us":6269557}
I20260810 13:54:07.235431 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2e79b198186741b39955b48b1832908a" } modify_external_catalogs: true
I20260810 13:54:07.241372 15348 tablet_replica.cc:333] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:07.246986 13639 raft_consensus.cc:359] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.190968 13640 tablet_bootstrap.cc:654] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:07.255879 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bfb69a7ce74175b4f1f5f4db583aa9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:07.256605 13467 raft_consensus.cc:2468] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:07.257705 15348 raft_consensus.cc:2243] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:07.262307 15348 raft_consensus.cc:2272] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:07.264056 15471 lock_manager.cc:585] Waited 5 seconds to obtain row lock on key '<redacted>' (key hash 12749420330613191736) tablet 00000000000000000000000000000000 cur holder 0x7b5800043200
I20260810 13:54:07.267115 15348 ts_tablet_manager.cc:1916] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:07.173038 13167 leader_election.cc:304] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:07.277056 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 104109us
I20260810 13:54:07.164254 13638 raft_consensus.cc:359] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.278024 13638 raft_consensus.cc:385] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:07.278318 13638 raft_consensus.cc:740] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:07.278999 13638 consensus_queue.cc:260] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:07.187321 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 249495us
I20260810 13:54:07.191489 15321 ts_tablet_manager.cc:1929] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:07.280961 15321 log.cc:1199] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/00a7bce2378f482d81d2ad08e9d15b0c
I20260810 13:54:07.281656 15321 ts_tablet_manager.cc:1950] T 00a7bce2378f482d81d2ad08e9d15b0c P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:07.282315 15704 raft_consensus.cc:2804] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:07.282819 15704 raft_consensus.cc:697] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:07.283655 15704 consensus_queue.cc:237] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.284065 13164 leader_election.cc:304] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:07.286456 15694 raft_consensus.cc:3060] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:07.288936 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:07.289433 12721 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 45620.9us
I20260810 13:54:07.292603 13638 ts_tablet_manager.cc:1434] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.130s user 0.006s sys 0.000s
I20260810 13:54:07.260499 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb30ebe9520d4224bdfd45a5e915d8bd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:07.285012 12952 leader_election.cc:343] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:07.301534 15702 tablet_replica.cc:333] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:07.299818 15710 tablet.cc:1724] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:07.302345 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 449) took 3531 ms. Trace:
I20260810 13:54:07.302495 15702 raft_consensus.cc:2243] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:07.302696 15321 rpcz_store.cc:276] 0810 13:54:03.771024 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.777986 (+ 6962us) service_pool.cc:224] Handling call
0810 13:54:06.873918 (+3095932us) ts_tablet_manager.cc:1151] Deleting tablet 00a7bce2378f482d81d2ad08e9d15b0c
0810 13:54:06.909759 (+ 35841us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.099348 (+189589us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54000956d4. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f911eaac951 00007f911eb4b742 00007f911ef8bd2c 00007f911fbf341a 00007f911fc240e0 00007f911fc0a64d 00007f911fc0a5f9 00007f911fc0a589 00007f911fc0a551 00007f911fc0977d 00000000005bd8c4
0810 13:54:07.126263 (+ 26915us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.191362 (+ 65099us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.302284 (+110922us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405639040,"tablet-delete.queue_time_us":3094982}
I20260810 13:54:07.303509 15702 raft_consensus.cc:2272] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:07.304191 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 450) took 3524 ms. Trace:
I20260810 13:54:07.305588 13638 tablet_bootstrap.cc:492] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:07.305997 13639 raft_consensus.cc:385] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:07.306303 13639 raft_consensus.cc:740] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:07.307010 13639 consensus_queue.cc:260] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.310799 15635 raft_consensus.cc:493] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:07.311277 15635 raft_consensus.cc:515] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.304489 15321 rpcz_store.cc:276] 0810 13:54:03.779719 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.779857 (+ 138us) service_pool.cc:224] Handling call
0810 13:54:07.303857 (+3524000us) ts_tablet_manager.cc:1151] Deleting tablet bf672d15f88c4f0dbdf2fdb6aefa1108
0810 13:54:07.303896 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.304139 (+ 243us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3523389}
I20260810 13:54:07.312507 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 451) took 3532 ms. Trace:
I20260810 13:54:07.312804 15321 rpcz_store.cc:276] 0810 13:54:03.780159 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.780726 (+ 567us) service_pool.cc:224] Handling call
0810 13:54:07.312148 (+3531422us) ts_tablet_manager.cc:1151] Deleting tablet d5aa1374d37a4918af34a5e9b15c16b3
0810 13:54:07.312191 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.312455 (+ 264us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3530485}
I20260810 13:54:07.313227 15635 leader_election.cc:290] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:07.313819 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 453) took 3150 ms. Trace:
I20260810 13:54:07.314092 15321 rpcz_store.cc:276] 0810 13:54:04.163417 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.163638 (+ 221us) service_pool.cc:224] Handling call
0810 13:54:07.313584 (+3149946us) ts_tablet_manager.cc:1151] Deleting tablet 063e3b74a9a248a1aa0c2de4b4b73a06
0810 13:54:07.313623 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.313775 (+ 152us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2989881}
I20260810 13:54:07.314975 15321 tablet_replica.cc:333] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:07.315694 15321 raft_consensus.cc:2243] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:07.316182 15321 raft_consensus.cc:2272] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:07.316627 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 1b84bd35b02f4a1faf15ac9bc21e6146 (table default.Table_cb09b1a8472e4349bbbac0669af3d045 [id=5222178a76314f4da374fe8c2984369b]) successfully deleted
W20260810 13:54:07.317622 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 0a6893b0b32646f6aeb72c866251a112 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0a6893b0b32646f6aeb72c866251a112 already in progress: creating tablet
W20260810 13:54:07.318994 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 452978fbf3b74e3c9b16756b9f394be7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 452978fbf3b74e3c9b16756b9f394be7 already in progress: creating tablet
W20260810 13:54:07.320974 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba5b835c1bf44c59a4ea7ab4b9ea93f4 already in progress: creating tablet
I20260810 13:54:07.327874 15321 ts_tablet_manager.cc:1916] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:07.278609 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_9d81870e910444848f2c714a1b9da18c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:07.317997 13640 tablet_bootstrap.cc:492] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:07.334187 13640 ts_tablet_manager.cc:1403] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.191s user 0.010s sys 0.001s
I20260810 13:54:07.323241 15702 ts_tablet_manager.cc:1916] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:07.336006 13639 ts_tablet_manager.cc:1434] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.104s user 0.005s sys 0.000s
I20260810 13:54:07.338716 13640 raft_consensus.cc:359] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:07.339847 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d81870e910444848f2c714a1b9da18c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:07.323902 15694 raft_consensus.cc:2749] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:07.335819 13638 tablet_bootstrap.cc:654] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:07.346179 13639 tablet_bootstrap.cc:492] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:07.266466 15707 tablet.cc:1724] T 2e5ad84fe2604dd2959768db31f66e7c P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:07.346359 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 00a7bce2378f482d81d2ad08e9d15b0c (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]) successfully deleted
W20260810 13:54:07.358297 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet bf672d15f88c4f0dbdf2fdb6aefa1108 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf672d15f88c4f0dbdf2fdb6aefa1108 already in progress: creating tablet
W20260810 13:54:07.359246 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet d5aa1374d37a4918af34a5e9b15c16b3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5aa1374d37a4918af34a5e9b15c16b3 already in progress: creating tablet
W20260810 13:54:07.360417 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 063e3b74a9a248a1aa0c2de4b4b73a06 because the tablet was not found. No further retry: Not found: Tablet not found: 063e3b74a9a248a1aa0c2de4b4b73a06
W20260810 13:54:07.362336 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 because the tablet was not found. No further retry: Not found: Tablet not found: ab4cd2e5c73e467eb1bc4623e5d5e831
W20260810 13:54:07.364259 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6453dd9e48244c87b339ec515898bb0c consensus state has no leader
I20260810 13:54:07.366127 12744 master_service.cc:960] ReplaceTablet: received request to replace tablet d0e488e3e89047b18178c9cb64d74bef from {username='slave'} at 127.0.0.1:48758
I20260810 13:54:07.366240 13640 raft_consensus.cc:385] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:07.366932 13640 raft_consensus.cc:740] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:07.370090 12743 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 629) took 1162 ms. Trace:
I20260810 13:54:07.373413 12750 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 631) took 1028 ms. Trace:
I20260810 13:54:07.373778 12750 rpcz_store.cc:276] 0810 13:54:06.344761 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.344854 (+ 93us) service_pool.cc:224] Handling call
0810 13:54:06.361223 (+ 16369us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:54:06.363077 (+ 1854us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:54:06.364439 (+ 1362us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:54:07.264713 (+900274us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:54:07.372841 (+108128us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:54:07.373250 (+ 409us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:07.227894 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:07.228532 (+ 638us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:07.228577 (+ 45us) write_op.cc:435] Acquired schema lock
0810 13:54:07.228589 (+ 12us) tablet.cc:662] Decoding operations
0810 13:54:07.231227 (+ 2638us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:07.231286 (+ 59us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:07.231309 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:07.231707 (+ 398us) tablet.cc:701] Row locks acquired
0810 13:54:07.231720 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:54:07.231930 (+ 210us) write_op.cc:270] Start()
0810 13:54:07.232064 (+ 134us) write_op.cc:276] Timestamp: P: 1786370047231789 usec, L: 0
0810 13:54:07.232111 (+ 47us) op_driver.cc:348] REPLICATION: starting
0810 13:54:07.238205 (+ 6094us) log.cc:844] Serialized 433 byte log entry
0810 13:54:07.252913 (+ 14708us) op_driver.cc:464] REPLICATION: finished
0810 13:54:07.262418 (+ 9505us) write_op.cc:301] APPLY: starting
0810 13:54:07.262483 (+ 65us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:07.262609 (+ 126us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:07.262753 (+ 144us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:07.263236 (+ 483us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:07.263415 (+ 179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:54:07.263464 (+ 49us) write_op.cc:312] APPLY: finished
0810 13:54:07.263652 (+ 188us) log.cc:844] Serialized 29 byte log entry
0810 13:54:07.263814 (+ 162us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:07.263884 (+ 70us) write_op.cc:454] Released schema lock
0810 13:54:07.263919 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0810 13:54:07.264713 (+ 794us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:07.264747 (+ 34us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":35993344,"child_traces":[["op",{"apply.queue_time_us":9331,"apply.run_cpu_time_us":1826,"apply.run_wall_time_us":2224,"num_ops":2,"prepare.queue_time_us":854328,"prepare.run_cpu_time_us":2652,"prepare.run_wall_time_us":10654,"replication_time_us":20685}]]}
I20260810 13:54:07.379415 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 8d647bf5c1ba42f48186661310065448
I20260810 13:54:07.379945 13640 consensus_queue.cc:260] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.381597 12742 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 630) took 1037 ms. Trace:
I20260810 13:54:07.382550 15466 raft_consensus.cc:493] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:07.383190 15466 raft_consensus.cc:515] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.385654 15466 leader_election.cc:290] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:07.385789 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2e79b198186741b39955b48b1832908a" } modify_external_catalogs: true
I20260810 13:54:07.386373 15466 raft_consensus.cc:493] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:07.387292 15466 raft_consensus.cc:515] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.389781 15466 leader_election.cc:290] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:07.370465 12743 rpcz_store.cc:276] 0810 13:54:06.207174 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.207332 (+ 158us) service_pool.cc:224] Handling call
0810 13:54:06.248515 (+ 41183us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c81c6 00007fec6df7c034 00007fec6df7bfc2 00007fec6df7bef1 00007fec6df7be6c 00007fec6df7b122 00007fec6c22207c 00007fec6c2214b6
0810 13:54:06.250465 (+ 1950us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:54:06.251786 (+ 1321us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:54:07.041555 (+789769us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:54:07.369504 (+327949us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:54:07.369914 (+ 410us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:06.774166 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:06.774555 (+ 389us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:06.774578 (+ 23us) write_op.cc:435] Acquired schema lock
0810 13:54:06.774590 (+ 12us) tablet.cc:662] Decoding operations
0810 13:54:06.774844 (+ 254us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:06.774888 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:06.774911 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:06.775096 (+ 185us) tablet.cc:701] Row locks acquired
0810 13:54:06.775108 (+ 12us) write_op.cc:260] PREPARE: finished
0810 13:54:06.775213 (+ 105us) write_op.cc:270] Start()
0810 13:54:06.775291 (+ 78us) write_op.cc:276] Timestamp: P: 1786370046775136 usec, L: 0
0810 13:54:06.775305 (+ 14us) op_driver.cc:348] REPLICATION: starting
0810 13:54:06.775760 (+ 455us) log.cc:844] Serialized 433 byte log entry
0810 13:54:06.987777 (+212017us) op_driver.cc:464] REPLICATION: finished
0810 13:54:07.038855 (+ 51078us) write_op.cc:301] APPLY: starting
0810 13:54:07.038953 (+ 98us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:07.039094 (+ 141us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:07.039201 (+ 107us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:07.039717 (+ 516us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:07.039897 (+ 180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:54:07.039964 (+ 67us) write_op.cc:312] APPLY: finished
0810 13:54:07.040335 (+ 371us) log.cc:844] Serialized 29 byte log entry
0810 13:54:07.041050 (+ 715us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:07.041164 (+ 114us) write_op.cc:454] Released schema lock
0810 13:54:07.041200 (+ 36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":78879616,"child_traces":[["op",{"apply.queue_time_us":50906,"apply.run_cpu_time_us":1954,"apply.run_wall_time_us":3207,"num_ops":2,"prepare.queue_time_us":508540,"prepare.run_cpu_time_us":1787,"prepare.run_wall_time_us":2720,"replication_time_us":212319,"thread_start_us":234183,"threads_started":1}]]}
I20260810 13:54:07.395180 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet ce9243eda3974532aff0425885f54166 (table default.Table_56bad358a07547909304ec6d4ca91118 [id=eb9d4e7dfab6444ba91f07b1cec13b18]) successfully deleted
I20260810 13:54:07.402163 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d647bf5c1ba42f48186661310065448 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:06 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:07.381880 12742 rpcz_store.cc:276] 0810 13:54:06.344427 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.344547 (+ 120us) service_pool.cc:224] Handling call
0810 13:54:06.358382 (+ 13835us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c84d6 00007fec6df80b34 00007fec6df80ac2 00007fec6df809f1 00007fec6df8096c 00007fec6df7fc22 00007fec6c22207c 00007fec6c2214b6
0810 13:54:06.359428 (+ 1046us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:54:06.359989 (+ 561us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:54:06.360137 (+ 148us) catalog_manager.cc:2850] Locking tablets
0810 13:54:06.370563 (+ 10426us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:54:07.244447 (+873884us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:54:07.378965 (+134518us) catalog_manager.cc:2898] Committing in-memory state
0810 13:54:07.379177 (+ 212us) catalog_manager.cc:2902] Aborting table tasks
0810 13:54:07.381515 (+ 2338us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:06.981359 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:06.981860 (+ 501us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:06.981910 (+ 50us) write_op.cc:435] Acquired schema lock
0810 13:54:06.981928 (+ 18us) tablet.cc:662] Decoding operations
0810 13:54:06.982340 (+ 412us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:06.982433 (+ 93us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:06.982467 (+ 34us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:06.982859 (+ 392us) tablet.cc:701] Row locks acquired
0810 13:54:06.982880 (+ 21us) write_op.cc:260] PREPARE: finished
0810 13:54:06.983010 (+ 130us) write_op.cc:270] Start()
0810 13:54:06.997233 (+ 14223us) write_op.cc:276] Timestamp: P: 1786370046982909 usec, L: 0
0810 13:54:06.997258 (+ 25us) op_driver.cc:348] REPLICATION: starting
0810 13:54:07.226324 (+229066us) log.cc:844] Serialized 756 byte log entry
0810 13:54:07.227456 (+ 1132us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c0951 00007fec6e553208 00007fec6e9e2f61 00007fec6e9e2738 00007fec6e9e73d1 00007fec6e9e7389 00007fec6e9e7319 00007fec6e9e72e1 00007fec6e9e650d 00000000005bd8c4 00000000005bd6f9
0810 13:54:07.240455 (+ 12999us) op_driver.cc:464] REPLICATION: finished
0810 13:54:07.242759 (+ 2304us) write_op.cc:301] APPLY: starting
0810 13:54:07.242813 (+ 54us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:07.242923 (+ 110us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:07.242953 (+ 30us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:07.243326 (+ 373us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:07.243486 (+ 160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:54:07.243557 (+ 71us) write_op.cc:312] APPLY: finished
0810 13:54:07.243756 (+ 199us) log.cc:844] Serialized 29 byte log entry
0810 13:54:07.243910 (+ 154us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:07.243974 (+ 64us) write_op.cc:454] Released schema lock
0810 13:54:07.244004 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0810 13:54:07.244237 (+ 233us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:07.244262 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":30152064,"child_traces":[["op",{"apply.queue_time_us":2081,"apply.run_cpu_time_us":1449,"apply.run_wall_time_us":1449,"num_ops":2,"prepare.queue_time_us":608818,"prepare.run_cpu_time_us":5006,"prepare.run_wall_time_us":246349,"replication_time_us":243097,"spinlock_wait_cycles":523757952}]]}
I20260810 13:54:07.416985 15633 raft_consensus.cc:493] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:07.417492 15633 raft_consensus.cc:515] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.419588 15633 leader_election.cc:290] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:07.421311 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d647bf5c1ba42f48186661310065448 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:06 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:07.422887 12951 leader_election.cc:304] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:54:07.423632 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6453dd9e48244c87b339ec515898bb0c consensus state has no leader
W20260810 13:54:07.423808 13167 consensus_peers.cc:597] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:07.424438 15633 raft_consensus.cc:2804] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:07.424817 15633 raft_consensus.cc:493] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:07.425360 15633 raft_consensus.cc:3060] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:07.429822 15707 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:42314 (request call id 474) took 1172 ms. Trace:
I20260810 13:54:07.431794 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet fe4755e4fcfd4af087ce5831a4e02022 (table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9]). Expected version 1 got 0
I20260810 13:54:07.432497 12742 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
W20260810 13:54:07.433930 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 149965us
I20260810 13:54:07.435169 13164 leader_election.cc:304] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:07.435905 15718 raft_consensus.cc:2749] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:07.432289 15707 rpcz_store.cc:276] 0810 13:54:06.257902 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.260789 (+ 2887us) service_pool.cc:224] Handling call
0810 13:54:07.429755 (+1168966us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:06.353318 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:06.353675 (+ 357us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:06.353703 (+ 28us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:06.353745 (+ 42us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:06.353868 (+ 123us) alter_schema_op.cc:128] START. Timestamp: 1786370046353795
0810 13:54:06.353889 (+ 21us) op_driver.cc:348] REPLICATION: starting
0810 13:54:06.354421 (+ 532us) log.cc:844] Serialized 173 byte log entry
0810 13:54:06.397084 (+ 42663us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5400218f20. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f911eaad470 00007f911eabaa98 00007f911eaba6da 00007f911eb3ed45 00007f911eb3f1e9 00007f911efcef61 00007f911efce738 00007f911efd33d1 00007f911efd3389 00007f911efd3319 00007f911efd32e1
0810 13:54:07.114482 (+717398us) op_driver.cc:464] REPLICATION: finished
0810 13:54:07.266307 (+151825us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:07.347213 (+ 80906us) log.cc:844] Serialized 5 byte log entry
0810 13:54:07.416527 (+ 69314us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.429507 (+ 12980us) log.cc:844] Serialized 14 byte log entry
0810 13:54:07.429606 (+ 99us) alter_schema_op.cc:73] Released schema lock
0810 13:54:07.429636 (+ 30us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":151497,"prepare.queue_time_us":73176,"prepare.run_cpu_time_us":3707,"prepare.run_wall_time_us":64959,"raft.queue_time_us":19927,"raft.run_cpu_time_us":919,"raft.run_wall_time_us":919,"replication_time_us":760497,"spinlock_wait_cycles":48886144,"thread_start_us":247179,"threads_started":3,"wal-append.queue_time_us":869}]]}
I20260810 13:54:07.446061 13638 tablet_bootstrap.cc:492] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:07.446462 13638 ts_tablet_manager.cc:1403] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.141s user 0.010s sys 0.000s
I20260810 13:54:07.448459 15633 raft_consensus.cc:515] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.450901 15633 leader_election.cc:290] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:07.452086 12739 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 2e5ad84fe2604dd2959768db31f66e7c (table default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]). Expected version 2 got 1
I20260810 13:54:07.453076 12739 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:54:07.454027 12739 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet fe4755e4fcfd4af087ce5831a4e02022 (table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9]). Expected version 1 got 0
I20260810 13:54:07.453926 13638 raft_consensus.cc:359] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.454615 13638 raft_consensus.cc:385] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:07.454880 13638 raft_consensus.cc:740] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:07.455315 13164 leader_election.cc:304] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:07.455519 13638 consensus_queue.cc:260] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:07.456067 15694 raft_consensus.cc:2764] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260810 13:54:07.456799 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:07.466053 13382 consensus_peers.cc:597] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73ad47d29d61456891478a9544594a94. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:07.490422 13638 ts_tablet_manager.cc:1434] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.044s user 0.006s sys 0.001s
I20260810 13:54:07.491243 15633 consensus_queue.cc:1048] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:07.497846 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet d0e488e3e89047b18178c9cb64d74bef
I20260810 13:54:07.500818 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8aea1057f445a9b060d138952324ca" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:07.501590 13041 raft_consensus.cc:2393] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
W20260810 13:54:07.502357 13164 consensus_peers.cc:597] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03c640dce5dd4fc8a49f07fb983c50eb. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:07.504230 13167 leader_election.cc:343] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: ef59f7013ab4489dadd9084d065533a8
I20260810 13:54:07.505153 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 1a4fe8abad5649f2a42686c00148d957
I20260810 13:54:07.520397 13639 tablet_bootstrap.cc:700] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Time spent opening tablet: real 0.150s user 0.001s sys 0.001s
I20260810 13:54:07.521481 12747 catalog_manager.cc:6807] ReplaceTablet: tablet 1a4fe8abad5649f2a42686c00148d957 deleted and replaced by tablet df3031d8f75d4548b458cee6dd2083d2
I20260810 13:54:07.521296 13639 tablet_bootstrap.cc:654] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:07.524899 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a4fe8abad5649f2a42686c00148d957 with delete_type TABLET_DATA_DELETED (replaced by tablet df3031d8f75d4548b458cee6dd2083d2) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:07.527748 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet d0e488e3e89047b18178c9cb64d74bef with delete_type TABLET_DATA_DELETED (replaced by tablet 78e70ef9f0b642ab92d866cac1263cf8) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:07.528901 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 61853.4us
I20260810 13:54:07.529743 12744 catalog_manager.cc:6807] ReplaceTablet: tablet d0e488e3e89047b18178c9cb64d74bef deleted and replaced by tablet 78e70ef9f0b642ab92d866cac1263cf8
W20260810 13:54:07.530288 13382 leader_election.cc:343] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:07.531245 13382 leader_election.cc:343] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:07.454949 12739 catalog_manager.cc:5719] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:07.512097 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4
I20260810 13:54:07.542311 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:07 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:07.544728 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb30ebe9520d4224bdfd45a5e915d8bd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:07.545759 12739 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
I20260810 13:54:07.546557 12739 catalog_manager.cc:5719] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:07.548081 12739 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]). Expected version 1 got 0
I20260810 13:54:07.550554 13640 ts_tablet_manager.cc:1434] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.214s user 0.005s sys 0.002s
I20260810 13:54:07.551746 13640 tablet_bootstrap.cc:492] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:07.553288 15633 consensus_queue.cc:1048] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:07.560778 15321 ts_tablet_manager.cc:1929] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:54:07.561195 15321 log.cc:1199] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/73ad47d29d61456891478a9544594a94
I20260810 13:54:07.561935 15321 ts_tablet_manager.cc:1950] T 73ad47d29d61456891478a9544594a94 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:07.564400 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:07.568161 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5818235bc6094cb69999b2a6a1552d79" } new_table_name: "default.Table_b0a69610e50f4a43b2582f0cbfb2c87a" modify_external_catalogs: true
I20260810 13:54:07.576591 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d9a82635a9fc49d9943077eb2387dddb" } new_table_name: "default.Table_bbd75dd66aa8416d924106d384b46ed7" modify_external_catalogs: true
I20260810 13:54:07.560379 15702 ts_tablet_manager.cc:1929] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:07.564971 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a4fe8abad5649f2a42686c00148d957 with delete_type TABLET_DATA_DELETED (replaced by tablet df3031d8f75d4548b458cee6dd2083d2) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:07.581087 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet d0e488e3e89047b18178c9cb64d74bef with delete_type TABLET_DATA_DELETED (replaced by tablet 78e70ef9f0b642ab92d866cac1263cf8) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:07.583927 15702 log.cc:1199] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/03c640dce5dd4fc8a49f07fb983c50eb
I20260810 13:54:07.584992 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8aea1057f445a9b060d138952324ca" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:07.585371 15702 ts_tablet_manager.cc:1950] T 03c640dce5dd4fc8a49f07fb983c50eb P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:07.585731 13259 raft_consensus.cc:3060] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:07.589555 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:07 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:54:07.595204 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78e70ef9f0b642ab92d866cac1263cf8 has no consensus state
W20260810 13:54:07.599850 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 57670us
I20260810 13:54:07.595861 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4b2d4fca101f4cbc9f296c50ca183066"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:07.600998 12952 leader_election.cc:343] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:07.601610 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 455) took 3261 ms. Trace:
W20260810 13:54:07.601861 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b2d4fca101f4cbc9f296c50ca183066 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:07.601920 12952 leader_election.cc:343] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:07.602030 15321 rpcz_store.cc:276] 0810 13:54:04.339838 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.340187 (+ 349us) service_pool.cc:224] Handling call
0810 13:54:07.314848 (+2974661us) ts_tablet_manager.cc:1151] Deleting tablet 73ad47d29d61456891478a9544594a94
0810 13:54:07.314884 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.426260 (+111376us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.506536 (+ 80276us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.601545 (+ 95009us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2973912}
I20260810 13:54:07.602563 15710 tablet.cc:1724] T fe4755e4fcfd4af087ce5831a4e02022 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:07.603631 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 73ad47d29d61456891478a9544594a94 (table default.Table_c04efa0403424fbcb37f7215ea9dcd8b [id=41ab72dabf7e4cbaaa1c8010766780c4]) successfully deleted
I20260810 13:54:07.607338 15633 consensus_queue.cc:1048] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:07.611775 15707 tablet.cc:1724] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:07.614117 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 03c640dce5dd4fc8a49f07fb983c50eb (table default.Table_5306ac6359cd4033b2c54ad5db69828c [id=66a8a9b05b3a45f681081deace48b4a9]) successfully deleted
W20260810 13:54:07.614841 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 8d647bf5c1ba42f48186661310065448 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d647bf5c1ba42f48186661310065448 already in progress: creating tablet
I20260810 13:54:07.618261 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2711040d5d0d4fc2aeae4dd363d789a6" } modify_external_catalogs: true
I20260810 13:54:07.619525 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2711040d5d0d4fc2aeae4dd363d789a6" } modify_external_catalogs: true
W20260810 13:54:07.628135 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4520d51666b04814814fbaa8b71430fc consensus state has no leader
I20260810 13:54:07.635816 15348 ts_tablet_manager.cc:1929] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260810 13:54:07.636024 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 454) took 3300 ms. Trace:
I20260810 13:54:07.636204 15348 log.cc:1199] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/5dac7ad18d3c4fb58171ff8ab959d98a
I20260810 13:54:07.636333 15321 rpcz_store.cc:276] 0810 13:54:04.335387 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.339969 (+ 4582us) service_pool.cc:224] Handling call
0810 13:54:07.635551 (+3295582us) ts_tablet_manager.cc:1151] Deleting tablet 39ff3a48af494009bb53ee8d4e2a08cd
0810 13:54:07.635599 (+ 48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.635960 (+ 361us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3276996}
I20260810 13:54:07.638495 13639 tablet_bootstrap.cc:492] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:07.638943 13639 ts_tablet_manager.cc:1403] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.293s user 0.005s sys 0.005s
W20260810 13:54:07.643688 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 39ff3a48af494009bb53ee8d4e2a08cd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 39ff3a48af494009bb53ee8d4e2a08cd already in progress: creating tablet
I20260810 13:54:07.644963 13638 tablet_bootstrap.cc:492] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:07.646533 15348 ts_tablet_manager.cc:1950] T 5dac7ad18d3c4fb58171ff8ab959d98a P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:07.644431 13639 raft_consensus.cc:359] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.660321 15724 raft_consensus.cc:493] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:07.661100 15724 raft_consensus.cc:515] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:07.669039 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 136659us
I20260810 13:54:07.659149 13639 raft_consensus.cc:385] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:07.669629 13639 raft_consensus.cc:740] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:07.676373 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 456) took 2942 ms. Trace:
I20260810 13:54:07.676754 15321 rpcz_store.cc:276] 0810 13:54:04.733962 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.736209 (+ 2247us) service_pool.cc:224] Handling call
0810 13:54:07.675192 (+2938983us) ts_tablet_manager.cc:1151] Deleting tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c
0810 13:54:07.675905 (+ 713us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.676305 (+ 400us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2938305}
I20260810 13:54:07.677088 13639 consensus_queue.cc:260] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:07.678262 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c already in progress: creating tablet
I20260810 13:54:07.679288 13639 ts_tablet_manager.cc:1434] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.040s user 0.007s sys 0.003s
I20260810 13:54:07.684665 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 460) took 1954 ms. Trace:
I20260810 13:54:07.685009 15321 rpcz_store.cc:276] 0810 13:54:05.729883 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:05.730116 (+ 233us) service_pool.cc:224] Handling call
0810 13:54:07.678104 (+1947988us) ts_tablet_manager.cc:1151] Deleting tablet 34b2314b771f41188bc8101c5ddffaf4
0810 13:54:07.684293 (+ 6189us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.684544 (+ 251us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1931838}
I20260810 13:54:07.684885 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_08e421ad9e1d4274b11c4cb314c36201"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:07.689764 15633 raft_consensus.cc:493] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:07.686329 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 34b2314b771f41188bc8101c5ddffaf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34b2314b771f41188bc8101c5ddffaf4 already in progress: creating tablet
W20260810 13:54:07.690003 13382 leader_election.cc:343] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:07.690390 13382 leader_election.cc:304] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:07.693280 13640 tablet_bootstrap.cc:654] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:07.694242 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08e421ad9e1d4274b11c4cb314c36201 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:07.694621 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]). Expected version 1 got 0
I20260810 13:54:07.696012 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet fe4755e4fcfd4af087ce5831a4e02022 (table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9]). Expected version 1 got 0
I20260810 13:54:07.699214 15721 raft_consensus.cc:2749] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:07.690353 15633 raft_consensus.cc:515] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.710258 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:07.664505 15724 leader_election.cc:290] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:07.711894 15707 tablet.cc:1724] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 13:54:07.701412 13382 leader_election.cc:343] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:07.735868 13382 leader_election.cc:304] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:07.737048 15724 raft_consensus.cc:2749] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:07.740319 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:07.741194 13467 raft_consensus.cc:2468] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:07.743441 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e29a3f5b330e407d9a9e94706d641719" } modify_external_catalogs: true
I20260810 13:54:07.744024 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_e29a3f5b330e407d9a9e94706d641719" } modify_external_catalogs: true
I20260810 13:54:07.746809 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:07.747695 13467 raft_consensus.cc:2468] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:07.748065 12746 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0] alter complete (version 2)
I20260810 13:54:07.753314 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_210fb0797673402e8e79fcf4e3c293b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:07.753906 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:07.755105 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_210fb0797673402e8e79fcf4e3c293b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:07.756410 13231 tablet_service.cc:1558] Processing DeleteTablet for tablet 00a7bce2378f482d81d2ad08e9d15b0c with delete_type TABLET_DATA_DELETED (replaced by tablet a10f8466fc2844608eec8e781fc2e8a0) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:07.757483 12952 leader_election.cc:343] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:07.758025 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet ef59f7013ab4489dadd9084d065533a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 57fc6408d6664e9887b150d1cb934a8d) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:07.758263 15739 log.cc:927] Time spent T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.092s user 0.001s sys 0.000s
I20260810 13:54:07.759974 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet cb8aea1057f445a9b060d138952324ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:07.762938 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 441) took 7105 ms. Trace:
I20260810 13:54:07.763331 15348 rpcz_store.cc:276] 0810 13:54:00.657882 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.659420 (+ 1538us) service_pool.cc:224] Handling call
0810 13:54:07.241185 (+6581765us) ts_tablet_manager.cc:1151] Deleting tablet 5dac7ad18d3c4fb58171ff8ab959d98a
0810 13:54:07.241253 (+ 68us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.360005 (+118752us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.635659 (+275654us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.762833 (+127174us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6581129}
I20260810 13:54:07.764858 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 435) took 7190 ms. Trace:
I20260810 13:54:07.765201 15348 rpcz_store.cc:276] 0810 13:54:00.574249 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.574450 (+ 201us) service_pool.cc:224] Handling call
0810 13:54:07.764288 (+7189838us) ts_tablet_manager.cc:1151] Deleting tablet 48a059240c0f48ee958ef728acfcae92
0810 13:54:07.764363 (+ 75us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.764805 (+ 442us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7091024}
I20260810 13:54:07.766361 15348 tablet_replica.cc:333] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:07.769155 15348 raft_consensus.cc:2243] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:07.769817 15348 raft_consensus.cc:2272] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:07.772188 15348 ts_tablet_manager.cc:1916] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:07.779644 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_72e9522a295642b28aa17f724e010d9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:07.781322 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72e9522a295642b28aa17f724e010d9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:07.713658 13259 raft_consensus.cc:2468] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:07.785025 13639 tablet_bootstrap.cc:492] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:07.785187 12952 leader_election.cc:304] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:07.788724 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 1a4fe8abad5649f2a42686c00148d957 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a4fe8abad5649f2a42686c00148d957 already in progress: creating tablet
I20260810 13:54:07.790336 15633 leader_election.cc:290] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:07.791165 15633 raft_consensus.cc:2804] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:07.791899 15633 raft_consensus.cc:697] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:07.793020 15633 consensus_queue.cc:237] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:07.798074 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet d0e488e3e89047b18178c9cb64d74bef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0e488e3e89047b18178c9cb64d74bef already in progress: creating tablet
W20260810 13:54:07.798707 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 already in progress: creating tablet
I20260810 13:54:07.802575 13640 tablet_bootstrap.cc:492] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:07.803085 13640 ts_tablet_manager.cc:1403] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.252s user 0.008s sys 0.009s
I20260810 13:54:07.805671 13640 raft_consensus.cc:359] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.807790 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 461) took 2063 ms. Trace:
I20260810 13:54:07.808149 15321 rpcz_store.cc:276] 0810 13:54:05.744435 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:05.745236 (+ 801us) service_pool.cc:224] Handling call
0810 13:54:07.807414 (+2062178us) ts_tablet_manager.cc:1151] Deleting tablet 39fd2ebed17e4c1e946d7783c41d15e6
0810 13:54:07.807460 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.807729 (+ 269us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2059070}
I20260810 13:54:07.813666 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]). Expected version 1 got 0
I20260810 13:54:07.794437 15710 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:50548 (request call id 473) took 1370 ms. Trace:
I20260810 13:54:07.805042 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet 00a7bce2378f482d81d2ad08e9d15b0c with delete_type TABLET_DATA_DELETED (replaced by tablet a10f8466fc2844608eec8e781fc2e8a0) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:07.806854 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 03c640dce5dd4fc8a49f07fb983c50eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:38 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:07.814536 12745 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
I20260810 13:54:07.815277 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 464) took 1940 ms. Trace:
I20260810 13:54:07.815567 15321 rpcz_store.cc:276] 0810 13:54:05.874543 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:05.874673 (+ 130us) service_pool.cc:224] Handling call
0810 13:54:07.814876 (+1940203us) ts_tablet_manager.cc:1151] Deleting tablet a7fb3f80f940435a902c355cb699b434
0810 13:54:07.814916 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:07.815211 (+ 295us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1939645}
W20260810 13:54:07.816766 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet a7fb3f80f940435a902c355cb699b434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7fb3f80f940435a902c355cb699b434 already in progress: creating tablet
I20260810 13:54:07.820019 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_56bad358a07547909304ec6d4ca91118" } new_table_name: "default.Table_93c916a2352c47b79525650ef8c0d3ca" modify_external_catalogs: true
I20260810 13:54:07.834111 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0b822e65634b4fa6bbd83563bb9227dd" } new_table_name: "default.Table_a065ba49538e42ecb5640fb5fedcc382" modify_external_catalogs: true
W20260810 13:54:07.842909 12739 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 96) took 926 ms (client timeout 1000 ms). Trace:
W20260810 13:54:07.851560 12739 rpcz_store.cc:269] 0810 13:54:06.916332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.061367 (+145035us) service_pool.cc:224] Handling call
0810 13:54:07.273734 (+212367us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:54:07.842851 (+569117us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:07.627246 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:07.627683 (+ 437us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:07.627705 (+ 22us) write_op.cc:435] Acquired schema lock
0810 13:54:07.627717 (+ 12us) tablet.cc:662] Decoding operations
0810 13:54:07.628030 (+ 313us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:07.628086 (+ 56us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:07.628109 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:07.628481 (+ 372us) tablet.cc:701] Row locks acquired
0810 13:54:07.628497 (+ 16us) write_op.cc:260] PREPARE: finished
0810 13:54:07.628602 (+ 105us) write_op.cc:270] Start()
0810 13:54:07.628707 (+ 105us) write_op.cc:276] Timestamp: P: 1786370047628550 usec, L: 0
0810 13:54:07.628725 (+ 18us) op_driver.cc:348] REPLICATION: starting
0810 13:54:07.629267 (+ 542us) log.cc:844] Serialized 901 byte log entry
0810 13:54:07.644592 (+ 15325us) op_driver.cc:464] REPLICATION: finished
0810 13:54:07.645184 (+ 592us) write_op.cc:301] APPLY: starting
0810 13:54:07.645358 (+ 174us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:07.645573 (+ 215us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:07.645747 (+ 174us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:07.646290 (+ 543us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:07.646544 (+ 254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:54:07.646614 (+ 70us) write_op.cc:312] APPLY: finished
0810 13:54:07.672700 (+ 26086us) log.cc:844] Serialized 29 byte log entry
0810 13:54:07.676999 (+ 4299us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:07.677089 (+ 90us) write_op.cc:454] Released schema lock
0810 13:54:07.677128 (+ 39us) write_op.cc:341] FINISH: Updating metrics
0810 13:54:07.678738 (+ 1610us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:07.678798 (+ 60us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":11,"spinlock_wait_cycles":477141248,"child_traces":[["op",{"apply.queue_time_us":279,"apply.run_cpu_time_us":2366,"apply.run_wall_time_us":32225,"num_ops":2,"prepare.queue_time_us":32025,"prepare.run_cpu_time_us":2272,"prepare.run_wall_time_us":2272,"raft.queue_time_us":2154,"raft.run_cpu_time_us":1084,"raft.run_wall_time_us":12201,"replication_time_us":15726}]]}
I20260810 13:54:07.859689 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:07.863971 12750 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
W20260810 13:54:07.869625 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cafed58a5994479e91678ddbe74cd353 consensus state has no leader
I20260810 13:54:07.872890 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f7160fbf49d74f79b79a300e67af5cbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:07.874521 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f7160fbf49d74f79b79a300e67af5cbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:07.881013 12745 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9] alter complete (version 1)
W20260810 13:54:07.893956 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a82b2b44e0247f982294e5180842db3 consensus state has no leader
I20260810 13:54:07.896420 12951 leader_election.cc:304] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:07.902942 13638 tablet_bootstrap.cc:654] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:07.911054 15723 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:07.724454 15746 tablet.cc:1724] T b0b88e6d9f77487f8ed2cfafd702a753 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:07.921116 15751 raft_consensus.cc:2804] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:07.921695 15751 raft_consensus.cc:493] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:07.922369 15751 raft_consensus.cc:3060] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:07.929070 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef59f7013ab4489dadd9084d065533a8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:07.929474 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4b93246ea61e418db4efb3c2732711af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:07.929852 13261 raft_consensus.cc:2468] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
W20260810 13:54:07.931169 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b93246ea61e418db4efb3c2732711af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:07.935158 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 5dac7ad18d3c4fb58171ff8ab959d98a (table default.Table_5d1526181af947a2ae46e8e9e2718688 [id=9a3a9159f7634bc999c5c10834eb41d3]) successfully deleted
W20260810 13:54:07.935901 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 48a059240c0f48ee958ef728acfcae92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 48a059240c0f48ee958ef728acfcae92 already in progress: creating tablet
I20260810 13:54:07.941627 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:07.911785 15723 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.965258 15723 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:07.982923 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:07.817668 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8aea1057f445a9b060d138952324ca" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:07.993865 13640 raft_consensus.cc:385] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:07.994026 13467 raft_consensus.cc:3060] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:07.994220 13640 raft_consensus.cc:740] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:07.995177 13640 consensus_queue.cc:260] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:07.821139 15724 raft_consensus.cc:493] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:07.830404 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:08.003602 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 107258us
I20260810 13:54:08.004477 15724 raft_consensus.cc:515] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:08.007609 15724 leader_election.cc:290] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:08.007838 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 32721630ac494c07b015c02f4741cad8 (table default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]) was not created within the allowed timeout. Replacing with a new tablet 419f1f8bae1c458f83d6be2978cb6ecc
I20260810 13:54:08.008306 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6bfb69a7ce74175b4f1f5f4db583aa9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:08.009121 13470 raft_consensus.cc:3060] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:08.008984 13465 raft_consensus.cc:2468] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:08.013172 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a7bce2378f482d81d2ad08e9d15b0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:08.013877 13476 raft_consensus.cc:3060] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:08.016131 13467 raft_consensus.cc:2468] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:08.017855 12951 leader_election.cc:304] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:08.003795 13638 tablet_bootstrap.cc:492] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:08.018733 13638 ts_tablet_manager.cc:1403] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.419s user 0.012s sys 0.003s
I20260810 13:54:07.958663 15761 tablet.cc:1724] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:08.027859 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_819cbf37633d4c75ba529b0d037cb8db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:08.029459 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_819cbf37633d4c75ba529b0d037cb8db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:08.048430 15723 consensus_queue.cc:1048] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260810 13:54:08.055750 15723 raft_consensus.cc:2804] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:08.056188 15723 raft_consensus.cc:493] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:08.056663 15723 raft_consensus.cc:3060] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:08.059878 12721 catalog_manager.cc:5017] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 03c640dce5dd4fc8a49f07fb983c50eb because the tablet was not found. No further retry: Not found: Tablet not found: 03c640dce5dd4fc8a49f07fb983c50eb
I20260810 13:54:07.967192 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d647bf5c1ba42f48186661310065448 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:06 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:07.968035 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a4fe8abad5649f2a42686c00148d957 with delete_type TABLET_DATA_DELETED (replaced by tablet df3031d8f75d4548b458cee6dd2083d2) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:07.969442 13426 tablet_service.cc:1558] Processing DeleteTablet for tablet d0e488e3e89047b18178c9cb64d74bef with delete_type TABLET_DATA_DELETED (replaced by tablet 78e70ef9f0b642ab92d866cac1263cf8) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:08.025130 13638 raft_consensus.cc:359] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.070490 13638 raft_consensus.cc:385] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:07.814946 15710 rpcz_store.cc:276] 0810 13:54:06.423800 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.423899 (+ 99us) service_pool.cc:224] Handling call
0810 13:54:07.794361 (+1370462us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:06.442805 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:06.443101 (+ 296us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:06.443129 (+ 28us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:06.443172 (+ 43us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:06.443310 (+ 138us) alter_schema_op.cc:128] START. Timestamp: 1786370046443047
0810 13:54:06.443330 (+ 20us) op_driver.cc:348] REPLICATION: starting
0810 13:54:06.443830 (+ 500us) log.cc:844] Serialized 173 byte log entry
0810 13:54:07.582204 (+1138374us) op_driver.cc:464] REPLICATION: finished
0810 13:54:07.602469 (+ 20265us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:07.604340 (+ 1871us) log.cc:844] Serialized 5 byte log entry
0810 13:54:07.702785 (+ 98445us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:07.794150 (+ 91365us) log.cc:844] Serialized 14 byte log entry
0810 13:54:07.794239 (+ 89us) alter_schema_op.cc:73] Released schema lock
0810 13:54:07.794271 (+ 32us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":20027,"prepare.queue_time_us":3659,"prepare.run_cpu_time_us":2088,"prepare.run_wall_time_us":51898,"raft.queue_time_us":100,"raft.run_cpu_time_us":17,"raft.run_wall_time_us":17,"replication_time_us":1137297,"thread_start_us":50265,"threads_started":1,"wal-append.queue_time_us":46943,"wal-append.run_cpu_time_us":1328,"wal-append.run_wall_time_us":1001352}]]}
I20260810 13:54:08.064651 15702 tablet_replica.cc:333] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:07.971205 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:07 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:08.072250 13638 raft_consensus.cc:740] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:08.074038 13640 ts_tablet_manager.cc:1434] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.271s user 0.005s sys 0.001s
I20260810 13:54:08.074540 15321 tablet_replica.cc:333] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:08.074811 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2822dc6c838f40929cbe086ba80014db" } new_table_name: "default.Table_4af17ad5784a4e52b2dbd660bde940e0" modify_external_catalogs: true
I20260810 13:54:08.075305 15321 raft_consensus.cc:2243] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:08.075765 15321 raft_consensus.cc:2272] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:08.077432 15321 ts_tablet_manager.cc:1916] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:08.085371 15702 raft_consensus.cc:2243] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:08.086530 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8aea1057f445a9b060d138952324ca" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:08.087352 13465 raft_consensus.cc:2393] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:08.097882 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_71249f4d7f1441569904285eb7dc50e8" } new_table_name: "default.Table_47f2e1756c654cdeb68df0cedb31fc1e" modify_external_catalogs: true
I20260810 13:54:08.055325 15751 raft_consensus.cc:515] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:08.102263 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e93928dcb94ae296590c4dedfd1781" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:08.107456 15702 raft_consensus.cc:2272] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:08.113281 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e93928dcb94ae296590c4dedfd1781" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:08.121373 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 006c7409946a4122a95468288ed3aef0 consensus state has no leader
I20260810 13:54:08.125649 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_94153e136b9f4ea9aeb589c1a0322981"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:08.137378 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3f4b863f701471ab173b68049b1a602 consensus state has no leader
I20260810 13:54:08.137517 13049 raft_consensus.cc:2468] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:08.138051 12951 leader_election.cc:304] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:54:08.144004 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94153e136b9f4ea9aeb589c1a0322981 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:08.144781 13639 tablet_bootstrap.cc:654] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:08.153294 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 53527.7us
W20260810 13:54:08.153946 13382 leader_election.cc:343] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:08.158393 13382 leader_election.cc:343] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: ef59f7013ab4489dadd9084d065533a8
I20260810 13:54:08.159161 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e4f9174b7de74fd79642def9d4d0fffd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:08.161971 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e4f9174b7de74fd79642def9d4d0fffd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:08.166852 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_5eabd6d8208e4b28abd01f35c3fdfba0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:08.168357 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:08.072481 15721 raft_consensus.cc:493] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:08.169265 15721 raft_consensus.cc:515] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.176117 13640 tablet_bootstrap.cc:492] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:08.164414 12746 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet fe4755e4fcfd4af087ce5831a4e02022 (table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9]). Expected version 1 got 0
I20260810 13:54:08.170547 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef59f7013ab4489dadd9084d065533a8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:08.191653 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:08.198117 15730 raft_consensus.cc:2804] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:08.198755 15730 raft_consensus.cc:493] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:08.199376 15730 raft_consensus.cc:3060] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:08.209051 15704 consensus_queue.cc:1048] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:08.073872 13638 consensus_queue.cc:260] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.217093 13638 ts_tablet_manager.cc:1434] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.198s user 0.006s sys 0.000s
I20260810 13:54:08.220568 15721 leader_election.cc:290] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:08.224251 13638 tablet_bootstrap.cc:492] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:08.259589 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_772227d6702d4cf7bf6729e922d3eea5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:08.261334 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_772227d6702d4cf7bf6729e922d3eea5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:08.264495 15471 lock_manager.cc:585] Waited 6 seconds to obtain row lock on key '<redacted>' (key hash 12749420330613191736) tablet 00000000000000000000000000000000 cur holder 0x7b5800043200
I20260810 13:54:08.275379 13476 raft_consensus.cc:2468] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:08.235075 15746 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:50548 (request call id 487) took 1216 ms. Trace:
I20260810 13:54:08.304288 15723 raft_consensus.cc:515] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.306576 15723 leader_election.cc:290] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:08.325460 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_83e1fdd041db4bb598abc50295d4d742" } new_table_name: "default.Table_c349ffe18d0d43bdb7bcb14939f9d6db" modify_external_catalogs: true
I20260810 13:54:08.330209 15702 ts_tablet_manager.cc:1916] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:08.339097 15321 ts_tablet_manager.cc:1929] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:08.340636 15321 log.cc:1199] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/0c4e37b80b7645c2a14f3ab0c5e919d2
I20260810 13:54:08.341531 15321 ts_tablet_manager.cc:1950] T 0c4e37b80b7645c2a14f3ab0c5e919d2 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:08.341840 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1c8d47b92e21464d98e32ae2ac93fb9b" } new_table_name: "default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42" modify_external_catalogs: true
I20260810 13:54:08.344657 15751 leader_election.cc:290] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:08.373431 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:08.374218 13261 raft_consensus.cc:3060] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:08.301596 15746 rpcz_store.cc:276] 0810 13:54:07.003927 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.004072 (+ 145us) service_pool.cc:224] Handling call
0810 13:54:08.220113 (+1216041us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:07.137728 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:07.138075 (+ 347us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:07.138104 (+ 29us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:07.138151 (+ 47us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:07.138260 (+ 109us) alter_schema_op.cc:128] START. Timestamp: 1786370047138187
0810 13:54:07.138274 (+ 14us) op_driver.cc:348] REPLICATION: starting
0810 13:54:07.138799 (+ 525us) log.cc:844] Serialized 173 byte log entry
0810 13:54:07.704211 (+565412us) op_driver.cc:464] REPLICATION: finished
0810 13:54:07.724361 (+ 20150us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:07.941163 (+216802us) log.cc:844] Serialized 5 byte log entry
0810 13:54:08.201423 (+260260us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:08.202764 (+ 1341us) log.cc:844] Serialized 14 byte log entry
0810 13:54:08.206803 (+ 4039us) alter_schema_op.cc:73] Released schema lock
0810 13:54:08.206873 (+ 70us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":19928,"prepare.queue_time_us":209,"prepare.run_cpu_time_us":8412,"prepare.run_wall_time_us":37614,"replication_time_us":565741,"thread_start_us":56872,"threads_started":2,"wal-append.queue_time_us":34743}]]}
I20260810 13:54:08.383147 13261 raft_consensus.cc:2468] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:08.386145 15704 raft_consensus.cc:493] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:08.399103 15730 raft_consensus.cc:515] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.421370 15704 raft_consensus.cc:515] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:08.386741 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 84951.7us
I20260810 13:54:08.435691 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:08.401062 12952 leader_election.cc:304] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:08.426496 13639 tablet_bootstrap.cc:492] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:08.441128 13639 ts_tablet_manager.cc:1403] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.656s user 0.014s sys 0.010s
I20260810 13:54:08.442606 15748 raft_consensus.cc:2804] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:08.443352 15748 raft_consensus.cc:697] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:08.445125 13639 raft_consensus.cc:359] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.445856 13639 raft_consensus.cc:385] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:08.445971 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1c6686175347496093cb22ce8a3d4176 consensus state has no leader
I20260810 13:54:08.446168 13639 raft_consensus.cc:740] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:08.446928 13639 consensus_queue.cc:260] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.446758 15748 consensus_queue.cc:237] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.448007 15704 leader_election.cc:290] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:08.453552 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:08.454242 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:08.454870 13043 raft_consensus.cc:2393] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
W20260810 13:54:08.456173 12952 leader_election.cc:343] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:08.456352 13638 tablet_bootstrap.cc:700] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: Time spent opening tablet: real 0.216s user 0.002s sys 0.001s
I20260810 13:54:08.456738 15751 raft_consensus.cc:493] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:08.457098 13638 tablet_bootstrap.cc:654] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:08.457297 15751 raft_consensus.cc:515] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.462854 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ea7f41d802964936a967be553d7418fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:08.464623 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea7f41d802964936a967be553d7418fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:08.449412 15730 leader_election.cc:290] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:08.471253 13259 raft_consensus.cc:3060] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:08.460616 15751 leader_election.cc:290] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:08.461210 15702 ts_tablet_manager.cc:1929] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:08.473831 15702 log.cc:1199] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/00a7bce2378f482d81d2ad08e9d15b0c
I20260810 13:54:08.474651 15702 ts_tablet_manager.cc:1950] T 00a7bce2378f482d81d2ad08e9d15b0c P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:08.476244 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 00a7bce2378f482d81d2ad08e9d15b0c (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]) successfully deleted
I20260810 13:54:08.464589 13639 ts_tablet_manager.cc:1434] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.023s user 0.008s sys 0.000s
I20260810 13:54:08.477545 13639 tablet_bootstrap.cc:492] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:08.478564 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ff3a48af494009bb53ee8d4e2a08cd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:08.479775 12952 leader_election.cc:343] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:08.489419 13259 raft_consensus.cc:2468] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:08.496150 12952 leader_election.cc:304] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:08.500401 15748 raft_consensus.cc:2804] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:08.501027 15748 raft_consensus.cc:697] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:08.502043 15748 consensus_queue.cc:237] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:08.504792 13639 tablet_bootstrap.cc:654] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:08.520581 13638 tablet_bootstrap.cc:492] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:08.521701 13638 ts_tablet_manager.cc:1403] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.298s user 0.014s sys 0.009s
I20260810 13:54:08.526537 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:08.528388 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:08.530799 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_83164f9e96c540f58a5af47229b70854"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:08.532399 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83164f9e96c540f58a5af47229b70854 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:08.539502 13638 raft_consensus.cc:359] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.540194 13638 raft_consensus.cc:385] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:08.540480 13638 raft_consensus.cc:740] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:08.264665 15348 ts_tablet_manager.cc:1929] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:08.500284 15722 raft_consensus.cc:493] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:08.502576 13470 raft_consensus.cc:2468] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:08.553197 15348 log.cc:1199] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/ef59f7013ab4489dadd9084d065533a8
I20260810 13:54:08.554564 15348 ts_tablet_manager.cc:1950] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:08.547853 13638 consensus_queue.cc:260] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.536134 13640 tablet_bootstrap.cc:654] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:08.545985 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 369007us
I20260810 13:54:08.555578 13382 leader_election.cc:304] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:08.558221 15722 raft_consensus.cc:515] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.559118 15738 raft_consensus.cc:2804] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:08.559585 15738 raft_consensus.cc:493] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:08.557772 13638 ts_tablet_manager.cc:1434] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260810 13:54:08.560120 15738 raft_consensus.cc:3060] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:08.560667 15722 leader_election.cc:290] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:08.574685 13638 tablet_bootstrap.cc:492] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:08.577272 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 468) took 2548 ms. Trace:
I20260810 13:54:08.577657 15321 rpcz_store.cc:276] 0810 13:54:06.028537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.028728 (+ 191us) service_pool.cc:224] Handling call
0810 13:54:07.846559 (+1817831us) ts_tablet_manager.cc:1151] Deleting tablet 0c4e37b80b7645c2a14f3ab0c5e919d2
0810 13:54:08.074411 (+227852us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:08.138743 (+ 64332us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:08.328722 (+189979us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:08.577190 (+248468us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1817031}
I20260810 13:54:08.578982 15321 tablet_replica.cc:333] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:08.580430 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 0c4e37b80b7645c2a14f3ab0c5e919d2 (table default.Table_17e523ba6a3b40999d198d9649600be4 [id=8aed385284dd4b4db81ca50f1541807c]) successfully deleted
I20260810 13:54:08.586344 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
W20260810 13:54:08.586812 13382 leader_election.cc:343] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:08.589179 13382 leader_election.cc:304] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:08.592011 13638 tablet_bootstrap.cc:654] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:08.593621 12836 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 32721630ac494c07b015c02f4741cad8
I20260810 13:54:08.599807 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet 32721630ac494c07b015c02f4741cad8 with delete_type TABLET_DATA_DELETED (Replaced by 419f1f8bae1c458f83d6be2978cb6ecc at 2026-08-10 13:54:08 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:08.599833 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd127b3e02b54ba2a802877233c18247 consensus state has no leader
I20260810 13:54:08.602196 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet 32721630ac494c07b015c02f4741cad8 with delete_type TABLET_DATA_DELETED (Replaced by 419f1f8bae1c458f83d6be2978cb6ecc at 2026-08-10 13:54:08 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:08.603062 15702 tablet_replica.cc:333] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:08.602988 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 32905f89c1d3480abb007f8dd130e2de (DEFAULT_TABLE table=default.Table_7c263dc08783483d941121c9c3cafdc6 [id=fc5a0ae7f9074bfc89acd9077b020821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.604218 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32905f89c1d3480abb007f8dd130e2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.604135 15702 raft_consensus.cc:2243] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:08.604772 15702 raft_consensus.cc:2272] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:08.607626 15702 ts_tablet_manager.cc:1916] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:54:08.610311 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f1dd212fa9cc4ce388968cc236201a39 consensus state has no leader
I20260810 13:54:08.610095 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 32905f89c1d3480abb007f8dd130e2de (DEFAULT_TABLE table=default.Table_7c263dc08783483d941121c9c3cafdc6 [id=fc5a0ae7f9074bfc89acd9077b020821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.611306 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32905f89c1d3480abb007f8dd130e2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.616329 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a34a40f45be7413bb670738c4199fa50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:08.618110 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a34a40f45be7413bb670738c4199fa50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:08.622860 13004 tablet_service.cc:1511] Processing CreateTablet for tablet d982e709c71a4440b0cf07f11e429d72 (DEFAULT_TABLE table=default.Table_ec24cdc578624353b8936b6a7add0b7b [id=bf5a9955305343258f05d827cd3e8aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.623900 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d982e709c71a4440b0cf07f11e429d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.624154 13639 tablet_bootstrap.cc:492] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:08.624553 13639 ts_tablet_manager.cc:1403] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.147s user 0.015s sys 0.018s
I20260810 13:54:08.627960 13639 raft_consensus.cc:359] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.631677 13231 tablet_service.cc:1511] Processing CreateTablet for tablet d982e709c71a4440b0cf07f11e429d72 (DEFAULT_TABLE table=default.Table_ec24cdc578624353b8936b6a7add0b7b [id=bf5a9955305343258f05d827cd3e8aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.632965 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d982e709c71a4440b0cf07f11e429d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.628557 13639 raft_consensus.cc:385] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:08.651253 13639 raft_consensus.cc:740] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:08.652200 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 1a575515446d4e7db38c75820908b743 (DEFAULT_TABLE table=default.Table_b9529457562e49f380c06dc35ced9cfd [id=4747556e31c14e13b32ab1185728166e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.652071 13639 consensus_queue.cc:260] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.655644 15761 tablet.cc:1724] T 2e5ad84fe2604dd2959768db31f66e7c P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:08.657388 13638 tablet_bootstrap.cc:492] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:08.657994 13638 ts_tablet_manager.cc:1403] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.084s user 0.009s sys 0.010s
W20260810 13:54:08.662523 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 75739.6us
W20260810 13:54:08.663282 13382 consensus_peers.cc:597] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73ad47d29d61456891478a9544594a94. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:08.665716 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 1a575515446d4e7db38c75820908b743 (DEFAULT_TABLE table=default.Table_b9529457562e49f380c06dc35ced9cfd [id=4747556e31c14e13b32ab1185728166e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.666829 13639 ts_tablet_manager.cc:1434] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.042s user 0.006s sys 0.000s
I20260810 13:54:08.669358 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a575515446d4e7db38c75820908b743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.668452 13638 raft_consensus.cc:359] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.671231 13638 raft_consensus.cc:385] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:08.671161 13003 tablet_service.cc:1511] Processing CreateTablet for tablet e637fca32f12429d8cba24d15680051e (DEFAULT_TABLE table=default.Table_98fbef24cbef43679502dae9e67e35cf [id=1e5fe6bb81ec41d3be1b189a0631e695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.675736 13638 raft_consensus.cc:740] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:08.676805 13638 consensus_queue.cc:260] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.679512 13638 ts_tablet_manager.cc:1434] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20260810 13:54:08.680724 13638 tablet_bootstrap.cc:492] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:08.682272 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a575515446d4e7db38c75820908b743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.687737 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e637fca32f12429d8cba24d15680051e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.687896 13639 tablet_bootstrap.cc:492] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:08.691792 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
I20260810 13:54:08.695116 13208 tablet_service.cc:1511] Processing CreateTablet for tablet e637fca32f12429d8cba24d15680051e (DEFAULT_TABLE table=default.Table_98fbef24cbef43679502dae9e67e35cf [id=1e5fe6bb81ec41d3be1b189a0631e695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.696808 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e637fca32f12429d8cba24d15680051e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.713021 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 73749dd3ba784553b316d2f70ae34073 (DEFAULT_TABLE table=default.Table_0cd1166b3e534639918d41544e409ec7 [id=631d4e81ac6b445183e988a0821e0e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.714082 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73749dd3ba784553b316d2f70ae34073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.715034 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 73749dd3ba784553b316d2f70ae34073 (DEFAULT_TABLE table=default.Table_0cd1166b3e534639918d41544e409ec7 [id=631d4e81ac6b445183e988a0821e0e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.716146 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73749dd3ba784553b316d2f70ae34073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.720316 13638 tablet_bootstrap.cc:654] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:08.721663 13639 tablet_bootstrap.cc:654] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:08.722697 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet e6bfb69a7ce74175b4f1f5f4db583aa9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:08.733734 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 52900269b7f74b338d6f81480686a940 (DEFAULT_TABLE table=default.Table_ecb9a9595610488796d066d45e53880a [id=c478e4b06e604e5d8277d76680a5e8f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.734525 15321 raft_consensus.cc:2243] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:08.735579 15321 raft_consensus.cc:2272] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:08.736311 15702 ts_tablet_manager.cc:1929] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:08.737653 15321 ts_tablet_manager.cc:1916] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:08.739002 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet cb8aea1057f445a9b060d138952324ca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:45 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:08.741999 13206 tablet_service.cc:1511] Processing CreateTablet for tablet 52900269b7f74b338d6f81480686a940 (DEFAULT_TABLE table=default.Table_ecb9a9595610488796d066d45e53880a [id=c478e4b06e604e5d8277d76680a5e8f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.743439 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52900269b7f74b338d6f81480686a940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.745903 15746 tablet.cc:1724] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:08.762374 13018 tablet_service.cc:1558] Processing DeleteTablet for tablet b820c99b33264add8df5fd443981d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:08.758693 15823 tablet.cc:1724] T 98a59da23cfa4b5a9713b135d7fa4366 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:08.764752 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e93928dcb94ae296590c4dedfd1781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:08.768806 12999 tablet_service.cc:1511] Processing CreateTablet for tablet da7c4d83667c4c188e5f2774c40e5e53 (DEFAULT_TABLE table=default.Table_40ebe892a09b471581cb322124cf7630 [id=a79fc8e8c8ec420fb2c6e6cc0fdbc17e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.770607 13224 tablet_service.cc:1511] Processing CreateTablet for tablet da7c4d83667c4c188e5f2774c40e5e53 (DEFAULT_TABLE table=default.Table_40ebe892a09b471581cb322124cf7630 [id=a79fc8e8c8ec420fb2c6e6cc0fdbc17e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.664091 13382 leader_election.cc:304] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:08.778105 13018 tablet_service.cc:1511] Processing CreateTablet for tablet ffcb4016b1984ab9a00699bda1488664 (DEFAULT_TABLE table=default.Table_ec6618cc34614272b810138cd50001a0 [id=1f7d1c76a5444d188a2e4c5ba5b1fafe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.779779 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7c4d83667c4c188e5f2774c40e5e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.781270 15702 log.cc:1199] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/32721630ac494c07b015c02f4741cad8
I20260810 13:54:08.782286 15702 ts_tablet_manager.cc:1950] T 32721630ac494c07b015c02f4741cad8 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:08.762948 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52900269b7f74b338d6f81480686a940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.688463 15635 raft_consensus.cc:2749] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:08.789577 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7c4d83667c4c188e5f2774c40e5e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.790051 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcb4016b1984ab9a00699bda1488664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:08.790882 15816 tablet.cc:1724] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:08.805258 12750 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_45b2de0cf9874b08bf25152d4657565e" } new_table_name: "default.Table_5af5c57f6f844b67abe1ec29d66a1f28" modify_external_catalogs: true
I20260810 13:54:08.814357 12743 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_253b7e39c5104cbf95380f1adce4c89c" } new_table_name: "default.Table_0dd7b499a7f548c08269cf1858c67aeb" modify_external_catalogs: true
I20260810 13:54:08.818478 15635 raft_consensus.cc:493] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:08.818985 15635 raft_consensus.cc:515] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.821308 15635 leader_election.cc:290] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:08.818958 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 438) took 8242 ms. Trace:
I20260810 13:54:08.822487 15348 rpcz_store.cc:276] 0810 13:54:00.576460 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:00.654415 (+ 77955us) service_pool.cc:224] Handling call
0810 13:54:07.766163 (+7111748us) ts_tablet_manager.cc:1151] Deleting tablet ef59f7013ab4489dadd9084d065533a8
0810 13:54:07.766254 (+ 91us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:08.020169 (+253915us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:08.264517 (+244348us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:08.811653 (+547136us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400082e28. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb8823a9b41 00007fb8824316dc 00007fb88309a52b 00007fb8830cb0e0 00007fb8830b164d 00007fb8830b15f9 00007fb8830b1589 00007fb8830b1551 00007fb8830b077d 00000000005bd8c4 00000000005bd6f9
0810 13:54:08.818883 (+ 7230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1832,"spinlock_wait_cycles":268511104,"tablet-delete.queue_time_us":6836676}
I20260810 13:54:08.842360 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 449) took 7911 ms. Trace:
I20260810 13:54:08.842789 15348 rpcz_store.cc:276] 0810 13:54:00.931100 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.493159 (+562059us) service_pool.cc:224] Handling call
0810 13:54:08.841862 (+7348703us) ts_tablet_manager.cc:1151] Deleting tablet cab5c35fa6b440a7bc4ebe2709fbfc60
0810 13:54:08.841929 (+ 67us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:08.842287 (+ 358us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7348138}
I20260810 13:54:08.844663 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 454) took 7912 ms. Trace:
I20260810 13:54:08.845177 15348 rpcz_store.cc:276] 0810 13:54:00.932380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:01.518227 (+585847us) service_pool.cc:224] Handling call
0810 13:54:08.844027 (+7325800us) ts_tablet_manager.cc:1151] Deleting tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2
0810 13:54:08.844117 (+ 90us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:08.844593 (+ 476us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7324893}
I20260810 13:54:08.869437 15748 raft_consensus.cc:493] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:08.870069 15748 raft_consensus.cc:515] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:08.880316 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa729726a7f4603b0f5085a56cf89f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:08.881004 13261 raft_consensus.cc:2468] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:08.882972 12952 leader_election.cc:304] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:08.883874 15633 raft_consensus.cc:2804] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:08.884369 15633 raft_consensus.cc:493] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:08.884838 15633 raft_consensus.cc:3060] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:08.897819 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 456) took 6534 ms. Trace:
I20260810 13:54:08.898146 15348 rpcz_store.cc:276] 0810 13:54:02.363349 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.364072 (+ 723us) service_pool.cc:224] Handling call
0810 13:54:08.897397 (+6533325us) ts_tablet_manager.cc:1151] Deleting tablet 6406062bb0934eadae901502806178b5
0810 13:54:08.897453 (+ 56us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:08.897751 (+ 298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6532538}
I20260810 13:54:08.583561 15738 raft_consensus.cc:515] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:08.901583 15738 leader_election.cc:290] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:08.827559 13382 raft_consensus.cc:2686] T ef59f7013ab4489dadd9084d065533a8 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:54:08.913813 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 249772us
W20260810 13:54:08.915232 13382 leader_election.cc:343] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:08.917498 13164 leader_election.cc:304] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:08.925770 12951 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:08.926548 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet ef59f7013ab4489dadd9084d065533a8 (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]) successfully deleted
W20260810 13:54:08.927561 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet cab5c35fa6b440a7bc4ebe2709fbfc60 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cab5c35fa6b440a7bc4ebe2709fbfc60 already in progress: creating tablet
I20260810 13:54:08.826030 13640 tablet_bootstrap.cc:492] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
W20260810 13:54:08.928224 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 537b6d667f174d7f9aa8c7a4f3a2e5e2 already in progress: creating tablet
W20260810 13:54:08.929092 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 6406062bb0934eadae901502806178b5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6406062bb0934eadae901502806178b5 already in progress: creating tablet
I20260810 13:54:08.928658 13640 ts_tablet_manager.cc:1403] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.753s user 0.011s sys 0.013s
I20260810 13:54:08.945534 13224 tablet_service.cc:1511] Processing CreateTablet for tablet ffcb4016b1984ab9a00699bda1488664 (DEFAULT_TABLE table=default.Table_ec6618cc34614272b810138cd50001a0 [id=1f7d1c76a5444d188a2e4c5ba5b1fafe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.937096 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 457) took 6573 ms. Trace:
I20260810 13:54:08.949906 15321 ts_tablet_manager.cc:1929] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:08.950306 15321 log.cc:1199] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/03c640dce5dd4fc8a49f07fb983c50eb
I20260810 13:54:08.951057 15321 ts_tablet_manager.cc:1950] T 03c640dce5dd4fc8a49f07fb983c50eb P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:08.952015 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:08.946012 15348 rpcz_store.cc:276] 0810 13:54:02.363676 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.366560 (+ 2884us) service_pool.cc:224] Handling call
0810 13:54:08.898992 (+6532432us) ts_tablet_manager.cc:1151] Deleting tablet 674599456f9a49dc98d8d089c166ca89
0810 13:54:08.899056 (+ 64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:08.937038 (+ 37982us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6526271}
I20260810 13:54:08.937825 15800 raft_consensus.cc:2749] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:08.959523 13164 leader_election.cc:343] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: Tablet not RUNNING: STOPPED
I20260810 13:54:08.959934 13164 leader_election.cc:304] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:08.962800 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:08.965708 13208 tablet_service.cc:1511] Processing CreateTablet for tablet 50d8651946d242feb9cf993aff99ba1b (DEFAULT_TABLE table=default.Table_2901b91576984ac4a165471a90e86a8b [id=a67f03853a964c2fbf175165ee422881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.967813 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 50d8651946d242feb9cf993aff99ba1b (DEFAULT_TABLE table=default.Table_2901b91576984ac4a165471a90e86a8b [id=a67f03853a964c2fbf175165ee422881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.968061 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 32721630ac494c07b015c02f4741cad8 (table default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]) successfully deleted
I20260810 13:54:08.973019 15800 raft_consensus.cc:2749] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:08.958722 15722 raft_consensus.cc:493] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:08.975819 15722 raft_consensus.cc:515] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:08.977766 15722 leader_election.cc:290] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:08.979617 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet 32721630ac494c07b015c02f4741cad8 with delete_type TABLET_DATA_DELETED (Replaced by 419f1f8bae1c458f83d6be2978cb6ecc at 2026-08-10 13:54:08 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:08.981053 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 32905f89c1d3480abb007f8dd130e2de (DEFAULT_TABLE table=default.Table_7c263dc08783483d941121c9c3cafdc6 [id=fc5a0ae7f9074bfc89acd9077b020821]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.942289 15751 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:08.982558 13448 tablet_service.cc:1511] Processing CreateTablet for tablet d982e709c71a4440b0cf07f11e429d72 (DEFAULT_TABLE table=default.Table_ec24cdc578624353b8936b6a7add0b7b [id=bf5a9955305343258f05d827cd3e8aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.982877 13426 tablet_service.cc:1511] Processing CreateTablet for tablet 1a575515446d4e7db38c75820908b743 (DEFAULT_TABLE table=default.Table_b9529457562e49f380c06dc35ced9cfd [id=4747556e31c14e13b32ab1185728166e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.984040 13438 tablet_service.cc:1511] Processing CreateTablet for tablet e637fca32f12429d8cba24d15680051e (DEFAULT_TABLE table=default.Table_98fbef24cbef43679502dae9e67e35cf [id=1e5fe6bb81ec41d3be1b189a0631e695]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.987075 15816 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 525) took 1048 ms. Trace:
I20260810 13:54:08.989360 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 73749dd3ba784553b316d2f70ae34073 (DEFAULT_TABLE table=default.Table_0cd1166b3e534639918d41544e409ec7 [id=631d4e81ac6b445183e988a0821e0e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.991261 13442 tablet_service.cc:1511] Processing CreateTablet for tablet 52900269b7f74b338d6f81480686a940 (DEFAULT_TABLE table=default.Table_ecb9a9595610488796d066d45e53880a [id=c478e4b06e604e5d8277d76680a5e8f8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:08.961588 15748 leader_election.cc:290] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:09.007604 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e93928dcb94ae296590c4dedfd1781" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:09.008348 13039 raft_consensus.cc:3060] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:09.011155 13229 tablet_service.cc:1511] Processing CreateTablet for tablet ee650f1e57294de89643e84bf7914298 (DEFAULT_TABLE table=default.Table_09a6fde1eefc4ce0a591129d6ab65e3a [id=8b4fe3206c2344728b61ed31b33580a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.011386 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:09.012799 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:09.015254 13216 tablet_service.cc:1511] Processing CreateTablet for tablet b2f2b53b984441e4baee332183e4c5c3 (DEFAULT_TABLE table=default.Table_87c087a440044f9483716cce60bb4777 [id=4777400951884e84a747cbc635b6a087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.017210 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:09.018359 13639 tablet_bootstrap.cc:492] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:09.018831 13639 ts_tablet_manager.cc:1403] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.331s user 0.007s sys 0.008s
I20260810 13:54:09.019521 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcb4016b1984ab9a00699bda1488664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.020304 13004 tablet_service.cc:1511] Processing CreateTablet for tablet ee650f1e57294de89643e84bf7914298 (DEFAULT_TABLE table=default.Table_09a6fde1eefc4ce0a591129d6ab65e3a [id=8b4fe3206c2344728b61ed31b33580a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.023772 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 247fb8b09c12407d8535c07c5d0687fe
I20260810 13:54:09.025420 12744 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 643) took 1407 ms. Trace:
I20260810 13:54:09.025872 13022 tablet_service.cc:1511] Processing CreateTablet for tablet ec901677e46946578fe0929794df881f (DEFAULT_TABLE table=default.Table_586e39daebb14dfaa08b3cc251eeb18a [id=46490c79e3814a82b21ab79f2a53814e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.026970 13018 tablet_service.cc:1511] Processing CreateTablet for tablet b2f2b53b984441e4baee332183e4c5c3 (DEFAULT_TABLE table=default.Table_87c087a440044f9483716cce60bb4777 [id=4777400951884e84a747cbc635b6a087]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.025739 12744 rpcz_store.cc:276] 0810 13:54:07.617660 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.617884 (+ 224us) service_pool.cc:224] Handling call
0810 13:54:07.642563 (+ 24679us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:54:07.643323 (+ 760us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:54:07.643529 (+ 206us) catalog_manager.cc:2850] Locking tablets
0810 13:54:08.573838 (+930309us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:54:09.023333 (+449495us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:54:09.023592 (+ 259us) catalog_manager.cc:2898] Committing in-memory state
0810 13:54:09.023687 (+ 95us) catalog_manager.cc:2902] Aborting table tasks
0810 13:54:09.025340 (+ 1653us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:08.576058 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:08.576480 (+ 422us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:08.576521 (+ 41us) write_op.cc:435] Acquired schema lock
0810 13:54:08.576535 (+ 14us) tablet.cc:662] Decoding operations
0810 13:54:08.580114 (+ 3579us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:08.580154 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:08.580178 (+ 24us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:08.580491 (+ 313us) tablet.cc:701] Row locks acquired
0810 13:54:08.580507 (+ 16us) write_op.cc:260] PREPARE: finished
0810 13:54:08.580626 (+ 119us) write_op.cc:270] Start()
0810 13:54:08.580746 (+ 120us) write_op.cc:276] Timestamp: P: 1786370048580573 usec, L: 0
0810 13:54:08.580764 (+ 18us) op_driver.cc:348] REPLICATION: starting
0810 13:54:08.581357 (+ 593us) log.cc:844] Serialized 725 byte log entry
0810 13:54:09.019967 (+438610us) op_driver.cc:464] REPLICATION: finished
0810 13:54:09.021075 (+ 1108us) write_op.cc:301] APPLY: starting
0810 13:54:09.021138 (+ 63us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:09.021259 (+ 121us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:09.021363 (+ 104us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:09.021679 (+ 316us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:09.021836 (+ 157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:54:09.021911 (+ 75us) write_op.cc:312] APPLY: finished
0810 13:54:09.022136 (+ 225us) log.cc:844] Serialized 29 byte log entry
0810 13:54:09.022851 (+ 715us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:09.022923 (+ 72us) write_op.cc:454] Released schema lock
0810 13:54:09.022961 (+ 38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":911,"apply.run_cpu_time_us":1611,"apply.run_wall_time_us":6947,"num_ops":2,"prepare.queue_time_us":292,"prepare.run_cpu_time_us":2333,"prepare.run_wall_time_us":5512,"replication_time_us":439051}]]}
I20260810 13:54:09.030351 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 11e3902adc094227830cf6ddab916916
I20260810 13:54:09.032330 12742 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 645) took 1289 ms. Trace:
I20260810 13:54:09.032447 13227 tablet_service.cc:1511] Processing CreateTablet for tablet fa5fb50327a3454090bc41a2892df8c0 (DEFAULT_TABLE table=default.Table_bc50dbac8249499e90b8d763fd7041f2 [id=92622bf6828843419776bf2bbe0c6aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.032959 13008 tablet_service.cc:1511] Processing CreateTablet for tablet fa5fb50327a3454090bc41a2892df8c0 (DEFAULT_TABLE table=default.Table_bc50dbac8249499e90b8d763fd7041f2 [id=92622bf6828843419776bf2bbe0c6aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.032776 12742 rpcz_store.cc:276] 0810 13:54:07.742818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.742954 (+ 136us) service_pool.cc:224] Handling call
0810 13:54:07.744421 (+ 1467us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:54:07.745143 (+ 722us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:54:07.745406 (+ 263us) catalog_manager.cc:2850] Locking tablets
0810 13:54:08.577471 (+832065us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:54:09.029930 (+452459us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:54:09.030156 (+ 226us) catalog_manager.cc:2898] Committing in-memory state
0810 13:54:09.030264 (+ 108us) catalog_manager.cc:2902] Aborting table tasks
0810 13:54:09.032274 (+ 2010us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:08.581740 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:08.582289 (+ 549us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:08.582314 (+ 25us) write_op.cc:435] Acquired schema lock
0810 13:54:08.582328 (+ 14us) tablet.cc:662] Decoding operations
0810 13:54:08.582718 (+ 390us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:08.582778 (+ 60us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:08.582812 (+ 34us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:08.583201 (+ 389us) tablet.cc:701] Row locks acquired
0810 13:54:08.583226 (+ 25us) write_op.cc:260] PREPARE: finished
0810 13:54:08.583365 (+ 139us) write_op.cc:270] Start()
0810 13:54:08.583447 (+ 82us) write_op.cc:276] Timestamp: P: 1786370048583311 usec, L: 0
0810 13:54:08.583462 (+ 15us) op_driver.cc:348] REPLICATION: starting
0810 13:54:08.584008 (+ 546us) log.cc:844] Serialized 756 byte log entry
0810 13:54:09.020325 (+436317us) op_driver.cc:464] REPLICATION: finished
0810 13:54:09.028394 (+ 8069us) write_op.cc:301] APPLY: starting
0810 13:54:09.028452 (+ 58us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:09.028559 (+ 107us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:09.028644 (+ 85us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:09.029034 (+ 390us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:09.029208 (+ 174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:54:09.029253 (+ 45us) write_op.cc:312] APPLY: finished
0810 13:54:09.029440 (+ 187us) log.cc:844] Serialized 29 byte log entry
0810 13:54:09.029601 (+ 161us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:09.029670 (+ 69us) write_op.cc:454] Released schema lock
0810 13:54:09.029711 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":7454,"num_ops":2,"prepare.queue_time_us":2382,"prepare.run_cpu_time_us":2534,"prepare.run_wall_time_us":2533,"replication_time_us":436749}]]}
I20260810 13:54:09.019593 15633 raft_consensus.cc:515] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.038029 15633 leader_election.cc:290] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:09.038460 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet 247fb8b09c12407d8535c07c5d0687fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:07 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:09.038707 13239 tablet_service.cc:1511] Processing CreateTablet for tablet ec901677e46946578fe0929794df881f (DEFAULT_TABLE table=default.Table_586e39daebb14dfaa08b3cc251eeb18a [id=46490c79e3814a82b21ab79f2a53814e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.039592 13217 tablet_service.cc:1511] Processing CreateTablet for tablet d18c4ddd51b6463ea28dfb2456128a18 (DEFAULT_TABLE table=default.Table_72fd7834d8574cb1a74c1d08699d1f7e [id=8cdd566d9af748b6a8d998ecf7221fb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.040156 13223 tablet_service.cc:1558] Processing DeleteTablet for tablet 11e3902adc094227830cf6ddab916916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:07 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:09.040964 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 419f1f8bae1c458f83d6be2978cb6ecc (DEFAULT_TABLE table=default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.041044 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:09.042451 13210 tablet_service.cc:1511] Processing CreateTablet for tablet b2d9bca9a4e74f3aa7ea0a11c7906a09 (DEFAULT_TABLE table=default.Table_890e94f5e2914f4e9e3994ab8bc4075c [id=d08463e955564de898a2af8457a26457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.043001 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e93928dcb94ae296590c4dedfd1781" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:09.045495 13009 tablet_service.cc:1558] Processing DeleteTablet for tablet 247fb8b09c12407d8535c07c5d0687fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:07 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:09.046627 13021 tablet_service.cc:1511] Processing CreateTablet for tablet b2d9bca9a4e74f3aa7ea0a11c7906a09 (DEFAULT_TABLE table=default.Table_890e94f5e2914f4e9e3994ab8bc4075c [id=d08463e955564de898a2af8457a26457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.046963 12998 tablet_service.cc:1511] Processing CreateTablet for tablet d18c4ddd51b6463ea28dfb2456128a18 (DEFAULT_TABLE table=default.Table_72fd7834d8574cb1a74c1d08699d1f7e [id=8cdd566d9af748b6a8d998ecf7221fb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.048096 13009 tablet_service.cc:1558] Processing DeleteTablet for tablet 11e3902adc094227830cf6ddab916916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:07 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:09.049680 13639 raft_consensus.cc:359] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.050303 13639 raft_consensus.cc:385] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:09.050554 13639 raft_consensus.cc:740] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:09.051636 13639 consensus_queue.cc:260] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.051697 13039 raft_consensus.cc:2468] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:09.053329 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 419f1f8bae1c458f83d6be2978cb6ecc (DEFAULT_TABLE table=default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.054687 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f2b53b984441e4baee332183e4c5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.057770 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee650f1e57294de89643e84bf7914298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.059512 13639 ts_tablet_manager.cc:1434] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.040s user 0.006s sys 0.001s
I20260810 13:54:09.059511 13638 tablet_bootstrap.cc:492] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:09.060039 13638 ts_tablet_manager.cc:1403] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.380s user 0.049s sys 0.068s
I20260810 13:54:09.061412 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa729726a7f4603b0f5085a56cf89f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:09.061821 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50d8651946d242feb9cf993aff99ba1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.063695 13638 raft_consensus.cc:359] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.064419 13638 raft_consensus.cc:385] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:09.064674 13638 raft_consensus.cc:740] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:09.066771 13638 consensus_queue.cc:260] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.069274 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d18c4ddd51b6463ea28dfb2456128a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.073187 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419f1f8bae1c458f83d6be2978cb6ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.078333 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa5fb50327a3454090bc41a2892df8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.063903 13268 raft_consensus.cc:3060] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:09.081207 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d9bca9a4e74f3aa7ea0a11c7906a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.084180 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec901677e46946578fe0929794df881f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.086426 12740 catalog_manager.cc:5719] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:09.087795 12740 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]). Expected version 1 got 0
I20260810 13:54:09.089011 15746 tablet.cc:1724] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:09.092437 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32905f89c1d3480abb007f8dd130e2de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.093116 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d982e709c71a4440b0cf07f11e429d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.100221 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50d8651946d242feb9cf993aff99ba1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.088665 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 469) took 3058 ms. Trace:
I20260810 13:54:09.103331 15321 rpcz_store.cc:276] 0810 13:54:06.030708 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.030856 (+ 148us) service_pool.cc:224] Handling call
0810 13:54:08.578830 (+2547974us) ts_tablet_manager.cc:1151] Deleting tablet 03c640dce5dd4fc8a49f07fb983c50eb
0810 13:54:08.578872 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:08.755789 (+176917us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:08.949778 (+193989us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:09.088586 (+138808us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154669,"spinlock_wait_cycles":1792,"tablet-delete.queue_time_us":2547353}
I20260810 13:54:09.105696 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 03c640dce5dd4fc8a49f07fb983c50eb (table default.Table_5306ac6359cd4033b2c54ad5db69828c [id=66a8a9b05b3a45f681081deace48b4a9]) successfully deleted
I20260810 13:54:09.109246 12740 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
I20260810 13:54:09.110174 12740 catalog_manager.cc:5719] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:09.114051 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_7c53cfb1808c47e59a8e23b0e6325acd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:09.114338 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_c4942145f1414e939000a9b7443c0d29"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:09.115875 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4942145f1414e939000a9b7443c0d29 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:09.115978 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c53cfb1808c47e59a8e23b0e6325acd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:09.117424 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a575515446d4e7db38c75820908b743. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.122797 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_77e30d5f98584b9e9711faa0b7a824df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:09.124295 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77e30d5f98584b9e9711faa0b7a824df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:09.130110 15787 raft_consensus.cc:493] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:09.130827 15787 raft_consensus.cc:515] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.132637 12749 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f] alter complete (version 1)
W20260810 13:54:09.133468 12749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 95) took 1070 ms (client timeout 1000 ms). Trace:
I20260810 13:54:09.135943 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 470) took 3103 ms. Trace:
W20260810 13:54:09.133770 12749 rpcz_store.cc:269] 0810 13:54:08.063494 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:08.063606 (+ 112us) service_pool.cc:224] Handling call
0810 13:54:09.133415 (+1069809us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:08.592490 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:08.594433 (+ 1943us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:08.594471 (+ 38us) write_op.cc:435] Acquired schema lock
0810 13:54:08.594493 (+ 22us) tablet.cc:662] Decoding operations
0810 13:54:08.594864 (+ 371us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:08.594918 (+ 54us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:08.594955 (+ 37us) tablet.cc:685] Acquiring locks for 1 operations
0810 13:54:08.595152 (+ 197us) tablet.cc:701] Row locks acquired
0810 13:54:08.595173 (+ 21us) write_op.cc:260] PREPARE: finished
0810 13:54:08.595312 (+ 139us) write_op.cc:270] Start()
0810 13:54:08.595422 (+ 110us) write_op.cc:276] Timestamp: P: 1786370048595250 usec, L: 0
0810 13:54:08.595449 (+ 27us) op_driver.cc:348] REPLICATION: starting
0810 13:54:08.596109 (+ 660us) log.cc:844] Serialized 356 byte log entry
0810 13:54:09.128460 (+532351us) op_driver.cc:464] REPLICATION: finished
0810 13:54:09.129375 (+ 915us) write_op.cc:301] APPLY: starting
0810 13:54:09.129506 (+ 131us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:09.129608 (+ 102us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:09.129710 (+ 102us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:09.130058 (+ 348us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:09.130370 (+ 312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0810 13:54:09.130479 (+ 109us) write_op.cc:312] APPLY: finished
0810 13:54:09.130790 (+ 311us) log.cc:844] Serialized 23 byte log entry
0810 13:54:09.131070 (+ 280us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:09.131177 (+ 107us) write_op.cc:454] Released schema lock
0810 13:54:09.131264 (+ 87us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":702,"num_ops":1,"prepare.queue_time_us":1976,"prepare.run_cpu_time_us":2451,"prepare.run_wall_time_us":3858,"replication_time_us":532858,"spinlock_wait_cycles":76160}]]}
W20260810 13:54:09.136831 12743 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83c7a8e941ea433d890fdbea2b754f22 consensus state has no leader
I20260810 13:54:09.136379 15321 rpcz_store.cc:276] 0810 13:54:06.032235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.032365 (+ 130us) service_pool.cc:224] Handling call
0810 13:54:09.104512 (+3072147us) ts_tablet_manager.cc:1151] Deleting tablet 69a3a4d2724b42da83a523e208b5714b
0810 13:54:09.135654 (+ 31142us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.135870 (+ 216us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3071548}
I20260810 13:54:09.137702 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 471) took 3104 ms. Trace:
I20260810 13:54:09.138001 15321 rpcz_store.cc:276] 0810 13:54:06.033734 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.033911 (+ 177us) service_pool.cc:224] Handling call
0810 13:54:09.137443 (+3103532us) ts_tablet_manager.cc:1151] Deleting tablet ab4cd2e5c73e467eb1bc4623e5d5e831
0810 13:54:09.137483 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.137633 (+ 150us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3102981}
I20260810 13:54:09.139180 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 481) took 2671 ms. Trace:
I20260810 13:54:09.139477 15321 rpcz_store.cc:276] 0810 13:54:06.467545 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.467674 (+ 129us) service_pool.cc:224] Handling call
0810 13:54:09.138848 (+2671174us) ts_tablet_manager.cc:1151] Deleting tablet d891e763a1854b6a8bda1071448fd8e0
0810 13:54:09.138895 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.139132 (+ 237us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2670585}
W20260810 13:54:09.142200 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 69a3a4d2724b42da83a523e208b5714b because the tablet was not found. No further retry: Not found: Tablet not found: 69a3a4d2724b42da83a523e208b5714b
W20260810 13:54:09.142913 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ab4cd2e5c73e467eb1bc4623e5d5e831 because the tablet was not found. No further retry: Not found: Tablet not found: ab4cd2e5c73e467eb1bc4623e5d5e831
W20260810 13:54:09.143599 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet d891e763a1854b6a8bda1071448fd8e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d891e763a1854b6a8bda1071448fd8e0 already in progress: creating tablet
I20260810 13:54:09.152197 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e637fca32f12429d8cba24d15680051e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.160449 13445 tablet_service.cc:1511] Processing CreateTablet for tablet da7c4d83667c4c188e5f2774c40e5e53 (DEFAULT_TABLE table=default.Table_40ebe892a09b471581cb322124cf7630 [id=a79fc8e8c8ec420fb2c6e6cc0fdbc17e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.156194 15348 tablet_replica.cc:333] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:09.174319 13417 tablet_service.cc:1511] Processing CreateTablet for tablet 50d8651946d242feb9cf993aff99ba1b (DEFAULT_TABLE table=default.Table_2901b91576984ac4a165471a90e86a8b [id=a67f03853a964c2fbf175165ee422881]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.177243 15633 consensus_queue.cc:1048] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:09.090408 13638 ts_tablet_manager.cc:1434] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.030s user 0.005s sys 0.003s
I20260810 13:54:08.987442 15816 rpcz_store.cc:276] 0810 13:54:07.938705 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.958130 (+ 19425us) service_pool.cc:224] Handling call
0810 13:54:08.986997 (+1028867us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:07.959333 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:07.959760 (+ 427us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:07.959788 (+ 28us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:07.959833 (+ 45us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:07.959943 (+ 110us) alter_schema_op.cc:128] START. Timestamp: 1786370047959837
0810 13:54:07.959960 (+ 17us) op_driver.cc:348] REPLICATION: starting
0810 13:54:07.960462 (+ 502us) log.cc:844] Serialized 173 byte log entry
0810 13:54:08.651459 (+690997us) op_driver.cc:464] REPLICATION: finished
0810 13:54:08.790580 (+139121us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:08.792464 (+ 1884us) log.cc:844] Serialized 5 byte log entry
0810 13:54:08.985519 (+193055us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:08.986292 (+ 773us) log.cc:844] Serialized 14 byte log entry
0810 13:54:08.986870 (+ 578us) alter_schema_op.cc:73] Released schema lock
0810 13:54:08.986901 (+ 31us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":138810,"prepare.queue_time_us":303,"prepare.run_cpu_time_us":3268,"prepare.run_wall_time_us":104749,"raft.queue_time_us":2740,"raft.run_cpu_time_us":1036,"raft.run_wall_time_us":74138,"replication_time_us":691376,"thread_start_us":266255,"threads_started":2,"wal-append.queue_time_us":128426}]]}
I20260810 13:54:09.183292 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d9bca9a4e74f3aa7ea0a11c7906a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.186259 13420 tablet_service.cc:1511] Processing CreateTablet for tablet ffcb4016b1984ab9a00699bda1488664 (DEFAULT_TABLE table=default.Table_ec6618cc34614272b810138cd50001a0 [id=1f7d1c76a5444d188a2e4c5ba5b1fafe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.187547 15348 raft_consensus.cc:2243] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:09.189944 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec901677e46946578fe0929794df881f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.193122 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f2b53b984441e4baee332183e4c5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.197270 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee650f1e57294de89643e84bf7914298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.140463 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 493) took 2021 ms. Trace:
I20260810 13:54:09.200564 15321 rpcz_store.cc:276] 0810 13:54:07.119405 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.122884 (+ 3479us) service_pool.cc:224] Handling call
0810 13:54:09.140233 (+2017349us) ts_tablet_manager.cc:1151] Deleting tablet a83ddc3ea3e74b569385b289fe8cf469
0810 13:54:09.140269 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.140414 (+ 145us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2016777}
I20260810 13:54:09.201370 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d18c4ddd51b6463ea28dfb2456128a18. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:09.201942 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet a83ddc3ea3e74b569385b289fe8cf469 because the tablet was not found. No further retry: Not found: Tablet not found: a83ddc3ea3e74b569385b289fe8cf469
I20260810 13:54:09.203233 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa5fb50327a3454090bc41a2892df8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.205865 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52900269b7f74b338d6f81480686a940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.207823 15321 tablet_replica.cc:333] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:09.208534 15321 raft_consensus.cc:2243] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:09.209029 15321 raft_consensus.cc:2272] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:09.209247 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419f1f8bae1c458f83d6be2978cb6ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.209985 13428 tablet_service.cc:1511] Processing CreateTablet for tablet ee650f1e57294de89643e84bf7914298 (DEFAULT_TABLE table=default.Table_09a6fde1eefc4ce0a591129d6ab65e3a [id=8b4fe3206c2344728b61ed31b33580a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.210721 15321 ts_tablet_manager.cc:1916] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:09.212167 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73749dd3ba784553b316d2f70ae34073. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.212805 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7c4d83667c4c188e5f2774c40e5e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.213042 15702 tablet_replica.cc:333] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:09.214645 15702 raft_consensus.cc:2243] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:09.215395 15702 raft_consensus.cc:2272] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:09.218575 15702 ts_tablet_manager.cc:1916] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:09.218348 13640 raft_consensus.cc:359] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.219060 13640 raft_consensus.cc:385] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:09.219314 13640 raft_consensus.cc:740] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:09.224134 13421 tablet_service.cc:1511] Processing CreateTablet for tablet b2f2b53b984441e4baee332183e4c5c3 (DEFAULT_TABLE table=default.Table_87c087a440044f9483716cce60bb4777 [id=4777400951884e84a747cbc635b6a087]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:09.237835 12750 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bd3119d63857480294dcb68ed0451bc0 consensus state has no leader
I20260810 13:54:09.246248 15348 raft_consensus.cc:2272] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:09.247610 13639 tablet_bootstrap.cc:492] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:09.256076 12745 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_cca9d32f9bad4ec9b60a5dfeafdd4e33" } modify_external_catalogs: true
I20260810 13:54:09.256661 12745 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_cca9d32f9bad4ec9b60a5dfeafdd4e33" } modify_external_catalogs: true
I20260810 13:54:09.261934 13427 tablet_service.cc:1511] Processing CreateTablet for tablet ec901677e46946578fe0929794df881f (DEFAULT_TABLE table=default.Table_586e39daebb14dfaa08b3cc251eeb18a [id=46490c79e3814a82b21ab79f2a53814e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.262374 13419 tablet_service.cc:1511] Processing CreateTablet for tablet fa5fb50327a3454090bc41a2892df8c0 (DEFAULT_TABLE table=default.Table_bc50dbac8249499e90b8d763fd7041f2 [id=92622bf6828843419776bf2bbe0c6aee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.263435 13436 tablet_service.cc:1558] Processing DeleteTablet for tablet 247fb8b09c12407d8535c07c5d0687fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:07 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:09.263979 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 11e3902adc094227830cf6ddab916916 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:07 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:09.265542 13430 tablet_service.cc:1511] Processing CreateTablet for tablet d18c4ddd51b6463ea28dfb2456128a18 (DEFAULT_TABLE table=default.Table_72fd7834d8574cb1a74c1d08699d1f7e [id=8cdd566d9af748b6a8d998ecf7221fb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.266130 13429 tablet_service.cc:1511] Processing CreateTablet for tablet b2d9bca9a4e74f3aa7ea0a11c7906a09 (DEFAULT_TABLE table=default.Table_890e94f5e2914f4e9e3994ab8bc4075c [id=d08463e955564de898a2af8457a26457]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.266677 12749 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5d92bfb4e8eb4ad58e5aac4da446b255" } modify_external_catalogs: true
I20260810 13:54:09.268930 13640 consensus_queue.cc:260] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.270242 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 419f1f8bae1c458f83d6be2978cb6ecc (DEFAULT_TABLE table=default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.267237 12749 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5d92bfb4e8eb4ad58e5aac4da446b255" } modify_external_catalogs: true
I20260810 13:54:09.271281 13640 ts_tablet_manager.cc:1434] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.340s user 0.004s sys 0.003s
I20260810 13:54:09.291303 13224 tablet_service.cc:1511] Processing CreateTablet for tablet a4cca967e70b4164ba13c139d9610c73 (DEFAULT_TABLE table=default.Table_5388dd61e30949a5a2b9c07a35637080 [id=9fe82107b8344dfdae308a0d7091488d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.292400 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cca967e70b4164ba13c139d9610c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.187668 15784 raft_consensus.cc:493] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:09.293267 15784 raft_consensus.cc:515] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.298162 15787 leader_election.cc:290] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:09.308447 12999 tablet_service.cc:1511] Processing CreateTablet for tablet 09d572e2dc764d259df43026f49e0831 (DEFAULT_TABLE table=default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 [id=7b407001f6d54bd2929f1f0d141b065e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.309310 15348 ts_tablet_manager.cc:1916] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:09.309583 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d572e2dc764d259df43026f49e0831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.310074 13206 tablet_service.cc:1511] Processing CreateTablet for tablet 6d19fba564324475a790174b4033ab1b (DEFAULT_TABLE table=default.Table_eebc498aa5734ab8b23c00b74d896ba9 [id=9756f3d17c15460e84863e49504d8349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.313316 13217 tablet_service.cc:1511] Processing CreateTablet for tablet 09d572e2dc764d259df43026f49e0831 (DEFAULT_TABLE table=default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 [id=7b407001f6d54bd2929f1f0d141b065e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.324071 13009 tablet_service.cc:1511] Processing CreateTablet for tablet a4cca967e70b4164ba13c139d9610c73 (DEFAULT_TABLE table=default.Table_5388dd61e30949a5a2b9c07a35637080 [id=9fe82107b8344dfdae308a0d7091488d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.325131 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cca967e70b4164ba13c139d9610c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.330385 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 6d19fba564324475a790174b4033ab1b (DEFAULT_TABLE table=default.Table_eebc498aa5734ab8b23c00b74d896ba9 [id=9756f3d17c15460e84863e49504d8349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.331363 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d19fba564324475a790174b4033ab1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.337913 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ff3a48af494009bb53ee8d4e2a08cd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:09.338650 13039 raft_consensus.cc:2468] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:09.343688 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_278ad8ed658b48d28fcc3aa3eec747b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:09.344283 12742 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_45d030548717429993bab4df43ab59a4" } new_table_name: "default.Table_5469eacb9ee344faa2428f2ceaeabf32" modify_external_catalogs: true
W20260810 13:54:09.345580 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_278ad8ed658b48d28fcc3aa3eec747b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:09.349221 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee650f1e57294de89643e84bf7914298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.354511 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffcb4016b1984ab9a00699bda1488664. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.355116 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f2b53b984441e4baee332183e4c5c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.357378 13427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec901677e46946578fe0929794df881f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.358945 13638 tablet_bootstrap.cc:492] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:09.359217 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa5fb50327a3454090bc41a2892df8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.364029 13268 raft_consensus.cc:2468] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:09.366228 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d18c4ddd51b6463ea28dfb2456128a18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.368170 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419f1f8bae1c458f83d6be2978cb6ecc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.369108 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50d8651946d242feb9cf993aff99ba1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.372967 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d9bca9a4e74f3aa7ea0a11c7906a09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.372980 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d19fba564324475a790174b4033ab1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.377343 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d572e2dc764d259df43026f49e0831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.393002 12995 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 36) took 1663 ms. Trace:
I20260810 13:54:09.394925 15784 leader_election.cc:290] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:09.396814 12995 rpcz_store.cc:276] 0810 13:54:07.729265 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.729443 (+ 178us) service_pool.cc:224] Handling call
0810 13:54:07.975801 (+246358us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b5400151b54. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:09.392910 (+1417109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12784512}
I20260810 13:54:09.409606 12952 leader_election.cc:304] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:09.410485 15633 raft_consensus.cc:2804] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:09.410897 15633 raft_consensus.cc:697] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:09.411657 15633 consensus_queue.cc:237] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.407331 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:09.417538 13472 raft_consensus.cc:2468] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:09.391832 13640 tablet_bootstrap.cc:492] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:09.423080 13638 tablet_bootstrap.cc:654] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:09.436244 12745 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 8ab17a06cccf4cfeaff8919bc1391f9f
I20260810 13:54:09.452162 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:09.453263 13039 raft_consensus.cc:2393] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:09.456068 13167 leader_election.cc:304] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:09.456873 15785 raft_consensus.cc:2804] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:09.457187 15785 raft_consensus.cc:493] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:09.457451 15785 raft_consensus.cc:3060] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:09.457482 12739 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1b4d290e5bd445eaaff143b18dd41da9" } new_table_name: "default.Table_133760df225b4dda850229214ad22194" modify_external_catalogs: true
I20260810 13:54:09.461614 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2da57f87f29a425dbef85d4f4db4bc26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:09.463057 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2da57f87f29a425dbef85d4f4db4bc26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:09.467165 15785 raft_consensus.cc:515] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.478654 13208 tablet_service.cc:1511] Processing CreateTablet for tablet e837879f1c2549c795b240589dfa9bf7 (DEFAULT_TABLE table=default.Table_209ee5a105144c7e871214eaafcd0cbe [id=9a05ad06179141dfabe2d12858c1746c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.479939 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e837879f1c2549c795b240589dfa9bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.481003 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:09.481688 13472 raft_consensus.cc:2468] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:09.485443 15785 leader_election.cc:290] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:09.490322 13639 tablet_bootstrap.cc:700] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Time spent opening tablet: real 0.163s user 0.000s sys 0.000s
I20260810 13:54:09.491076 13639 tablet_bootstrap.cc:654] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:09.506910 12750 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
W20260810 13:54:09.514963 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ad6a373308fa4b039e8331d9a0a90d16 consensus state has no leader
I20260810 13:54:09.518103 12743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ff3b2726de9046d7878cc76ea94ecb90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:09.520058 12743 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff3b2726de9046d7878cc76ea94ecb90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:09.540634 12749 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet fd22f04344954142922942fc4b7cb157
W20260810 13:54:09.541924 12742 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1bbee4f9a50342599434a2b05c0740bd consensus state has no leader
I20260810 13:54:09.558817 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 2b88b4fa155d4364b4fa1b2c724755bb (DEFAULT_TABLE table=default.Table_856a1bf64ef9498890c9b6d98edcc8ad [id=60b4f30b701344d79b0c64b4e8127dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.559839 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b88b4fa155d4364b4fa1b2c724755bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.560250 13638 tablet_bootstrap.cc:492] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:09.560758 13638 ts_tablet_manager.cc:1403] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.223s user 0.009s sys 0.003s
I20260810 13:54:09.563557 13638 raft_consensus.cc:359] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:09.564267 13638 raft_consensus.cc:385] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:09.577234 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet fd22f04344954142922942fc4b7cb157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:09.599390 13640 tablet_bootstrap.cc:654] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:09.620337 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ff3a48af494009bb53ee8d4e2a08cd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:09.621073 13472 raft_consensus.cc:2468] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:09.631214 13208 tablet_service.cc:1511] Processing CreateTablet for tablet 48ff07074f4a4392adc6c3aa0360454f (DEFAULT_TABLE table=default.Table_da87a4b83c12422e999c5b88c825d890 [id=3064108a10bd4f76b2be6614ebed22fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.632342 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ff07074f4a4392adc6c3aa0360454f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:09.639545 12740 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 98) took 764 ms (client timeout 1000 ms). Trace:
I20260810 13:54:09.657410 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ff3a48af494009bb53ee8d4e2a08cd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:09.657982 13472 raft_consensus.cc:3060] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:09.658711 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 815f4333c441441ca8e857df66a0263e (DEFAULT_TABLE table=default.Table_8606de06b2994b3291a5ee1e28ad7100 [id=7162bee4392749a38057f272df172987]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:09.659040 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_f0a8373b96114e0c896e54dcb940f74d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:09.660228 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815f4333c441441ca8e857df66a0263e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:09.666153 12742 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1cc7e2bca3cc43cda9ace3f7194fc23e" } modify_external_catalogs: true
I20260810 13:54:09.666707 12742 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_1cc7e2bca3cc43cda9ace3f7194fc23e" } modify_external_catalogs: true
W20260810 13:54:09.671311 12739 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f934006c34a4b18ab157dad01a1b41d consensus state has no leader
W20260810 13:54:09.660485 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0a8373b96114e0c896e54dcb940f74d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:09.681510 15761 tablet.cc:1724] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:09.687126 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:09.687719 13470 raft_consensus.cc:3060] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:09.639870 12740 rpcz_store.cc:269] 0810 13:54:08.875408 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:08.880557 (+ 5149us) service_pool.cc:224] Handling call
0810 13:54:09.074158 (+193601us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:54:09.639485 (+565327us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:09.118170 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:09.118650 (+ 480us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:09.118674 (+ 24us) write_op.cc:435] Acquired schema lock
0810 13:54:09.118698 (+ 24us) tablet.cc:662] Decoding operations
0810 13:54:09.119026 (+ 328us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:09.119063 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:09.119108 (+ 45us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:09.119501 (+ 393us) tablet.cc:701] Row locks acquired
0810 13:54:09.119517 (+ 16us) write_op.cc:260] PREPARE: finished
0810 13:54:09.119652 (+ 135us) write_op.cc:270] Start()
0810 13:54:09.119737 (+ 85us) write_op.cc:276] Timestamp: P: 1786370049119593 usec, L: 0
0810 13:54:09.119764 (+ 27us) op_driver.cc:348] REPLICATION: starting
0810 13:54:09.120427 (+ 663us) log.cc:844] Serialized 901 byte log entry
0810 13:54:09.228063 (+107636us) op_driver.cc:464] REPLICATION: finished
0810 13:54:09.231641 (+ 3578us) write_op.cc:301] APPLY: starting
0810 13:54:09.231754 (+ 113us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:09.231935 (+ 181us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:09.232061 (+ 126us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:09.232552 (+ 491us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:09.273484 (+ 40932us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:54:09.273584 (+ 100us) write_op.cc:312] APPLY: finished
0810 13:54:09.273940 (+ 356us) log.cc:844] Serialized 29 byte log entry
0810 13:54:09.274916 (+ 976us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:09.275044 (+ 128us) write_op.cc:454] Released schema lock
0810 13:54:09.275092 (+ 48us) write_op.cc:341] FINISH: Updating metrics
0810 13:54:09.275635 (+ 543us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:09.275674 (+ 39us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":437894400,"child_traces":[["op",{"apply.queue_time_us":3396,"apply.run_cpu_time_us":2794,"apply.run_wall_time_us":43896,"mutex_wait_us":12065,"num_ops":2,"prepare.queue_time_us":4546,"prepare.run_cpu_time_us":2507,"prepare.run_wall_time_us":2508,"replication_time_us":108218}]]}
I20260810 13:54:09.693255 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:09.693945 13476 raft_consensus.cc:3060] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:09.697088 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:09.697620 13477 raft_consensus.cc:3060] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:09.701062 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ff3a48af494009bb53ee8d4e2a08cd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:09.702356 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa729726a7f4603b0f5085a56cf89f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:09.702937 13480 raft_consensus.cc:2468] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:09.564524 13638 raft_consensus.cc:740] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:09.711181 13638 consensus_queue.cc:260] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:09.713064 13638 ts_tablet_manager.cc:1434] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.152s user 0.006s sys 0.000s
I20260810 13:54:09.717475 13638 tablet_bootstrap.cc:492] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:09.721349 15348 ts_tablet_manager.cc:1929] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:09.721756 15348 log.cc:1199] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/a83ddc3ea3e74b569385b289fe8cf469
I20260810 13:54:09.722496 15348 ts_tablet_manager.cc:1950] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:09.735280 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fa729726a7f4603b0f5085a56cf89f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:09.735847 13480 raft_consensus.cc:3060] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:09.756194 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 674599456f9a49dc98d8d089c166ca89 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 674599456f9a49dc98d8d089c166ca89 already in progress: creating tablet
I20260810 13:54:09.763643 13476 raft_consensus.cc:2468] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:09.743891 13480 raft_consensus.cc:2468] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:09.773089 13639 tablet_bootstrap.cc:492] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:09.773608 13639 ts_tablet_manager.cc:1403] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.527s user 0.008s sys 0.006s
I20260810 13:54:09.783206 15321 ts_tablet_manager.cc:1929] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:09.783823 15321 log.cc:1199] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/ce9243eda3974532aff0425885f54166
I20260810 13:54:09.784610 15321 ts_tablet_manager.cc:1950] T ce9243eda3974532aff0425885f54166 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
W20260810 13:54:09.789173 12441 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 54321.2us
I20260810 13:54:09.797794 12739 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_7ef25000b5b24c7e967819fa18512810" } modify_external_catalogs: true
I20260810 13:54:09.798331 12739 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_7ef25000b5b24c7e967819fa18512810" } modify_external_catalogs: true
I20260810 13:54:09.802536 12744 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_38574d5b763c4a5197c7431ebb1bac4f" } new_table_name: "default.Table_da3e46db73d44e2cb3b90775b78c2a15" modify_external_catalogs: true
I20260810 13:54:09.809089 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 458) took 7445 ms. Trace:
I20260810 13:54:09.809484 15348 rpcz_store.cc:276] 0810 13:54:02.363968 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.399901 (+ 35933us) service_pool.cc:224] Handling call
0810 13:54:08.959442 (+6559541us) ts_tablet_manager.cc:1151] Deleting tablet a83ddc3ea3e74b569385b289fe8cf469
0810 13:54:09.156062 (+196620us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.601710 (+445648us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:09.721223 (+119513us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:09.808997 (+ 87774us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6558900}
I20260810 13:54:09.810009 13638 tablet_bootstrap.cc:654] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:09.822028 15348 tablet_replica.cc:333] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:09.825723 15348 raft_consensus.cc:2243] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:09.825870 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 494) took 2701 ms. Trace:
I20260810 13:54:09.827719 15348 raft_consensus.cc:2272] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:09.828449 13639 raft_consensus.cc:359] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.829818 15785 consensus_queue.cc:1048] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:09.752619 13470 raft_consensus.cc:2468] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:09.832144 13164 leader_election.cc:304] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:09.833606 15795 raft_consensus.cc:2764] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:09.834692 13164 leader_election.cc:304] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:09.835306 15784 raft_consensus.cc:2804] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:09.835637 15784 raft_consensus.cc:493] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:09.836069 15784 raft_consensus.cc:3060] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:09.826236 15321 rpcz_store.cc:276] 0810 13:54:07.126198 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.126636 (+ 438us) service_pool.cc:224] Handling call
0810 13:54:09.207673 (+2081037us) ts_tablet_manager.cc:1151] Deleting tablet ce9243eda3974532aff0425885f54166
0810 13:54:09.207717 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.479749 (+272032us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:09.783058 (+303309us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:09.825794 (+ 42736us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2080536}
I20260810 13:54:09.841740 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet ce9243eda3974532aff0425885f54166 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]) successfully deleted
I20260810 13:54:09.845342 12747 master_service.cc:960] ReplaceTablet: received request to replace tablet 0f422b17b9a24f609b06625837947e64 from {username='slave'} at 127.0.0.1:48758
I20260810 13:54:09.843953 13477 raft_consensus.cc:2468] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:09.844367 15784 raft_consensus.cc:515] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.848533 15702 ts_tablet_manager.cc:1929] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:09.849107 15702 log.cc:1199] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/e6bfb69a7ce74175b4f1f5f4db583aa9
I20260810 13:54:09.849992 15702 ts_tablet_manager.cc:1950] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:09.851228 15784 leader_election.cc:290] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:09.827189 13472 raft_consensus.cc:2468] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:09.871003 13640 tablet_bootstrap.cc:492] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:09.871603 13640 ts_tablet_manager.cc:1403] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.481s user 0.016s sys 0.002s
I20260810 13:54:09.874802 13640 raft_consensus.cc:359] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.875663 13640 raft_consensus.cc:385] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:09.875993 13640 raft_consensus.cc:740] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:09.876843 13640 consensus_queue.cc:260] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.876816 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_1668535b5107458a842c0def2c55461f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:09.878654 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1668535b5107458a842c0def2c55461f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:09.882115 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_c4151a7b51d1422a91db569721e57895" } new_table_name: "default.Table_ba01d0c61c5e48c8a9e4a12b5739a568" modify_external_catalogs: true
I20260810 13:54:09.896072 15348 ts_tablet_manager.cc:1916] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:09.898340 15761 tablet.cc:1724] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:09.905799 15843 tablet.cc:1724] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:09.938239 15849 raft_consensus.cc:493] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:09.942533 15852 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:09.949159 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 495) took 2548 ms. Trace:
I20260810 13:54:09.949612 15321 rpcz_store.cc:276] 0810 13:54:07.401047 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.402022 (+ 975us) service_pool.cc:224] Handling call
0810 13:54:09.846639 (+2444617us) ts_tablet_manager.cc:1151] Deleting tablet 8d647bf5c1ba42f48186661310065448
0810 13:54:09.948823 (+102184us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.949098 (+ 275us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2443977}
I20260810 13:54:09.959167 13638 tablet_bootstrap.cc:492] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:09.965322 13638 ts_tablet_manager.cc:1403] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.248s user 0.013s sys 0.005s
I20260810 13:54:09.843820 13342 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
I20260810 13:54:09.967756 13638 raft_consensus.cc:359] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.973374 13638 raft_consensus.cc:385] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:09.973716 13638 raft_consensus.cc:740] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:09.974470 13638 consensus_queue.cc:260] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.976119 13638 ts_tablet_manager.cc:1434] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.011s user 0.003s sys 0.002s
I20260810 13:54:09.981504 13638 tablet_bootstrap.cc:492] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:09.989152 15784 raft_consensus.cc:493] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:09.989661 15784 raft_consensus.cc:515] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:09.991887 15784 leader_election.cc:290] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:09.996810 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 496) took 2472 ms. Trace:
W20260810 13:54:09.996910 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 8d647bf5c1ba42f48186661310065448 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8d647bf5c1ba42f48186661310065448 already in progress: creating tablet
I20260810 13:54:09.997150 15321 rpcz_store.cc:276] 0810 13:54:07.524537 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.524677 (+ 140us) service_pool.cc:224] Handling call
0810 13:54:09.996418 (+2471741us) ts_tablet_manager.cc:1151] Deleting tablet 1a4fe8abad5649f2a42686c00148d957
0810 13:54:09.996468 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.996750 (+ 282us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2471103}
W20260810 13:54:09.998569 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 1a4fe8abad5649f2a42686c00148d957 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a4fe8abad5649f2a42686c00148d957 already in progress: creating tablet
I20260810 13:54:09.998575 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 497) took 2471 ms. Trace:
I20260810 13:54:09.998937 15321 rpcz_store.cc:276] 0810 13:54:07.527476 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.527605 (+ 129us) service_pool.cc:224] Handling call
0810 13:54:09.998145 (+2470540us) ts_tablet_manager.cc:1151] Deleting tablet d0e488e3e89047b18178c9cb64d74bef
0810 13:54:09.998189 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.998511 (+ 322us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2470004}
I20260810 13:54:10.000165 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 498) took 2458 ms. Trace:
W20260810 13:54:09.949301 13382 leader_election.cc:343] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:10.001511 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 52243us
I20260810 13:54:10.001430 15852 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:10.002250 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet d0e488e3e89047b18178c9cb64d74bef because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d0e488e3e89047b18178c9cb64d74bef already in progress: creating tablet
W20260810 13:54:10.002822 13382 leader_election.cc:343] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:10.003095 12750 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e] alter complete (version 1)
W20260810 13:54:10.003708 13382 leader_election.cc:343] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:10.004281 13382 leader_election.cc:343] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:09.966105 13640 ts_tablet_manager.cc:1434] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.094s user 0.006s sys 0.003s
I20260810 13:54:10.004848 15852 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:10.005813 13640 tablet_bootstrap.cc:492] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:10.007009 13208 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ff3a48af494009bb53ee8d4e2a08cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:10.004864 13382 leader_election.cc:343] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: a83ddc3ea3e74b569385b289fe8cf469
W20260810 13:54:10.010346 13382 leader_election.cc:343] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:10.010746 13382 leader_election.cc:304] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:10.013423 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 350b68f6c1cf48ff8e5f8521e5a4dad6
I20260810 13:54:10.015506 13640 tablet_bootstrap.cc:654] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:10.017838 13206 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:10.017886 13208 tablet_service.cc:1558] Processing DeleteTablet for tablet b820c99b33264add8df5fd443981d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:10.020344 13208 tablet_service.cc:1558] Processing DeleteTablet for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:09.938966 15849 raft_consensus.cc:515] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.024304 15849 leader_election.cc:290] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:10.015532 15854 raft_consensus.cc:2749] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:10.035540 13382 leader_election.cc:343] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:10.035977 13382 leader_election.cc:304] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:10.037422 15857 raft_consensus.cc:2749] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:10.038372 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 1.602s user 0.053s sys 0.011s
W20260810 13:54:10.039215 13382 leader_election.cc:343] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:10.039690 13382 leader_election.cc:304] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:10.040383 15857 raft_consensus.cc:2749] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:10.046725 13638 tablet_bootstrap.cc:654] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:10.049636 12739 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 65c3b03d5f1543b28ea6c439c3cfb07e
I20260810 13:54:10.055348 15348 ts_tablet_manager.cc:1929] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:10.055972 15348 log.cc:1199] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/e6bfb69a7ce74175b4f1f5f4db583aa9
I20260810 13:54:10.056777 13382 leader_election.cc:304] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:10.060626 15857 raft_consensus.cc:2804] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:10.061223 15857 raft_consensus.cc:697] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:10.062216 15857 consensus_queue.cc:237] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:10.069419 13421 tablet_service.cc:1511] Processing CreateTablet for tablet a4cca967e70b4164ba13c139d9610c73 (DEFAULT_TABLE table=default.Table_5388dd61e30949a5a2b9c07a35637080 [id=9fe82107b8344dfdae308a0d7091488d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.070537 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4cca967e70b4164ba13c139d9610c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.070489 13428 tablet_service.cc:1511] Processing CreateTablet for tablet 6d19fba564324475a790174b4033ab1b (DEFAULT_TABLE table=default.Table_eebc498aa5734ab8b23c00b74d896ba9 [id=9756f3d17c15460e84863e49504d8349]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.071521 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d19fba564324475a790174b4033ab1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.072070 13427 tablet_service.cc:1511] Processing CreateTablet for tablet 09d572e2dc764d259df43026f49e0831 (DEFAULT_TABLE table=default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 [id=7b407001f6d54bd2929f1f0d141b065e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.073212 13427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09d572e2dc764d259df43026f49e0831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.091166 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_7cf74351dd314634a7a8ca1b1a24302b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:10.091291 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:10.084671 15348 ts_tablet_manager.cc:1950] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:54:10.093091 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260810 13:54:10.093403 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7cf74351dd314634a7a8ca1b1a24302b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.093947 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 464) took 7135 ms. Trace:
I20260810 13:54:10.095868 13420 tablet_service.cc:1511] Processing CreateTablet for tablet e837879f1c2549c795b240589dfa9bf7 (DEFAULT_TABLE table=default.Table_209ee5a105144c7e871214eaafcd0cbe [id=9a05ad06179141dfabe2d12858c1746c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.109186 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e837879f1c2549c795b240589dfa9bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.053114 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c3b03d5f1543b28ea6c439c3cfb07e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:10.000484 15321 rpcz_store.cc:276] 0810 13:54:07.542044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.542180 (+ 136us) service_pool.cc:224] Handling call
0810 13:54:09.999843 (+2457663us) ts_tablet_manager.cc:1151] Deleting tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4
0810 13:54:09.999883 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:10.000116 (+ 233us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2457129}
W20260810 13:54:10.113799 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 already in progress: creating tablet
I20260810 13:54:10.116408 15321 tablet_replica.cc:333] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:10.117329 15321 raft_consensus.cc:2243] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:10.118067 15321 raft_consensus.cc:2272] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:10.119994 15321 ts_tablet_manager.cc:1916] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:10.107442 13640 tablet_bootstrap.cc:492] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:10.107875 13445 tablet_service.cc:1558] Processing DeleteTablet for tablet fd22f04344954142922942fc4b7cb157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:10.121351 13640 ts_tablet_manager.cc:1403] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.116s user 0.003s sys 0.009s
I20260810 13:54:10.124506 13640 raft_consensus.cc:359] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.125244 13640 raft_consensus.cc:385] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:10.125567 13640 raft_consensus.cc:740] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:10.126384 13640 consensus_queue.cc:260] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.134255 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet a83ddc3ea3e74b569385b289fe8cf469 (table default.Table_f681c78b940441a29062623de79e8420 [id=c084fab842804eaa9fdb0bd1d42e518a]) successfully deleted
I20260810 13:54:10.136361 13164 leader_election.cc:304] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:10.137264 15784 raft_consensus.cc:2804] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:10.137828 15784 raft_consensus.cc:697] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:10.138813 15784 consensus_queue.cc:237] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.150556 12740 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_6c443ac64289437d8c7dcf5ea44469dd [id=9c99ad2364cc45fba0746cbae06deeeb] alter complete (version 3)
W20260810 13:54:10.152328 12744 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d321f9c075554ffcb299d02792a0662d consensus state has no leader
I20260810 13:54:10.161538 13208 tablet_service.cc:1558] Processing DeleteTablet for tablet ba05f4940220459f951adf3491f60b93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:10.163466 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e93928dcb94ae296590c4dedfd1781 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:42 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:10.164477 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f3d299c668c444908ccdc2f36873ad24 consensus state has no leader
I20260810 13:54:10.127130 15348 rpcz_store.cc:276] 0810 13:54:02.958285 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.960073 (+ 1788us) service_pool.cc:224] Handling call
0810 13:54:09.810473 (+6850400us) ts_tablet_manager.cc:1151] Deleting tablet e6bfb69a7ce74175b4f1f5f4db583aa9
0810 13:54:09.821915 (+ 11442us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.954631 (+132716us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.055219 (+100588us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.093888 (+ 38669us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6837256}
I20260810 13:54:10.128582 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 2b88b4fa155d4364b4fa1b2c724755bb (DEFAULT_TABLE table=default.Table_856a1bf64ef9498890c9b6d98edcc8ad [id=60b4f30b701344d79b0c64b4e8127dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.130246 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 48ff07074f4a4392adc6c3aa0360454f (DEFAULT_TABLE table=default.Table_da87a4b83c12422e999c5b88c825d890 [id=3064108a10bd4f76b2be6614ebed22fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.131543 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 815f4333c441441ca8e857df66a0263e (DEFAULT_TABLE table=default.Table_8606de06b2994b3291a5ee1e28ad7100 [id=7162bee4392749a38057f272df172987]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.132453 13438 tablet_service.cc:1558] Processing DeleteTablet for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:10.132714 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c3b03d5f1543b28ea6c439c3cfb07e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:10.195291 13640 ts_tablet_manager.cc:1434] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.073s user 0.005s sys 0.000s
W20260810 13:54:10.195473 12998 consensus_meta.cc:287] T d18c4ddd51b6463ea28dfb2456128a18 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.712s user 0.007s sys 0.008s
W20260810 13:54:10.201983 13003 consensus_meta.cc:287] T 50d8651946d242feb9cf993aff99ba1b P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 1.022s user 0.009s sys 0.003s
I20260810 13:54:10.207789 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac9e3d3430044a5e85e2d812b7e221f5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:10.225497 12739 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_fd7c2744dc274e678bcb58f7eb4fb1f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:09.829126 13639 raft_consensus.cc:385] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:10.227268 13639 raft_consensus.cc:740] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:10.227252 12739 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd7c2744dc274e678bcb58f7eb4fb1f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.228101 13639 consensus_queue.cc:260] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.228747 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d028580c0c154a01a3d21e5c767d23eb" } modify_external_catalogs: true
I20260810 13:54:10.229252 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_d028580c0c154a01a3d21e5c767d23eb" } modify_external_catalogs: true
I20260810 13:54:10.234277 12745 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_64421a271bfe4c4cbbab1afcd35955de [id=147b038d3de54c8d85e666747153cb7d]). Expected version 1 got 0
I20260810 13:54:10.236894 15633 raft_consensus.cc:493] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:10.237462 15633 raft_consensus.cc:515] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.239974 15633 leader_election.cc:290] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:10.243865 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 502) took 1535 ms. Trace:
I20260810 13:54:10.244280 15702 rpcz_store.cc:276] 0810 13:54:08.708621 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:08.722542 (+ 13921us) service_pool.cc:224] Handling call
0810 13:54:08.995164 (+272622us) ts_tablet_manager.cc:1151] Deleting tablet e6bfb69a7ce74175b4f1f5f4db583aa9
0810 13:54:09.212816 (+217652us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:09.479355 (+266539us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:09.680538 (+201183us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.243632 (+563094us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":265516}
I20260810 13:54:10.246513 15702 tablet_replica.cc:333] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
W20260810 13:54:10.248605 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet fb30ebe9520d4224bdfd45a5e915d8bd (table default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]) was not created within the allowed timeout. Replacing with a new tablet f2b97ddd62b547ba997bf3044d37029d
I20260810 13:54:10.253978 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:10.254799 13261 raft_consensus.cc:2468] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:10.255658 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ec6618cc34614272b810138cd50001a0" } modify_external_catalogs: true
I20260810 13:54:10.256223 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ec6618cc34614272b810138cd50001a0" } modify_external_catalogs: true
I20260810 13:54:10.265156 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:10.265789 13638 tablet_bootstrap.cc:492] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:10.265923 13468 raft_consensus.cc:2393] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:10.266222 13638 ts_tablet_manager.cc:1403] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.285s user 0.009s sys 0.000s
I20260810 13:54:10.272050 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b88b4fa155d4364b4fa1b2c724755bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.272456 13003 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 510) took 1305 ms. Trace:
I20260810 13:54:10.273173 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ff07074f4a4392adc6c3aa0360454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.272807 13003 rpcz_store.cc:276] 0810 13:54:08.966937 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:08.967067 (+ 130us) service_pool.cc:224] Handling call
0810 13:54:09.084675 (+117608us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:09.099891 (+ 15216us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:09.179848 (+ 79957us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.202640 (+1022792us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:10.272376 (+ 69736us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:10.274154 12998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 516) took 1228 ms. Trace:
I20260810 13:54:10.274538 12998 rpcz_store.cc:276] 0810 13:54:09.045564 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:09.045998 (+ 434us) service_pool.cc:224] Handling call
0810 13:54:09.200836 (+154838us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:09.201026 (+ 190us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:09.483004 (+281978us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.196608 (+713604us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:10.274081 (+ 77473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:10.277257 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815f4333c441441ca8e857df66a0263e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.294165 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb30ebe9520d4224bdfd45a5e915d8bd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:10.299307 12951 leader_election.cc:304] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:10.300184 15748 raft_consensus.cc:2749] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:10.300984 15348 tablet_replica.cc:333] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:10.301904 15348 raft_consensus.cc:2243] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:10.302531 15348 raft_consensus.cc:2272] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:10.304819 15348 ts_tablet_manager.cc:1916] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:10.329756 12994 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 37) took 2590 ms. Trace:
I20260810 13:54:10.330228 12994 rpcz_store.cc:276] 0810 13:54:07.739443 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.739573 (+ 130us) service_pool.cc:224] Handling call
0810 13:54:08.333752 (+594179us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b54001d0a28. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f192822eb41 00007f19282bad1c 00007f1928ed84c0 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:08.679233 (+345481us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5400113ba8. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f192822eb41 00007f19282bad1c 00007f1928ed84c0 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:10.329550 (+1650317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93275776}
I20260810 13:54:10.343309 13639 ts_tablet_manager.cc:1434] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.569s user 0.009s sys 0.006s
W20260810 13:54:10.343633 13639 ts_tablet_manager.cc:1467] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Tablet startup took 569ms
W20260810 13:54:10.344045 13639 ts_tablet_manager.cc:1469] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Trace:
0810 13:53:40.142316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.176803 (+ 34487us) service_pool.cc:224] Handling call
0810 13:53:40.178360 (+ 1557us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:40.178438 (+ 78us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:40.354672 (+176234us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:40.368595 (+ 13923us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:40.375989 (+ 7394us) inbound_call.cc:177] Queueing success response
0810 13:54:09.246771 (+28870782us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:54:09.773957 (+527186us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:54:09.775422 (+ 1465us) tablet_replica.cc:261] Starting instrumentation
0810 13:54:09.825833 (+ 50411us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":13269,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":318,"tablet-open.queue_time_us":28870863,"thread_start_us":112989,"threads_started":1}
I20260810 13:54:10.346675 13639 tablet_bootstrap.cc:492] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:10.359316 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_356ec0418a38420d8a4e18b2f69682c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:10.361115 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_356ec0418a38420d8a4e18b2f69682c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.364168 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet e6bfb69a7ce74175b4f1f5f4db583aa9 (table default.Table_f98c8ce886d84413a005fa4b80373027 [id=10e4d51c28b7401bbf53fdcf117f9e3c]) successfully deleted
I20260810 13:54:10.368248 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_70b6f93d3d5b4c96a17ca2ffe2efe136" } new_table_name: "default.Table_d805dec488a54cf98f2630fbc15a1be4" modify_external_catalogs: true
I20260810 13:54:10.371071 13638 raft_consensus.cc:359] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.386600 15748 consensus_queue.cc:1048] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:54:10.388931 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 86536.4us
I20260810 13:54:10.389832 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:10.389909 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2d75c2da0411444ba34cab36ab78b40b" } new_table_name: "default.Table_568e3a24b182478ab6205746311d5725" modify_external_catalogs: true
I20260810 13:54:10.390430 13470 raft_consensus.cc:2468] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:10.393931 13640 tablet_bootstrap.cc:492] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:10.400637 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4793f262a5e44f9e804c27092b110921 consensus state has no leader
I20260810 13:54:10.426715 13638 raft_consensus.cc:385] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:10.427018 13638 raft_consensus.cc:740] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:10.427683 13638 consensus_queue.cc:260] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.430815 13638 ts_tablet_manager.cc:1434] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.164s user 0.007s sys 0.001s
W20260810 13:54:10.394317 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 52771.7us
W20260810 13:54:10.431891 12952 leader_election.cc:343] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:10.431941 15784 raft_consensus.cc:493] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:10.432422 15784 raft_consensus.cc:515] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.433092 15869 consensus_queue.cc:1048] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:10.434506 15784 leader_election.cc:290] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:10.434386 15869 consensus_queue.cc:1048] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:10.426164 15702 raft_consensus.cc:2243] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:10.437011 15702 raft_consensus.cc:2272] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:10.441568 15424 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:10.444491 15702 ts_tablet_manager.cc:1916] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:10.449888 15869 consensus_queue.cc:1048] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:10.448473 15434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1298bde14cec4cd3a9d6338c7d47f0b7. Latest consensus state: current_term: 1 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:10.451766 15434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:54:10.453985 15873 raft_consensus.cc:493] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:10.454653 15873 raft_consensus.cc:515] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.458899 15873 leader_election.cc:290] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:10.459091 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:10.459695 13257 raft_consensus.cc:2468] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:10.465641 12952 leader_election.cc:304] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:10.467918 12951 leader_election.cc:304] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:10.469050 15877 raft_consensus.cc:2804] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:10.469532 15877 raft_consensus.cc:493] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:10.469976 15877 raft_consensus.cc:3060] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:10.471783 15873 raft_consensus.cc:2804] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:10.472581 15873 raft_consensus.cc:697] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:10.473666 15873 consensus_queue.cc:237] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.477989 15784 raft_consensus.cc:493] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:10.479511 15784 raft_consensus.cc:515] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:10.481783 15784 leader_election.cc:290] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:10.490314 13121 heartbeater.cc:344] Connected to a master server at 127.12.36.61:35861
W20260810 13:54:10.498344 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 65494.7us
I20260810 13:54:10.500102 15748 consensus_queue.cc:1048] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:10.512812 12836 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet fb30ebe9520d4224bdfd45a5e915d8bd
W20260810 13:54:10.512799 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 74698.4us
W20260810 13:54:10.514444 13382 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:10.515491 13382 leader_election.cc:304] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
W20260810 13:54:10.517782 13167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:10.518663 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet fb30ebe9520d4224bdfd45a5e915d8bd with delete_type TABLET_DATA_DELETED (Replaced by f2b97ddd62b547ba997bf3044d37029d at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:10.520989 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f3d299c668c444908ccdc2f36873ad24 consensus state has no leader
W20260810 13:54:10.524833 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f425739a239144048975fb15a26d197e consensus state has no leader
I20260810 13:54:10.528882 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 82fe5ef58d9a49389a201ea7c51faad5 (DEFAULT_TABLE table=default.Table_77e30d5f98584b9e9711faa0b7a824df [id=6afc4e9a485640dda167bbaa0d6b347e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.530262 12747 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 0f422b17b9a24f609b06625837947e64
I20260810 13:54:10.531584 12747 catalog_manager.cc:6807] ReplaceTablet: tablet 0f422b17b9a24f609b06625837947e64 deleted and replaced by tablet e24ce014b17f418fbea698adb0d7ff60
I20260810 13:54:10.537707 15882 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 13:54:10.544516 13208 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f422b17b9a24f609b06625837947e64 with delete_type TABLET_DATA_DELETED (replaced by tablet e24ce014b17f418fbea698adb0d7ff60) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:10.557472 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 3641ae594b104131bb55005bc1f61027
I20260810 13:54:10.559731 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet ffcb4016b1984ab9a00699bda1488664
I20260810 13:54:10.569691 13206 tablet_service.cc:1558] Processing DeleteTablet for tablet ffcb4016b1984ab9a00699bda1488664 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:10.570816 13217 tablet_service.cc:1511] Processing CreateTablet for tablet ea80282f10e647ebb4b7c87112f579c9 (DEFAULT_TABLE table=default.Table_7c53cfb1808c47e59a8e23b0e6325acd [id=5558467decbe4ca29c989c08073be0de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.571743 13208 tablet_service.cc:1558] Processing DeleteTablet for tablet 3641ae594b104131bb55005bc1f61027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:10.578384 15857 raft_consensus.cc:2804] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:10.578791 15857 raft_consensus.cc:493] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:10.579133 15857 raft_consensus.cc:3060] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:10.589135 15857 raft_consensus.cc:515] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.591094 15857 leader_election.cc:290] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:10.591562 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 66170us
I20260810 13:54:10.608407 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_fd80397e5f4247339b3e3d483a671afa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:10.609761 15181 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" instance_seqno: 1786370005442414) as {username='slave'} at 127.12.36.3:51727; Asking this server to re-register.
W20260810 13:54:10.610081 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd80397e5f4247339b3e3d483a671afa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.613188 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_da227c8b756041528b3a4dd7196645fe" } new_table_name: "default.Table_276835c42e5a48309351dd4e441cc62f" modify_external_catalogs: true
I20260810 13:54:10.614006 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fe5ef58d9a49389a201ea7c51faad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.619488 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea80282f10e647ebb4b7c87112f579c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.621146 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_03b06d24159c4b079c0008aa041c517b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:10.622618 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_03b06d24159c4b079c0008aa041c517b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.626645 15321 ts_tablet_manager.cc:1929] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:10.627041 15321 log.cc:1199] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/e6bfb69a7ce74175b4f1f5f4db583aa9
I20260810 13:54:10.627813 15321 ts_tablet_manager.cc:1950] T e6bfb69a7ce74175b4f1f5f4db583aa9 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:10.628960 15784 raft_consensus.cc:493] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:10.629329 13164 leader_election.cc:304] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:10.629401 15784 raft_consensus.cc:515] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:10.630192 15785 raft_consensus.cc:2804] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:10.630548 15785 raft_consensus.cc:493] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:10.631105 15785 raft_consensus.cc:3060] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:10.631433 15784 leader_election.cc:290] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:10.637625 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ac603f8e352345f98a0cd705e12f5097"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:10.638473 15785 raft_consensus.cc:515] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:10.639125 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac603f8e352345f98a0cd705e12f5097 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.641777 15785 leader_election.cc:290] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:10.645985 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 499) took 2892 ms. Trace:
I20260810 13:54:10.647596 15702 ts_tablet_manager.cc:1929] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:10.648108 15702 log.cc:1199] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/cb8aea1057f445a9b060d138952324ca
I20260810 13:54:10.658866 13639 tablet_bootstrap.cc:700] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: Time spent opening tablet: real 0.177s user 0.002s sys 0.000s
I20260810 13:54:10.658946 15702 ts_tablet_manager.cc:1950] T cb8aea1057f445a9b060d138952324ca P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:10.659139 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b5e6f89f8d854f7e991193036d4d8321"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:10.660825 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5e6f89f8d854f7e991193036d4d8321 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.661530 13639 tablet_bootstrap.cc:654] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:10.661895 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 505) took 1923 ms. Trace:
I20260810 13:54:10.639029 13638 tablet_bootstrap.cc:492] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:10.667524 13640 tablet_bootstrap.cc:654] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:10.670238 12746 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]). Expected version 1 got 0
I20260810 13:54:10.646313 15321 rpcz_store.cc:276] 0810 13:54:07.753628 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.753780 (+ 152us) service_pool.cc:224] Handling call
0810 13:54:10.116241 (+2362461us) ts_tablet_manager.cc:1151] Deleting tablet e6bfb69a7ce74175b4f1f5f4db583aa9
0810 13:54:10.116290 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:10.438849 (+322559us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.621267 (+182418us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.645925 (+ 24658us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15873,"tablet-delete.queue_time_us":2361911}
I20260810 13:54:10.685604 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac9e3d3430044a5e85e2d812b7e221f5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:10.689286 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:10.648458 15877 raft_consensus.cc:515] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.706769 15877 leader_election.cc:290] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:10.707023 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet e6bfb69a7ce74175b4f1f5f4db583aa9 (table default.Table_f98c8ce886d84413a005fa4b80373027 [id=10e4d51c28b7401bbf53fdcf117f9e3c]) successfully deleted
I20260810 13:54:10.709797 13040 raft_consensus.cc:2393] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:10.714497 12998 tablet_service.cc:1511] Processing CreateTablet for tablet e837879f1c2549c795b240589dfa9bf7 (DEFAULT_TABLE table=default.Table_209ee5a105144c7e871214eaafcd0cbe [id=9a05ad06179141dfabe2d12858c1746c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.718463 13003 tablet_service.cc:1511] Processing CreateTablet for tablet 2b88b4fa155d4364b4fa1b2c724755bb (DEFAULT_TABLE table=default.Table_856a1bf64ef9498890c9b6d98edcc8ad [id=60b4f30b701344d79b0c64b4e8127dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.719822 13208 tablet_service.cc:1511] Processing CreateTablet for tablet d669bb7f769c44df994efae1d39eb7a8 (DEFAULT_TABLE table=default.Table_a34a40f45be7413bb670738c4199fa50 [id=fd9cae2939d9440b92dc923383e5839c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.721181 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:10.722155 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e837879f1c2549c795b240589dfa9bf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.724020 13206 tablet_service.cc:1511] Processing CreateTablet for tablet af106f431764457bbeb43691f5b0a46a (DEFAULT_TABLE table=default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 [id=19cf8ac217b34ed1b6ceccb40508fd56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.725824 13268 raft_consensus.cc:2393] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:10.725988 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b88b4fa155d4364b4fa1b2c724755bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.731777 12747 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_fd7c2744dc274e678bcb58f7eb4fb1f7" } new_table_name: "default.Table_56ff9d041639490089431e67e55e741c" modify_external_catalogs: true
I20260810 13:54:10.737030 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 501) took 2981 ms. Trace:
I20260810 13:54:10.737432 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d669bb7f769c44df994efae1d39eb7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.741314 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af106f431764457bbeb43691f5b0a46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.768172 13239 tablet_service.cc:1511] Processing CreateTablet for tablet c4a656fba31f49d99303e6a71cc4a9a6 (DEFAULT_TABLE table=default.Table_e4f9174b7de74fd79642def9d4d0fffd [id=f8ba71724c3f4068a8377462165aee32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.769061 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0e5dd5b3fe41426192ac5ea2177f974f" } modify_external_catalogs: true
I20260810 13:54:10.769589 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_0e5dd5b3fe41426192ac5ea2177f974f" } modify_external_catalogs: true
I20260810 13:54:10.785213 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a656fba31f49d99303e6a71cc4a9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.786957 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet fd22f04344954142922942fc4b7cb157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:10.788702 12999 tablet_service.cc:1558] Processing DeleteTablet for tablet 39ff3a48af494009bb53ee8d4e2a08cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:10.662240 15702 rpcz_store.cc:276] 0810 13:54:08.738070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:08.738884 (+ 814us) service_pool.cc:224] Handling call
0810 13:54:10.246180 (+1507296us) ts_tablet_manager.cc:1151] Deleting tablet cb8aea1057f445a9b060d138952324ca
0810 13:54:10.246300 (+ 120us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:10.474470 (+228170us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.647452 (+172982us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.661838 (+ 14386us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178322,"tablet-delete.queue_time_us":1506706}
I20260810 13:54:10.802001 15702 tablet_replica.cc:333] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:10.805562 13012 tablet_service.cc:1558] Processing DeleteTablet for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:10.806046 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 815f4333c441441ca8e857df66a0263e (DEFAULT_TABLE table=default.Table_8606de06b2994b3291a5ee1e28ad7100 [id=7162bee4392749a38057f272df172987]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.806574 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c3b03d5f1543b28ea6c439c3cfb07e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:10.808264 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815f4333c441441ca8e857df66a0263e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.811859 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 82fe5ef58d9a49389a201ea7c51faad5 (DEFAULT_TABLE table=default.Table_77e30d5f98584b9e9711faa0b7a824df [id=6afc4e9a485640dda167bbaa0d6b347e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.813441 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fe5ef58d9a49389a201ea7c51faad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.819110 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:10.821866 12999 tablet_service.cc:1511] Processing CreateTablet for tablet 48ff07074f4a4392adc6c3aa0360454f (DEFAULT_TABLE table=default.Table_da87a4b83c12422e999c5b88c825d890 [id=3064108a10bd4f76b2be6614ebed22fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.823526 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ff07074f4a4392adc6c3aa0360454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.667799 15852 raft_consensus.cc:493] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:10.824512 15852 raft_consensus.cc:515] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:10.668399 13551 heartbeater.cc:461] Registering TS with master...
I20260810 13:54:10.827525 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet fb30ebe9520d4224bdfd45a5e915d8bd with delete_type TABLET_DATA_DELETED (Replaced by f2b97ddd62b547ba997bf3044d37029d at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:54:10.829758 12747 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a04498da4fce45bb9a906e75594a023f has no consensus state
I20260810 13:54:10.835651 13217 tablet_service.cc:1511] Processing CreateTablet for tablet b427309e4db942bd920539274bffe7cd (DEFAULT_TABLE table=default.Table_819cbf37633d4c75ba529b0d037cb8db [id=8d2ee7c5b732405c804aec9f79e98038]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.836580 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8eb7d73e845b48b6a2356ad6c1004d1f" } modify_external_catalogs: true
I20260810 13:54:10.837095 13217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b427309e4db942bd920539274bffe7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.837121 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_8eb7d73e845b48b6a2356ad6c1004d1f" } modify_external_catalogs: true
I20260810 13:54:10.840026 15181 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "218e946161f64d1d92427684ac15e4fb" instance_seqno: 1786370003430791) as {username='slave'} at 127.12.36.2:55221; Asking this server to re-register.
I20260810 13:54:10.844234 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f422b17b9a24f609b06625837947e64 with delete_type TABLET_DATA_DELETED (replaced by tablet e24ce014b17f418fbea698adb0d7ff60) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:10.847041 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet 3641ae594b104131bb55005bc1f61027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:10.847213 15348 ts_tablet_manager.cc:1929] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:10.847580 15348 log.cc:1199] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/3a1b35d369474ba9bee379089796bd3c
I20260810 13:54:10.847862 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet a17d73c65f544b7c8566fd874ee87a25
I20260810 13:54:10.851164 13011 tablet_service.cc:1558] Processing DeleteTablet for tablet ffcb4016b1984ab9a00699bda1488664 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:10.852003 13004 tablet_service.cc:1511] Processing CreateTablet for tablet d669bb7f769c44df994efae1d39eb7a8 (DEFAULT_TABLE table=default.Table_a34a40f45be7413bb670738c4199fa50 [id=fd9cae2939d9440b92dc923383e5839c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.852398 13224 tablet_service.cc:1558] Processing DeleteTablet for tablet a17d73c65f544b7c8566fd874ee87a25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:10.852563 13022 tablet_service.cc:1511] Processing CreateTablet for tablet ea80282f10e647ebb4b7c87112f579c9 (DEFAULT_TABLE table=default.Table_7c53cfb1808c47e59a8e23b0e6325acd [id=5558467decbe4ca29c989c08073be0de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.737406 15321 rpcz_store.cc:276] 0810 13:54:07.755996 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.756117 (+ 121us) service_pool.cc:224] Handling call
0810 13:54:10.709747 (+2953630us) ts_tablet_manager.cc:1151] Deleting tablet 00a7bce2378f482d81d2ad08e9d15b0c
0810 13:54:10.736758 (+ 27011us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:10.736969 (+ 211us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2952932}
I20260810 13:54:10.854218 15321 tablet_replica.cc:333] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
W20260810 13:54:10.854279 12721 catalog_manager.cc:5017] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 00a7bce2378f482d81d2ad08e9d15b0c because the tablet was not found. No further retry: Not found: Tablet not found: 00a7bce2378f482d81d2ad08e9d15b0c
I20260810 13:54:10.854279 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_b9529457562e49f380c06dc35ced9cfd" } new_table_name: "default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d" modify_external_catalogs: true
I20260810 13:54:10.860056 15702 raft_consensus.cc:2243] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:10.861209 15702 pending_rounds.cc:70] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:54:10.861589 15702 pending_rounds.cc:77] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971727059681280 op_type: NO_OP noop_request { }
I20260810 13:54:10.862247 15702 raft_consensus.cc:2889] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:10.862841 15702 raft_consensus.cc:2272] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:10.866631 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d669bb7f769c44df994efae1d39eb7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.867267 13342 heartbeater.cc:461] Registering TS with master...
I20260810 13:54:10.873615 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea80282f10e647ebb4b7c87112f579c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.848316 15348 ts_tablet_manager.cc:1950] T 3a1b35d369474ba9bee379089796bd3c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:10.890863 15852 leader_election.cc:290] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:10.895795 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 1956edd131c14f93994b5d9f2a7420b1 (DEFAULT_TABLE table=default.Table_72e9522a295642b28aa17f724e010d9e [id=143a3ec1ee2d409fa9de19aa1c8c8ab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.902657 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1956edd131c14f93994b5d9f2a7420b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.905436 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_734de53e103d480c93e2779ef687142e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:10.907186 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_734de53e103d480c93e2779ef687142e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.907269 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:10.908767 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.916643 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet b0b44a300d4b4f41854371735ecbab1a
I20260810 13:54:10.917695 13018 tablet_service.cc:1511] Processing CreateTablet for tablet af106f431764457bbeb43691f5b0a46a (DEFAULT_TABLE table=default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 [id=19cf8ac217b34ed1b6ceccb40508fd56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.918668 13210 tablet_service.cc:1558] Processing DeleteTablet for tablet b0b44a300d4b4f41854371735ecbab1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:10.926426 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af106f431764457bbeb43691f5b0a46a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:10.928743 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 285921us
I20260810 13:54:10.936414 13011 tablet_service.cc:1511] Processing CreateTablet for tablet c4a656fba31f49d99303e6a71cc4a9a6 (DEFAULT_TABLE table=default.Table_e4f9174b7de74fd79642def9d4d0fffd [id=f8ba71724c3f4068a8377462165aee32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.937418 13638 tablet_bootstrap.cc:700] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb: Time spent opening tablet: real 0.161s user 0.004s sys 0.000s
I20260810 13:54:10.937930 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a656fba31f49d99303e6a71cc4a9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.946877 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 461) took 7990 ms. Trace:
I20260810 13:54:10.947463 13021 tablet_service.cc:1511] Processing CreateTablet for tablet b427309e4db942bd920539274bffe7cd (DEFAULT_TABLE table=default.Table_819cbf37633d4c75ba529b0d037cb8db [id=8d2ee7c5b732405c804aec9f79e98038]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.947214 15348 rpcz_store.cc:276] 0810 13:54:02.956029 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.956132 (+ 103us) service_pool.cc:224] Handling call
0810 13:54:10.188460 (+7232328us) ts_tablet_manager.cc:1151] Deleting tablet 3a1b35d369474ba9bee379089796bd3c
0810 13:54:10.300843 (+112383us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:10.378991 (+ 78148us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.847068 (+468077us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:10.946810 (+ 99742us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69719,"tablet-delete.queue_time_us":7213385}
I20260810 13:54:10.948550 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b427309e4db942bd920539274bffe7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.949231 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:10.950026 13259 raft_consensus.cc:2393] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:10.957129 13009 tablet_service.cc:1558] Processing DeleteTablet for tablet a17d73c65f544b7c8566fd874ee87a25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:10.957300 13638 tablet_bootstrap.cc:654] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:10.959523 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 1956edd131c14f93994b5d9f2a7420b1 (DEFAULT_TABLE table=default.Table_72e9522a295642b28aa17f724e010d9e [id=143a3ec1ee2d409fa9de19aa1c8c8ab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.960714 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1956edd131c14f93994b5d9f2a7420b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:10.963088 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_40e69780eeb744aa8a192c8623bc7d4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:10.965049 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40e69780eeb744aa8a192c8623bc7d4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:10.965607 13210 tablet_service.cc:1511] Processing CreateTablet for tablet 4744dd484c3d4e0cb903840759ec532f (DEFAULT_TABLE table=default.Table_08e421ad9e1d4274b11c4cb314c36201 [id=f7546e5fae5641d0b1747c71934496ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:10.966701 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4744dd484c3d4e0cb903840759ec532f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:10.982430 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 52265.2us
I20260810 13:54:10.994783 15321 raft_consensus.cc:2243] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:10.995501 15321 raft_consensus.cc:2272] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:10.998557 13639 tablet_bootstrap.cc:492] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:10.999545 13639 ts_tablet_manager.cc:1403] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.653s user 0.013s sys 0.023s
I20260810 13:54:10.999583 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_a3085b5448ff4df8a25c4802ca130085"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:11.001262 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a3085b5448ff4df8a25c4802ca130085 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:11.003392 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb30ebe9520d4224bdfd45a5e915d8bd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:11.004029 13470 raft_consensus.cc:2468] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:11.021837 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 8e82c1366b534a11b7d615c3602406af (DEFAULT_TABLE table=default.Table_9ec2734c1c43472ca16731c99911a350 [id=b5072df8be3e4cc58980380d089942e2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:11.027444 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1a575515446d4e7db38c75820908b743 consensus state has no leader
I20260810 13:54:11.032131 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 462) took 8075 ms. Trace:
I20260810 13:54:11.032531 15348 rpcz_store.cc:276] 0810 13:54:02.956296 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.972818 (+ 16522us) service_pool.cc:224] Handling call
0810 13:54:10.948196 (+7975378us) ts_tablet_manager.cc:1151] Deleting tablet ca4c0fea312c418f8ebd5c0619e7e220
0810 13:54:11.002067 (+ 53871us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:11.032060 (+ 29993us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7971297}
I20260810 13:54:11.033885 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 469) took 8074 ms. Trace:
I20260810 13:54:11.034227 15348 rpcz_store.cc:276] 0810 13:54:02.959701 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.973069 (+ 13368us) service_pool.cc:224] Handling call
0810 13:54:11.033486 (+8060417us) ts_tablet_manager.cc:1151] Deleting tablet c4ecf9abd60848f993234e98284974e8
0810 13:54:11.033547 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:11.033827 (+ 280us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8055033}
I20260810 13:54:11.035571 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 460) took 8080 ms. Trace:
I20260810 13:54:11.035888 15348 rpcz_store.cc:276] 0810 13:54:02.955475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.972737 (+ 17262us) service_pool.cc:224] Handling call
0810 13:54:11.035091 (+8062354us) ts_tablet_manager.cc:1151] Deleting tablet 00a4341f5d274a9eb54cb030b47c9a91
0810 13:54:11.035152 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:11.035499 (+ 347us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8055327}
I20260810 13:54:11.036842 13216 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3e50e523354dd7898ff1768ae824bb (DEFAULT_TABLE table=default.Table_54ea5af3ae44427eb0031a29dd62e663 [id=834d810fa56c49de9d97b91dabab82f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.037847 13640 tablet_bootstrap.cc:492] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:11.042018 13640 ts_tablet_manager.cc:1403] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.648s user 0.007s sys 0.013s
I20260810 13:54:11.050720 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 78e70ef9f0b642ab92d866cac1263cf8 (DEFAULT_TABLE table=default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.057173 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "32721630ac494c07b015c02f4741cad8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:11.057909 13468 raft_consensus.cc:2468] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:11.018270 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet b0b44a300d4b4f41854371735ecbab1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:11.019905 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 4744dd484c3d4e0cb903840759ec532f (DEFAULT_TABLE table=default.Table_08e421ad9e1d4274b11c4cb314c36201 [id=f7546e5fae5641d0b1747c71934496ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.034657 15702 ts_tablet_manager.cc:1916] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:11.051378 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 8e82c1366b534a11b7d615c3602406af (DEFAULT_TABLE table=default.Table_9ec2734c1c43472ca16731c99911a350 [id=b5072df8be3e4cc58980380d089942e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.060776 15321 ts_tablet_manager.cc:1916] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:11.062776 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e93928dcb94ae296590c4dedfd1781" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:11.064389 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:11.065194 13468 raft_consensus.cc:2393] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:11.066957 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ff3a48af494009bb53ee8d4e2a08cd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:11.069572 13227 tablet_service.cc:1511] Processing CreateTablet for tablet 5e99055cb9814d4d9b22e7a99a9ca61e (DEFAULT_TABLE table=default.Table_4b2d4fca101f4cbc9f296c50ca183066 [id=35087d7e2d0642a59670773333dda055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.078531 13639 raft_consensus.cc:359] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:11.079192 13639 raft_consensus.cc:385] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:11.079456 13639 raft_consensus.cc:740] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:11.080299 13638 tablet_bootstrap.cc:492] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:11.080019 13639 consensus_queue.cc:260] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:11.080782 13638 ts_tablet_manager.cc:1403] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.442s user 0.011s sys 0.001s
I20260810 13:54:11.083515 13231 tablet_service.cc:1511] Processing CreateTablet for tablet b8fcd43569dd49b38d3227b312b896c4 (DEFAULT_TABLE table=default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb [id=dea63931a83f494b8fa574685cd4ff24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.099349 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 95ad70febdef4f59b252bc5f1bf6d25e (DEFAULT_TABLE table=default.Table_ea7f41d802964936a967be553d7418fe [id=96574627e23442ebb0323b065423efae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.099848 12744 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]). Expected version 1 got 0
I20260810 13:54:11.104061 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b820c99b33264add8df5fd443981d0cc" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:11.109836 13639 ts_tablet_manager.cc:1434] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.050s user 0.005s sys 0.000s
I20260810 13:54:11.125801 15181 ts_manager.cc:194] Registered new tserver with Master: 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:11.125325 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:11.127651 13042 raft_consensus.cc:2393] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:11.130242 13221 tablet_service.cc:1511] Processing CreateTablet for tablet f2b97ddd62b547ba997bf3044d37029d (DEFAULT_TABLE table=default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.143536 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_133760df225b4dda850229214ad22194" } new_table_name: "default.Table_9feb9759744149f69e0a5d3358bd4880" modify_external_catalogs: true
I20260810 13:54:11.151566 12746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_25022662dc9f47efbf32de19c684ea1b" } modify_external_catalogs: true
I20260810 13:54:11.152158 12746 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_25022662dc9f47efbf32de19c684ea1b" } modify_external_catalogs: true
I20260810 13:54:11.153481 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9930da7fdf244dd099a7b0c848073c55" } modify_external_catalogs: true
I20260810 13:54:11.153981 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_9930da7fdf244dd099a7b0c848073c55" } modify_external_catalogs: true
I20260810 13:54:11.155828 13427 tablet_service.cc:1558] Processing DeleteTablet for tablet ac9e3d3430044a5e85e2d812b7e221f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.156665 13425 tablet_service.cc:1558] Processing DeleteTablet for tablet fb30ebe9520d4224bdfd45a5e915d8bd with delete_type TABLET_DATA_DELETED (Replaced by f2b97ddd62b547ba997bf3044d37029d at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.157492 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f422b17b9a24f609b06625837947e64 with delete_type TABLET_DATA_DELETED (replaced by tablet e24ce014b17f418fbea698adb0d7ff60) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.164477 12742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_921fde42e0214ef58181c03785687004"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:11.164616 12747 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:11.195403 13640 raft_consensus.cc:359] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:11.196228 13640 raft_consensus.cc:385] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:11.202885 13236 tablet_service.cc:1511] Processing CreateTablet for tablet da66e50033cf48d4897128b3aa77127f (DEFAULT_TABLE table=default.Table_94153e136b9f4ea9aeb589c1a0322981 [id=12299e0dca554badab42ee7a73ea9723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.204586 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 5797a5de96ad4c3c80741e6673a8f194 (DEFAULT_TABLE table=default.Table_210fb0797673402e8e79fcf4e3c293b6 [id=aa1bdb6bb7c04faabb47c1552cc4aaff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.219544 13209 tablet_service.cc:1511] Processing CreateTablet for tablet f7cf6e6b67994c139d920fd1a3e014e6 (DEFAULT_TABLE table=default.Table_f7160fbf49d74f79b79a300e67af5cbf [id=440aa3e8a24a415eb98a448b4848e76d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:11.220836 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f934006c34a4b18ab157dad01a1b41d consensus state has no leader
W20260810 13:54:11.225167 12742 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_921fde42e0214ef58181c03785687004 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:11.232458 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_5469eacb9ee344faa2428f2ceaeabf32" } new_table_name: "default.Table_fb06dafcfccb4167954aa3010890df4f" modify_external_catalogs: true
I20260810 13:54:11.234542 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e82c1366b534a11b7d615c3602406af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.237000 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e70ef9f0b642ab92d866cac1263cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.237234 12746 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet a43def9358894b2aa001a7db56706589
I20260810 13:54:11.237136 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d21ea3e2ede2490b963de16453e2ad9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:11.240888 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fcd43569dd49b38d3227b312b896c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.244849 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3e50e523354dd7898ff1768ae824bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:11.245888 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d21ea3e2ede2490b963de16453e2ad9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:11.249060 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e99055cb9814d4d9b22e7a99a9ca61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.249105 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e8a597f1c0ec4cd8878f49046eb45e66"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:11.250931 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8a597f1c0ec4cd8878f49046eb45e66 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:11.253849 13217 tablet_service.cc:1558] Processing DeleteTablet for tablet a43def9358894b2aa001a7db56706589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:11 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:11.255475 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 995d901d22484799bd79fcad8103b8a5
I20260810 13:54:11.260398 13217 tablet_service.cc:1558] Processing DeleteTablet for tablet 995d901d22484799bd79fcad8103b8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:11 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:11.273248 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ad70febdef4f59b252bc5f1bf6d25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.273856 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b97ddd62b547ba997bf3044d37029d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.274559 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da66e50033cf48d4897128b3aa77127f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.277113 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5797a5de96ad4c3c80741e6673a8f194. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:11.296168 12749 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1bbee4f9a50342599434a2b05c0740bd consensus state has no leader
I20260810 13:54:11.346588 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cf6e6b67994c139d920fd1a3e014e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.345985 12745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_ee9ef5f74a944eaabe6af879e8ab15a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:11.348131 12745 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee9ef5f74a944eaabe6af879e8ab15a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:11.348637 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 468) took 8389 ms. Trace:
I20260810 13:54:11.349215 15348 rpcz_store.cc:276] 0810 13:54:02.959384 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:02.972986 (+ 13602us) service_pool.cc:224] Handling call
0810 13:54:11.348029 (+8375043us) ts_tablet_manager.cc:1151] Deleting tablet 7a490fcb16164f968335f069129b3d71
0810 13:54:11.348111 (+ 82us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:11.348458 (+ 347us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8056491}
I20260810 13:54:11.350698 15348 tablet_replica.cc:333] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:11.351660 15348 raft_consensus.cc:2243] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:11.360265 13638 raft_consensus.cc:359] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:11.361135 13638 raft_consensus.cc:385] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:11.378789 13210 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd68cdc1322448292c481925ad33c79 (DEFAULT_TABLE table=default.Table_278ad8ed658b48d28fcc3aa3eec747b0 [id=d585e61cb61a4312ba2dbadbcae39899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.380015 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd68cdc1322448292c481925ad33c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.200906 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb30ebe9520d4224bdfd45a5e915d8bd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:11.382875 13042 raft_consensus.cc:2468] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:11.391273 13040 raft_consensus.cc:3060] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:11.394093 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4744dd484c3d4e0cb903840759ec532f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:11.394917 13167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:11.361450 13638 raft_consensus.cc:740] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:11.397585 13638 consensus_queue.cc:260] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:11.399266 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 188119us
I20260810 13:54:11.409999 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet e6bfb69a7ce74175b4f1f5f4db583aa9 (table default.Table_f98c8ce886d84413a005fa4b80373027 [id=10e4d51c28b7401bbf53fdcf117f9e3c]) successfully deleted
I20260810 13:54:11.424937 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_2c503da47ba34831aa28e953821d301d" } new_table_name: "default.Table_ef4ac07aac5d4bc7993e09b22003497a" modify_external_catalogs: true
I20260810 13:54:11.436208 13221 tablet_service.cc:1511] Processing CreateTablet for tablet a75054766c894d78bfa6d7f565700dce (DEFAULT_TABLE table=default.Table_83164f9e96c540f58a5af47229b70854 [id=3f7f1db8228e4efa9b34bc33cb13be40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.437644 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75054766c894d78bfa6d7f565700dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.196520 13640 raft_consensus.cc:740] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:11.353461 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 3641ae594b104131bb55005bc1f61027 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.355541 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 82fe5ef58d9a49389a201ea7c51faad5 (DEFAULT_TABLE table=default.Table_77e30d5f98584b9e9711faa0b7a824df [id=6afc4e9a485640dda167bbaa0d6b347e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.443043 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82fe5ef58d9a49389a201ea7c51faad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.356880 13427 tablet_service.cc:1558] Processing DeleteTablet for tablet ffcb4016b1984ab9a00699bda1488664 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.358979 13445 tablet_service.cc:1511] Processing CreateTablet for tablet ea80282f10e647ebb4b7c87112f579c9 (DEFAULT_TABLE table=default.Table_7c53cfb1808c47e59a8e23b0e6325acd [id=5558467decbe4ca29c989c08073be0de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.444965 13206 tablet_service.cc:1511] Processing CreateTablet for tablet d5cb099133c04a07956581f23378ddf4 (DEFAULT_TABLE table=default.Table_4b93246ea61e418db4efb3c2732711af [id=847e7c0039964b3f94192d5032791e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.445806 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea80282f10e647ebb4b7c87112f579c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.446017 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5cb099133c04a07956581f23378ddf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.412478 13421 tablet_service.cc:1511] Processing CreateTablet for tablet d669bb7f769c44df994efae1d39eb7a8 (DEFAULT_TABLE table=default.Table_a34a40f45be7413bb670738c4199fa50 [id=fd9cae2939d9440b92dc923383e5839c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.449474 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d669bb7f769c44df994efae1d39eb7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.450682 12744 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_080235e72e36450ba5d17b341d2f2b2e" } modify_external_catalogs: true
I20260810 13:54:11.415411 13420 tablet_service.cc:1511] Processing CreateTablet for tablet af106f431764457bbeb43691f5b0a46a (DEFAULT_TABLE table=default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 [id=19cf8ac217b34ed1b6ceccb40508fd56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.453461 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af106f431764457bbeb43691f5b0a46a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.453306 13208 tablet_service.cc:1511] Processing CreateTablet for tablet 058562eef38d46a8a3a39e3ce5425dd6 (DEFAULT_TABLE table=default.Table_9d81870e910444848f2c714a1b9da18c [id=e506f8a07858485398058c93c553f904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.454321 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 058562eef38d46a8a3a39e3ce5425dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.416810 13428 tablet_service.cc:1511] Processing CreateTablet for tablet c4a656fba31f49d99303e6a71cc4a9a6 (DEFAULT_TABLE table=default.Table_e4f9174b7de74fd79642def9d4d0fffd [id=f8ba71724c3f4068a8377462165aee32]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.459132 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4a656fba31f49d99303e6a71cc4a9a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.423684 13429 tablet_service.cc:1558] Processing DeleteTablet for tablet a17d73c65f544b7c8566fd874ee87a25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.425004 13438 tablet_service.cc:1511] Processing CreateTablet for tablet b427309e4db942bd920539274bffe7cd (DEFAULT_TABLE table=default.Table_819cbf37633d4c75ba529b0d037cb8db [id=8d2ee7c5b732405c804aec9f79e98038]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.427117 13419 tablet_service.cc:1511] Processing CreateTablet for tablet 4744dd484c3d4e0cb903840759ec532f (DEFAULT_TABLE table=default.Table_08e421ad9e1d4274b11c4cb314c36201 [id=f7546e5fae5641d0b1747c71934496ec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.427639 13442 tablet_service.cc:1558] Processing DeleteTablet for tablet b0b44a300d4b4f41854371735ecbab1a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:10 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.428146 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 8e82c1366b534a11b7d615c3602406af (DEFAULT_TABLE table=default.Table_9ec2734c1c43472ca16731c99911a350 [id=b5072df8be3e4cc58980380d089942e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.429171 13417 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3e50e523354dd7898ff1768ae824bb (DEFAULT_TABLE table=default.Table_54ea5af3ae44427eb0031a29dd62e663 [id=834d810fa56c49de9d97b91dabab82f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.462220 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b427309e4db942bd920539274bffe7cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.462090 12739 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ac603f8e352345f98a0cd705e12f5097" } modify_external_catalogs: true
I20260810 13:54:11.465698 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3e50e523354dd7898ff1768ae824bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.469194 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e82c1366b534a11b7d615c3602406af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.473269 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4744dd484c3d4e0cb903840759ec532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.429348 13426 tablet_service.cc:1511] Processing CreateTablet for tablet 78e70ef9f0b642ab92d866cac1263cf8 (DEFAULT_TABLE table=default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.477648 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e70ef9f0b642ab92d866cac1263cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.430207 13436 tablet_service.cc:1511] Processing CreateTablet for tablet b8fcd43569dd49b38d3227b312b896c4 (DEFAULT_TABLE table=default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb [id=dea63931a83f494b8fa574685cd4ff24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.430408 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 5e99055cb9814d4d9b22e7a99a9ca61e (DEFAULT_TABLE table=default.Table_4b2d4fca101f4cbc9f296c50ca183066 [id=35087d7e2d0642a59670773333dda055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.481554 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e99055cb9814d4d9b22e7a99a9ca61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.482182 12742 master_service.cc:960] ReplaceTablet: received request to replace tablet de012d382b194bf193fef76779abcf17 from {username='slave'} at 127.0.0.1:48758
W20260810 13:54:11.484313 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:11.428606 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 1956edd131c14f93994b5d9f2a7420b1 (DEFAULT_TABLE table=default.Table_72e9522a295642b28aa17f724e010d9e [id=143a3ec1ee2d409fa9de19aa1c8c8ab3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.485004 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fcd43569dd49b38d3227b312b896c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.485590 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1956edd131c14f93994b5d9f2a7420b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.485342 13640 consensus_queue.cc:260] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:11.500532 12749 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ea78a26b840d41b0bb76bbc37881b9c7" } new_table_name: "default.Table_70a5ed6b181b4db1ae5c28b4b6ca4553" modify_external_catalogs: true
I20260810 13:54:11.502475 12746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_b6a730448efc42958de4f9513cbd365b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:11.504384 12746 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6a730448efc42958de4f9513cbd365b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:11.518599 13640 ts_tablet_manager.cc:1434] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.476s user 0.006s sys 0.001s
I20260810 13:54:11.530514 15348 raft_consensus.cc:2272] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:11.534523 13638 ts_tablet_manager.cc:1434] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.453s user 0.004s sys 0.002s
I20260810 13:54:11.534688 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_51d643dcb2a5451e9cff367f2b3649c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 13:54:11.535638 13638 tablet_bootstrap.cc:492] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:11.536830 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51d643dcb2a5451e9cff367f2b3649c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:11.539601 12740 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e424bd25638b4b23b721c8529aa42285"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:11.540769 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet a04498da4fce45bb9a906e75594a023f (table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a04498da4fce45bb9a906e75594a023f has no consensus state
W20260810 13:54:11.541288 12740 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e424bd25638b4b23b721c8529aa42285 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:11.550747 15348 ts_tablet_manager.cc:1916] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:11.571656 12744 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_080235e72e36450ba5d17b341d2f2b2e" } modify_external_catalogs: true
I20260810 13:54:11.581041 15181 ts_manager.cc:194] Registered new tserver with Master: 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:11.605803 12739 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ac603f8e352345f98a0cd705e12f5097" } modify_external_catalogs: true
I20260810 13:54:11.612416 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_e317f4e20e124c60bbed5450c6c3ca07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:11.613911 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e317f4e20e124c60bbed5450c6c3ca07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:11.615159 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e93928dcb94ae296590c4dedfd1781" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:11.615885 13049 raft_consensus.cc:2393] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:11.619712 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:11.621443 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e82c1366b534a11b7d615c3602406af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.621791 13639 tablet_bootstrap.cc:492] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:11.625924 12742 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet de012d382b194bf193fef76779abcf17
I20260810 13:54:11.627722 12742 catalog_manager.cc:6807] ReplaceTablet: tablet de012d382b194bf193fef76779abcf17 deleted and replaced by tablet 19fe94b1d72b4bb29f0154f58c9fa43f
W20260810 13:54:11.634977 12745 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dd58cc128ce64f9abe1418b6093a1c2c consensus state has no leader
I20260810 13:54:11.620496 13043 raft_consensus.cc:2393] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:11.634501 15702 ts_tablet_manager.cc:1929] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:11.638247 15702 log.cc:1199] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/b820c99b33264add8df5fd443981d0cc
I20260810 13:54:11.639081 15702 ts_tablet_manager.cc:1950] T b820c99b33264add8df5fd443981d0cc P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:11.640012 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 506) took 2878 ms. Trace:
I20260810 13:54:11.640416 15702 rpcz_store.cc:276] 0810 13:54:08.762070 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:08.762215 (+ 145us) service_pool.cc:224] Handling call
0810 13:54:10.801713 (+2039498us) ts_tablet_manager.cc:1151] Deleting tablet b820c99b33264add8df5fd443981d0cc
0810 13:54:10.801816 (+ 103us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:11.121093 (+319277us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:11.633352 (+512259us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:11.639922 (+ 6570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56348,"tablet-delete.queue_time_us":2036846}
I20260810 13:54:11.642151 15702 tablet_replica.cc:333] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
W20260810 13:54:11.643863 12998 consensus_meta.cc:287] T e837879f1c2549c795b240589dfa9bf7 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.651s user 0.009s sys 0.005s
I20260810 13:54:11.664278 15321 ts_tablet_manager.cc:1929] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:11.668216 13233 tablet_service.cc:1511] Processing CreateTablet for tablet bfc9c907fe50470ca860728883fb6d9e (DEFAULT_TABLE table=default.Table_c4942145f1414e939000a9b7443c0d29 [id=b88902dec1e34475b3ae470c1c17f777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.670747 13239 tablet_service.cc:1511] Processing CreateTablet for tablet df3031d8f75d4548b458cee6dd2083d2 (DEFAULT_TABLE table=default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.660342 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet cb8aea1057f445a9b060d138952324ca (table default.Table_d447b3e1ee6a423dbe29ddad01c780b8 [id=bd6753e3ed074939b250f9fa448e47ba]) successfully deleted
I20260810 13:54:11.688766 13040 raft_consensus.cc:2468] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:11.693192 13639 tablet_bootstrap.cc:654] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:11.699474 13217 tablet_service.cc:1558] Processing DeleteTablet for tablet de012d382b194bf193fef76779abcf17 with delete_type TABLET_DATA_DELETED (replaced by tablet 19fe94b1d72b4bb29f0154f58c9fa43f) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:11.741966 15933 tablet.cc:1724] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260810 13:54:11.754559 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 84174us
I20260810 13:54:11.664652 15321 log.cc:1199] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/ef59f7013ab4489dadd9084d065533a8
W20260810 13:54:11.760955 13167 leader_election.cc:343] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: Tablet not RUNNING: STOPPED
I20260810 13:54:11.761390 13167 leader_election.cc:304] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:11.762166 15785 raft_consensus.cc:2749] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:11.764837 13236 tablet_service.cc:1511] Processing CreateTablet for tablet ceba68b27a63430fad93a30c452fb1a3 (DEFAULT_TABLE table=default.Table_772227d6702d4cf7bf6729e922d3eea5 [id=6ffcaf4f90f14e24b6d02b21e2936bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.781255 13435 tablet_service.cc:1511] Processing CreateTablet for tablet 95ad70febdef4f59b252bc5f1bf6d25e (DEFAULT_TABLE table=default.Table_ea7f41d802964936a967be553d7418fe [id=96574627e23442ebb0323b065423efae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.783063 13442 tablet_service.cc:1511] Processing CreateTablet for tablet f2b97ddd62b547ba997bf3044d37029d (DEFAULT_TABLE table=default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:11.784444 13011 consensus_meta.cc:287] T c4a656fba31f49d99303e6a71cc4a9a6 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.694s user 0.008s sys 0.001s
I20260810 13:54:11.806327 15930 tablet.cc:1724] T 9334ba72cfd94fa4a7062a29445c69f9 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:11.765473 15321 ts_tablet_manager.cc:1950] T ef59f7013ab4489dadd9084d065533a8 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:11.843019 13429 tablet_service.cc:1511] Processing CreateTablet for tablet da66e50033cf48d4897128b3aa77127f (DEFAULT_TABLE table=default.Table_94153e136b9f4ea9aeb589c1a0322981 [id=12299e0dca554badab42ee7a73ea9723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.854903 13427 tablet_service.cc:1511] Processing CreateTablet for tablet 5797a5de96ad4c3c80741e6673a8f194 (DEFAULT_TABLE table=default.Table_210fb0797673402e8e79fcf4e3c293b6 [id=aa1bdb6bb7c04faabb47c1552cc4aaff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.856218 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet a43def9358894b2aa001a7db56706589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:11 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.857254 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 995d901d22484799bd79fcad8103b8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:11 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.858580 13448 tablet_service.cc:1511] Processing CreateTablet for tablet f7cf6e6b67994c139d920fd1a3e014e6 (DEFAULT_TABLE table=default.Table_f7160fbf49d74f79b79a300e67af5cbf [id=440aa3e8a24a415eb98a448b4848e76d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.860428 13424 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd68cdc1322448292c481925ad33c79 (DEFAULT_TABLE table=default.Table_278ad8ed658b48d28fcc3aa3eec747b0 [id=d585e61cb61a4312ba2dbadbcae39899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.861780 13432 tablet_service.cc:1511] Processing CreateTablet for tablet df3031d8f75d4548b458cee6dd2083d2 (DEFAULT_TABLE table=default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.863075 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:11.866246 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_f98e5920f7d54537a56376403e71a0aa" } new_table_name: "default.Table_383bd937c51942a1b124430d2b5086af" modify_external_catalogs: true
I20260810 13:54:11.868259 13638 tablet_bootstrap.cc:654] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:11.900252 12744 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 3610bc4f8a0742fdb69347b40a04f078
I20260810 13:54:11.903791 13640 tablet_bootstrap.cc:492] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:11.904810 13434 tablet_service.cc:1511] Processing CreateTablet for tablet a75054766c894d78bfa6d7f565700dce (DEFAULT_TABLE table=default.Table_83164f9e96c540f58a5af47229b70854 [id=3f7f1db8228e4efa9b34bc33cb13be40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.904954 13217 tablet_service.cc:1558] Processing DeleteTablet for tablet 3610bc4f8a0742fdb69347b40a04f078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:11 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:11.904870 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 058562eef38d46a8a3a39e3ce5425dd6 (DEFAULT_TABLE table=default.Table_9d81870e910444848f2c714a1b9da18c [id=e506f8a07858485398058c93c553f904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.905859 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75054766c894d78bfa6d7f565700dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.903791 13423 tablet_service.cc:1511] Processing CreateTablet for tablet ceba68b27a63430fad93a30c452fb1a3 (DEFAULT_TABLE table=default.Table_772227d6702d4cf7bf6729e922d3eea5 [id=6ffcaf4f90f14e24b6d02b21e2936bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.910141 13426 tablet_service.cc:1511] Processing CreateTablet for tablet d5cb099133c04a07956581f23378ddf4 (DEFAULT_TABLE table=default.Table_4b93246ea61e418db4efb3c2732711af [id=847e7c0039964b3f94192d5032791e4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.911039 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5cb099133c04a07956581f23378ddf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.913004 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc9c907fe50470ca860728883fb6d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.913704 13419 tablet_service.cc:1511] Processing CreateTablet for tablet bfc9c907fe50470ca860728883fb6d9e (DEFAULT_TABLE table=default.Table_c4942145f1414e939000a9b7443c0d29 [id=b88902dec1e34475b3ae470c1c17f777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.914589 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc9c907fe50470ca860728883fb6d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.917263 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ad70febdef4f59b252bc5f1bf6d25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.917773 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3031d8f75d4548b458cee6dd2083d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.921134 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b97ddd62b547ba997bf3044d37029d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.925496 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da66e50033cf48d4897128b3aa77127f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.929169 13427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5797a5de96ad4c3c80741e6673a8f194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.934685 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cf6e6b67994c139d920fd1a3e014e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.937170 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd68cdc1322448292c481925ad33c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.941175 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3031d8f75d4548b458cee6dd2083d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.955096 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 500) took 4199 ms. Trace:
I20260810 13:54:11.955494 15321 rpcz_store.cc:276] 0810 13:54:07.755614 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.757898 (+ 2284us) service_pool.cc:224] Handling call
0810 13:54:10.853987 (+3096089us) ts_tablet_manager.cc:1151] Deleting tablet ef59f7013ab4489dadd9084d065533a8
0810 13:54:10.854045 (+ 58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:11.418169 (+564124us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:11.664152 (+245983us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:11.955028 (+290876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133574,"tablet-delete.queue_time_us":3095524}
I20260810 13:54:11.957191 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet ef59f7013ab4489dadd9084d065533a8 (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]) successfully deleted
I20260810 13:54:11.958707 15321 tablet_replica.cc:333] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:11.960171 15321 raft_consensus.cc:2243] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:11.960906 15321 raft_consensus.cc:2272] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:11.963430 15321 ts_tablet_manager.cc:1916] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:11.980876 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceba68b27a63430fad93a30c452fb1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.951251 13640 tablet_bootstrap.cc:654] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:12.009719 15321 ts_tablet_manager.cc:1929] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:12.010193 15321 log.cc:1199] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/cb8aea1057f445a9b060d138952324ca
I20260810 13:54:12.011191 15321 ts_tablet_manager.cc:1950] T cb8aea1057f445a9b060d138952324ca P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:12.023398 12744 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_6d071c01702c4d3cb0e693f02ef8a90f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:12.024971 12744 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d071c01702c4d3cb0e693f02ef8a90f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:12.026535 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 502) took 4266 ms. Trace:
I20260810 13:54:12.026917 15321 rpcz_store.cc:276] 0810 13:54:07.759763 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.759875 (+ 112us) service_pool.cc:224] Handling call
0810 13:54:11.956676 (+4196801us) ts_tablet_manager.cc:1151] Deleting tablet cb8aea1057f445a9b060d138952324ca
0810 13:54:11.958176 (+ 1500us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:11.992794 (+ 34618us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.009568 (+ 16774us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.026463 (+ 16895us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4196355}
I20260810 13:54:12.028295 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet cb8aea1057f445a9b060d138952324ca (table default.Table_d447b3e1ee6a423dbe29ddad01c780b8 [id=bd6753e3ed074939b250f9fa448e47ba]) successfully deleted
I20260810 13:54:12.029074 15321 tablet_replica.cc:333] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:12.029907 15321 raft_consensus.cc:2243] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:12.030369 15321 raft_consensus.cc:2272] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:12.032998 15321 ts_tablet_manager.cc:1916] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:11.841924 15702 raft_consensus.cc:2243] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:12.035135 15702 raft_consensus.cc:2272] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:12.038987 15702 ts_tablet_manager.cc:1916] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:11.869060 13639 tablet_bootstrap.cc:492] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:12.041000 13639 ts_tablet_manager.cc:1403] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.419s user 0.010s sys 0.003s
I20260810 13:54:11.871495 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:11.872200 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:11.874296 12998 tablet_service.cc:1511] Processing CreateTablet for tablet 5e99055cb9814d4d9b22e7a99a9ca61e (DEFAULT_TABLE table=default.Table_4b2d4fca101f4cbc9f296c50ca183066 [id=35087d7e2d0642a59670773333dda055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.043486 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e99055cb9814d4d9b22e7a99a9ca61e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.875674 13008 tablet_service.cc:1511] Processing CreateTablet for tablet b8fcd43569dd49b38d3227b312b896c4 (DEFAULT_TABLE table=default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb [id=dea63931a83f494b8fa574685cd4ff24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.045472 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8fcd43569dd49b38d3227b312b896c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:11.876816 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 95ad70febdef4f59b252bc5f1bf6d25e (DEFAULT_TABLE table=default.Table_ea7f41d802964936a967be553d7418fe [id=96574627e23442ebb0323b065423efae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.877306 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 5797a5de96ad4c3c80741e6673a8f194 (DEFAULT_TABLE table=default.Table_210fb0797673402e8e79fcf4e3c293b6 [id=aa1bdb6bb7c04faabb47c1552cc4aaff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.877938 13003 tablet_service.cc:1511] Processing CreateTablet for tablet f2b97ddd62b547ba997bf3044d37029d (DEFAULT_TABLE table=default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.879062 13021 tablet_service.cc:1511] Processing CreateTablet for tablet da66e50033cf48d4897128b3aa77127f (DEFAULT_TABLE table=default.Table_94153e136b9f4ea9aeb589c1a0322981 [id=12299e0dca554badab42ee7a73ea9723]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.880190 13004 tablet_service.cc:1511] Processing CreateTablet for tablet f7cf6e6b67994c139d920fd1a3e014e6 (DEFAULT_TABLE table=default.Table_f7160fbf49d74f79b79a300e67af5cbf [id=440aa3e8a24a415eb98a448b4848e76d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.049368 12749 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:12.049829 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ad70febdef4f59b252bc5f1bf6d25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.053366 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da66e50033cf48d4897128b3aa77127f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.057107 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b97ddd62b547ba997bf3044d37029d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.061173 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5797a5de96ad4c3c80741e6673a8f194. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.061888 15181 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" instance_seqno: 1786370000587132) as {username='slave'} at 127.12.36.1:53373; Asking this server to re-register.
I20260810 13:54:12.064465 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7cf6e6b67994c139d920fd1a3e014e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.064567 12739 catalog_manager.cc:6001] Not sending DeleteTablet requests; no consensus state for tablet 93dcebbcfe0f4f469dfc9939f8ac3f48
I20260810 13:54:12.067625 15785 raft_consensus.cc:493] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:12.068300 15785 raft_consensus.cc:515] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.074095 15785 leader_election.cc:290] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:12.080878 15321 ts_tablet_manager.cc:1929] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:12.081382 15321 log.cc:1199] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/32721630ac494c07b015c02f4741cad8
I20260810 13:54:12.082302 15321 ts_tablet_manager.cc:1950] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:12.083779 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 507) took 3484 ms. Trace:
I20260810 13:54:12.084093 15321 rpcz_store.cc:276] 0810 13:54:08.599539 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:08.599665 (+ 126us) service_pool.cc:224] Handling call
0810 13:54:12.028925 (+3429260us) ts_tablet_manager.cc:1151] Deleting tablet 32721630ac494c07b015c02f4741cad8
0810 13:54:12.028973 (+ 48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.059978 (+ 31005us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.068635 (+ 8657us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.083696 (+ 15061us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3428699}
I20260810 13:54:12.085423 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 32721630ac494c07b015c02f4741cad8 (table default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]) successfully deleted
I20260810 13:54:12.090086 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 522) took 3051 ms. Trace:
I20260810 13:54:12.090461 15321 rpcz_store.cc:276] 0810 13:54:09.038213 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:09.038342 (+ 129us) service_pool.cc:224] Handling call
0810 13:54:12.089644 (+3051302us) ts_tablet_manager.cc:1151] Deleting tablet 247fb8b09c12407d8535c07c5d0687fe
0810 13:54:12.089705 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.090018 (+ 313us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3050710}
W20260810 13:54:12.091969 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 247fb8b09c12407d8535c07c5d0687fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 247fb8b09c12407d8535c07c5d0687fe already in progress: creating tablet
I20260810 13:54:12.093243 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 525) took 3054 ms. Trace:
I20260810 13:54:12.093688 15321 rpcz_store.cc:276] 0810 13:54:09.039250 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:09.040002 (+ 752us) service_pool.cc:224] Handling call
0810 13:54:12.092915 (+3052913us) ts_tablet_manager.cc:1151] Deleting tablet 11e3902adc094227830cf6ddab916916
0810 13:54:12.092955 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.093194 (+ 239us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3052245}
W20260810 13:54:12.095302 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 11e3902adc094227830cf6ddab916916 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11e3902adc094227830cf6ddab916916 already in progress: creating tablet
W20260810 13:54:12.104840 13445 consensus_meta.cc:287] T ea80282f10e647ebb4b7c87112f579c9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.580s user 0.007s sys 0.000s
I20260810 13:54:11.916640 13421 tablet_service.cc:1558] Processing DeleteTablet for tablet de012d382b194bf193fef76779abcf17 with delete_type TABLET_DATA_DELETED (replaced by tablet 19fe94b1d72b4bb29f0154f58c9fa43f) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:11.880532 13022 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 537) took 1030 ms. Trace:
I20260810 13:54:11.880937 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet a43def9358894b2aa001a7db56706589 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:11 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:11.876669 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3e50e523354dd7898ff1768ae824bb (DEFAULT_TABLE table=default.Table_54ea5af3ae44427eb0031a29dd62e663 [id=834d810fa56c49de9d97b91dabab82f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:11.901350 12999 tablet_service.cc:1511] Processing CreateTablet for tablet 78e70ef9f0b642ab92d866cac1263cf8 (DEFAULT_TABLE table=default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.126152 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceba68b27a63430fad93a30c452fb1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.126821 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 058562eef38d46a8a3a39e3ce5425dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.145447 12747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_4f9508194c21480d9b603b139bdaf902"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:12.147280 12747 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f9508194c21480d9b603b139bdaf902 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:12.149575 12745 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_64421a271bfe4c4cbbab1afcd35955de" } new_table_name: "default.Table_2695264893564646a621e76ff6443e84" modify_external_catalogs: true
I20260810 13:54:12.153672 12740 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_22e32aea1f65480bb9ff9718ea6f6abb" } modify_external_catalogs: true
I20260810 13:54:12.154145 12740 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_22e32aea1f65480bb9ff9718ea6f6abb" } modify_external_catalogs: true
I20260810 13:54:12.199414 13164 leader_election.cc:304] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:12.201886 15931 raft_consensus.cc:2804] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:12.202651 15931 raft_consensus.cc:493] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:12.204563 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 3a1b35d369474ba9bee379089796bd3c (table default.Table_94f6cc658a01407194e9d5858f48d615 [id=1a0c5b7e411144e186003762b5dc3ace]) successfully deleted
W20260810 13:54:12.205574 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet ca4c0fea312c418f8ebd5c0619e7e220 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ca4c0fea312c418f8ebd5c0619e7e220 already in progress: creating tablet
W20260810 13:54:12.206387 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet c4ecf9abd60848f993234e98284974e8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4ecf9abd60848f993234e98284974e8 already in progress: creating tablet
W20260810 13:54:12.207100 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 00a4341f5d274a9eb54cb030b47c9a91 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 00a4341f5d274a9eb54cb030b47c9a91 already in progress: creating tablet
I20260810 13:54:12.186179 12749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_699797a1320b40709d0bf25947241900"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:12.244354 12749 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_699797a1320b40709d0bf25947241900 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:12.203378 15931 raft_consensus.cc:3060] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:12.258671 13164 leader_election.cc:304] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
W20260810 13:54:12.260013 13164 raft_consensus.cc:2686] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:54:12.262912 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 7a490fcb16164f968335f069129b3d71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7a490fcb16164f968335f069129b3d71 already in progress: creating tablet
I20260810 13:54:12.284694 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3e50e523354dd7898ff1768ae824bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.285421 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78e70ef9f0b642ab92d866cac1263cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.113087 13022 rpcz_store.cc:276] 0810 13:54:10.849872 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.851667 (+ 1795us) service_pool.cc:224] Handling call
0810 13:54:10.872753 (+ 21086us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:10.873003 (+ 250us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:11.364574 (+491571us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:11.880103 (+515529us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:11.880480 (+ 377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:12.291813 13014 tablet_service.cc:1558] Processing DeleteTablet for tablet 995d901d22484799bd79fcad8103b8a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:11 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:12.294718 15938 raft_consensus.cc:493] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:12.297227 15931 raft_consensus.cc:515] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.299875 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 531) took 2755 ms. Trace:
I20260810 13:54:12.300271 15321 rpcz_store.cc:276] 0810 13:54:09.544875 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:09.577036 (+ 32161us) service_pool.cc:224] Handling call
0810 13:54:12.108925 (+2531889us) ts_tablet_manager.cc:1151] Deleting tablet fd22f04344954142922942fc4b7cb157
0810 13:54:12.299468 (+190543us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.299778 (+ 310us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2531172}
I20260810 13:54:12.301411 15321 tablet_replica.cc:333] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:12.302294 15321 raft_consensus.cc:2243] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:12.302898 15321 pending_rounds.cc:70] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:54:12.303200 13638 tablet_bootstrap.cc:492] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:12.303125 15321 pending_rounds.cc:77] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971725385261056 op_type: NO_OP noop_request { }
I20260810 13:54:12.303454 15321 raft_consensus.cc:2889] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:12.303563 13638 ts_tablet_manager.cc:1403] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.768s user 0.005s sys 0.009s
I20260810 13:54:12.303751 15321 raft_consensus.cc:2272] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:12.306006 15321 ts_tablet_manager.cc:1916] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:12.307404 13638 raft_consensus.cc:359] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.308079 13638 raft_consensus.cc:385] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:12.308333 13638 raft_consensus.cc:740] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:54:12.309491 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet fd22f04344954142922942fc4b7cb157 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd22f04344954142922942fc4b7cb157 already in progress: creating tablet
I20260810 13:54:12.318282 13638 consensus_queue.cc:260] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.319463 15931 leader_election.cc:290] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:12.320326 15931 raft_consensus.cc:493] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:12.321070 15931 raft_consensus.cc:515] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.324127 15321 ts_tablet_manager.cc:1929] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:12.324486 15321 log.cc:1199] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/39ff3a48af494009bb53ee8d4e2a08cd
I20260810 13:54:12.325186 15321 ts_tablet_manager.cc:1950] T 39ff3a48af494009bb53ee8d4e2a08cd P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:12.329504 13638 ts_tablet_manager.cc:1434] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.026s user 0.000s sys 0.008s
I20260810 13:54:12.331197 15931 leader_election.cc:290] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:12.333055 13638 tablet_bootstrap.cc:492] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:12.335489 13168 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:12.340056 13638 tablet_bootstrap.cc:654] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:12.346863 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 535) took 2340 ms. Trace:
I20260810 13:54:12.347296 15321 rpcz_store.cc:276] 0810 13:54:10.006736 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.006867 (+ 131us) service_pool.cc:224] Handling call
0810 13:54:12.301252 (+2294385us) ts_tablet_manager.cc:1151] Deleting tablet 39ff3a48af494009bb53ee8d4e2a08cd
0810 13:54:12.301288 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.315929 (+ 14641us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.324008 (+ 8079us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.346803 (+ 22795us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2293803}
I20260810 13:54:12.348632 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 39ff3a48af494009bb53ee8d4e2a08cd (table default.Table_71513d2e5b514e3689dd3832681e181c [id=10d47f8e5d674a1585588be79dbef00b]) successfully deleted
I20260810 13:54:12.359745 15321 tablet_replica.cc:333] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:12.363003 13638 tablet_bootstrap.cc:492] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:12.363422 13638 ts_tablet_manager.cc:1403] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.009s
I20260810 13:54:12.365880 13638 raft_consensus.cc:359] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.366460 13638 raft_consensus.cc:385] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:12.366703 13638 raft_consensus.cc:740] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:12.367245 13638 consensus_queue.cc:260] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.402830 13638 ts_tablet_manager.cc:1434] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.039s user 0.005s sys 0.001s
I20260810 13:54:12.406845 12746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_ff3b2726de9046d7878cc76ea94ecb90" } new_table_name: "default.Table_03c25c1a5c044fe7b7f9fe7275551c5c" modify_external_catalogs: true
I20260810 13:54:12.409729 12750 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48758:
name: "default.Table_d5c509cabbb84883a9a911c2f4e04c88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 13:54:12.411414 12750 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5c509cabbb84883a9a911c2f4e04c88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 13:54:12.419523 12739 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_50a288b03da74905ac5286346bd7df20" } modify_external_catalogs: true
I20260810 13:54:12.445389 12739 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48758:
table { table_name: "default.Table_50a288b03da74905ac5286346bd7df20" } modify_external_catalogs: true
I20260810 13:54:12.454283 15953 raft_consensus.cc:493] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:12.457844 15953 raft_consensus.cc:515] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:12.464730 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 204196us
I20260810 13:54:12.504474 13022 tablet_service.cc:1511] Processing CreateTablet for tablet df3031d8f75d4548b458cee6dd2083d2 (DEFAULT_TABLE table=default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.505887 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3031d8f75d4548b458cee6dd2083d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.351137 13121 heartbeater.cc:461] Registering TS with master...
I20260810 13:54:12.518631 13638 tablet_bootstrap.cc:492] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:12.533224 13638 tablet_bootstrap.cc:654] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:12.551379 12432 master-stress-test.cc:579] Killing test thread 1/10
I20260810 13:54:12.554490 13638 tablet_bootstrap.cc:492] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:12.556876 12432 master-stress-test.cc:581] Killed test thread 1/10
I20260810 13:54:12.557122 12432 master-stress-test.cc:579] Killing test thread 2/10
I20260810 13:54:12.564850 13638 ts_tablet_manager.cc:1403] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.046s user 0.010s sys 0.001s
I20260810 13:54:12.567412 13638 raft_consensus.cc:359] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.568094 13638 raft_consensus.cc:385] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:12.568359 13638 raft_consensus.cc:740] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:12.569020 13638 consensus_queue.cc:260] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.570592 13638 ts_tablet_manager.cc:1434] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260810 13:54:12.588676 13638 tablet_bootstrap.cc:492] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:12.295274 15938 raft_consensus.cc:515] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:12.604867 13639 raft_consensus.cc:359] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.605628 13639 raft_consensus.cc:385] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:12.605908 13639 raft_consensus.cc:740] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:12.614831 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 8d647bf5c1ba42f48186661310065448 (table default.Table_4a0d9399ab4c468fab4289955631b20f [id=9ec5220333d6496b83c73d11150e444c], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8d647bf5c1ba42f48186661310065448 consensus state has no leader
I20260810 13:54:12.591987 13040 raft_consensus.cc:2393] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:12.603891 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd68cdc1322448292c481925ad33c79 (DEFAULT_TABLE table=default.Table_278ad8ed658b48d28fcc3aa3eec747b0 [id=d585e61cb61a4312ba2dbadbcae39899]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.626720 13639 consensus_queue.cc:260] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.634488 13638 tablet_bootstrap.cc:654] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:12.635044 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 058562eef38d46a8a3a39e3ce5425dd6 (DEFAULT_TABLE table=default.Table_9d81870e910444848f2c714a1b9da18c [id=e506f8a07858485398058c93c553f904]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.640215 15938 leader_election.cc:290] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:12.656916 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd68cdc1322448292c481925ad33c79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.663290 13007 tablet_service.cc:1558] Processing DeleteTablet for tablet de012d382b194bf193fef76779abcf17 with delete_type TABLET_DATA_DELETED (replaced by tablet 19fe94b1d72b4bb29f0154f58c9fa43f) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:12.672626 13019 tablet_service.cc:1558] Processing DeleteTablet for tablet 3610bc4f8a0742fdb69347b40a04f078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:11 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:12.674865 13009 tablet_service.cc:1511] Processing CreateTablet for tablet d5cb099133c04a07956581f23378ddf4 (DEFAULT_TABLE table=default.Table_4b93246ea61e418db4efb3c2732711af [id=847e7c0039964b3f94192d5032791e4a]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:12.680081 13167 leader_election.cc:343] T 32721630ac494c07b015c02f4741cad8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 32721630ac494c07b015c02f4741cad8
I20260810 13:54:12.682157 13167 leader_election.cc:304] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:12.684264 15785 raft_consensus.cc:3060] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:12.696230 15785 raft_consensus.cc:2749] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:12.676224 13639 ts_tablet_manager.cc:1434] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.635s user 0.002s sys 0.004s
W20260810 13:54:12.705531 13639 ts_tablet_manager.cc:1467] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Tablet startup took 664ms
W20260810 13:54:12.705847 13639 ts_tablet_manager.cc:1469] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Trace:
0810 13:53:40.230996 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:40.231125 (+ 129us) service_pool.cc:224] Handling call
0810 13:53:40.232291 (+ 1166us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:40.232383 (+ 92us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:40.352053 (+119670us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:40.421846 (+ 69793us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:40.461361 (+ 39515us) inbound_call.cc:177] Queueing success response
0810 13:54:11.621433 (+31160072us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:54:12.041269 (+419836us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:54:12.599104 (+557835us) tablet_replica.cc:261] Starting instrumentation
0810 13:54:12.599584 (+ 480us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":8878,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":175,"tablet-open.queue_time_us":31160185}
W20260810 13:54:12.710502 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 209110us
I20260810 13:54:12.716768 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:12.720142 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet b820c99b33264add8df5fd443981d0cc (table default.Table_b48c394590b6458487d9402067fc9889 [id=8169bbe19c43404bb723ba96fce6d27b]) successfully deleted
I20260810 13:54:12.729763 13003 tablet_service.cc:1511] Processing CreateTablet for tablet ceba68b27a63430fad93a30c452fb1a3 (DEFAULT_TABLE table=default.Table_772227d6702d4cf7bf6729e922d3eea5 [id=6ffcaf4f90f14e24b6d02b21e2936bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.734270 13167 leader_election.cc:304] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:12.737027 15785 raft_consensus.cc:2749] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:12.624162 13004 tablet_service.cc:1511] Processing CreateTablet for tablet a75054766c894d78bfa6d7f565700dce (DEFAULT_TABLE table=default.Table_83164f9e96c540f58a5af47229b70854 [id=3f7f1db8228e4efa9b34bc33cb13be40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.742744 15935 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:12.743448 15935 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.743754 15785 raft_consensus.cc:493] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:12.744484 15785 raft_consensus.cc:515] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.746383 15935 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:12.750849 15785 leader_election.cc:290] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:12.751214 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:12.753515 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac9e3d3430044a5e85e2d812b7e221f5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:12.760802 13639 tablet_bootstrap.cc:492] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:12.780354 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5cb099133c04a07956581f23378ddf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.782131 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 058562eef38d46a8a3a39e3ce5425dd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.784409 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75054766c894d78bfa6d7f565700dce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.787778 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceba68b27a63430fad93a30c452fb1a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.789927 13008 tablet_service.cc:1511] Processing CreateTablet for tablet bfc9c907fe50470ca860728883fb6d9e (DEFAULT_TABLE table=default.Table_c4942145f1414e939000a9b7443c0d29 [id=b88902dec1e34475b3ae470c1c17f777]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:12.794094 12745 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 9334ba72cfd94fa4a7062a29445c69f9 (table default.Table_276835c42e5a48309351dd4e441cc62f [id=4d5771db00ae42b9957c6453d83f81ae]). Expected version 1 got 0
I20260810 13:54:12.798614 15348 ts_tablet_manager.cc:1929] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 13:54:12.806419 12952 consensus_peers.cc:597] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:12.806989 12952 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:12.823786 15348 log.cc:1199] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/cb8aea1057f445a9b060d138952324ca
I20260810 13:54:12.824975 15348 ts_tablet_manager.cc:1950] T cb8aea1057f445a9b060d138952324ca P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:12.833957 15938 raft_consensus.cc:493] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:12.837405 15938 raft_consensus.cc:515] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.838747 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:12.840939 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb30ebe9520d4224bdfd45a5e915d8bd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:12.848939 15321 raft_consensus.cc:2243] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:12.849635 15321 raft_consensus.cc:2272] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:12.854279 15321 ts_tablet_manager.cc:1916] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:12.865747 13423 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 589) took 1005 ms. Trace:
I20260810 13:54:12.866112 13423 rpcz_store.cc:276] 0810 13:54:11.860182 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.903169 (+ 42987us) service_pool.cc:224] Handling call
0810 13:54:12.125699 (+222530us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:12.125796 (+ 97us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:12.135484 (+ 9688us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.861541 (+726057us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:12.865683 (+ 4142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:12.867189 13427 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43224 (request call id 583) took 1022 ms. Trace:
I20260810 13:54:12.867735 13427 rpcz_store.cc:276] 0810 13:54:11.844473 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.854232 (+ 9759us) service_pool.cc:224] Handling call
0810 13:54:11.928751 (+ 74519us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:11.928853 (+ 102us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:11.995001 (+ 66148us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.323438 (+328437us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:12.865142 (+541704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:12.869076 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 471) took 9797 ms. Trace:
I20260810 13:54:12.869249 15953 leader_election.cc:290] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:12.869443 15348 rpcz_store.cc:276] 0810 13:54:03.071920 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.096666 (+ 24746us) service_pool.cc:224] Handling call
0810 13:54:11.350517 (+8253851us) ts_tablet_manager.cc:1151] Deleting tablet cb8aea1057f445a9b060d138952324ca
0810 13:54:11.350596 (+ 79us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.274577 (+923981us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.798491 (+523914us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.869009 (+ 70518us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8253167}
I20260810 13:54:12.870751 15348 tablet_replica.cc:333] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:12.871248 15953 raft_consensus.cc:493] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:12.871556 15348 raft_consensus.cc:2243] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:12.872057 15348 raft_consensus.cc:2272] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:12.871858 15953 raft_consensus.cc:515] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.874028 15947 raft_consensus.cc:493] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:12.874540 15947 raft_consensus.cc:515] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:12.876223 15953 leader_election.cc:290] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:12.882370 15321 ts_tablet_manager.cc:1929] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:12.882813 15321 log.cc:1199] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/8fa729726a7f4603b0f5085a56cf89f6
I20260810 13:54:12.883682 15321 ts_tablet_manager.cc:1950] T 8fa729726a7f4603b0f5085a56cf89f6 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:12.897265 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 537) took 2879 ms. Trace:
I20260810 13:54:12.897603 15321 rpcz_store.cc:276] 0810 13:54:10.017597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.017694 (+ 97us) service_pool.cc:224] Handling call
0810 13:54:12.349458 (+2331764us) ts_tablet_manager.cc:1151] Deleting tablet 8fa729726a7f4603b0f5085a56cf89f6
0810 13:54:12.359585 (+ 10127us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.866392 (+506807us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.882219 (+ 15827us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.897198 (+ 14979us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":488060,"tablet-delete.queue_time_us":2331177}
I20260810 13:54:12.898883 15321 tablet_replica.cc:333] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:12.899742 15321 raft_consensus.cc:2243] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:12.900230 15321 raft_consensus.cc:2272] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:12.902320 15321 ts_tablet_manager.cc:1916] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:12.876652 15947 leader_election.cc:290] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:12.883822 15953 raft_consensus.cc:493] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:12.890509 15348 ts_tablet_manager.cc:1916] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:12.903406 15953 raft_consensus.cc:515] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:12.907245 15953 leader_election.cc:290] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:12.902144 13640 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.894s user 0.004s sys 0.003s
W20260810 13:54:12.908134 13640 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.900s user 0.004s sys 0.003s
I20260810 13:54:12.910306 13640 tablet_bootstrap.cc:492] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:12.910687 13640 ts_tablet_manager.cc:1403] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 1.007s user 0.010s sys 0.005s
I20260810 13:54:12.921164 13640 raft_consensus.cc:359] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:12.921849 13382 leader_election.cc:343] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: a83ddc3ea3e74b569385b289fe8cf469
I20260810 13:54:12.922153 13640 raft_consensus.cc:385] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:12.922466 13640 raft_consensus.cc:740] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:12.922528 13382 leader_election.cc:304] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:12.923485 13382 raft_consensus.cc:2686] T a83ddc3ea3e74b569385b289fe8cf469 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:54:12.928012 15882 catalog_manager.cc:1295] Loaded cluster ID: 13e3d414686543de8210a2d9c5898299
I20260810 13:54:12.928464 15882 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: loading cluster ID for follower catalog manager: success
W20260810 13:54:12.929047 13382 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:12.929601 13382 leader_election.cc:304] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:12.935685 15953 raft_consensus.cc:2749] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:12.923354 13640 consensus_queue.cc:260] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.938774 13640 ts_tablet_manager.cc:1434] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.028s user 0.006s sys 0.001s
W20260810 13:54:12.949909 13382 leader_election.cc:343] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:12.953673 13640 tablet_bootstrap.cc:492] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:12.963882 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb30ebe9520d4224bdfd45a5e915d8bd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:12.960184 15321 ts_tablet_manager.cc:1929] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:12.965472 15321 log.cc:1199] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/b820c99b33264add8df5fd443981d0cc
I20260810 13:54:12.965013 13468 raft_consensus.cc:2468] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:12.966233 15321 ts_tablet_manager.cc:1950] T b820c99b33264add8df5fd443981d0cc P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:12.969089 13638 tablet_bootstrap.cc:492] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:12.969635 13638 ts_tablet_manager.cc:1403] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.381s user 0.027s sys 0.041s
I20260810 13:54:12.972927 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 536) took 2955 ms. Trace:
I20260810 13:54:12.973284 15321 rpcz_store.cc:276] 0810 13:54:10.017322 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.017778 (+ 456us) service_pool.cc:224] Handling call
0810 13:54:12.898717 (+2880939us) ts_tablet_manager.cc:1151] Deleting tablet b820c99b33264add8df5fd443981d0cc
0810 13:54:12.898761 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.915221 (+ 16460us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.960038 (+ 44817us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.972866 (+ 12828us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2880166}
I20260810 13:54:12.974313 13638 raft_consensus.cc:359] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.974677 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 538) took 2954 ms. Trace:
I20260810 13:54:12.974944 13638 raft_consensus.cc:385] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:12.975244 13638 raft_consensus.cc:740] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:12.974972 15321 rpcz_store.cc:276] 0810 13:54:10.020098 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.020202 (+ 104us) service_pool.cc:224] Handling call
0810 13:54:12.974336 (+2954134us) ts_tablet_manager.cc:1151] Deleting tablet 350b68f6c1cf48ff8e5f8521e5a4dad6
0810 13:54:12.974391 (+ 55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.974630 (+ 239us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2953652}
I20260810 13:54:12.976131 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 539) took 2923 ms. Trace:
I20260810 13:54:12.975895 13638 consensus_queue.cc:260] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:12.976220 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:12.977632 13468 raft_consensus.cc:2393] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:12.981060 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba05f4940220459f951adf3491f60b93" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:12.982350 13470 raft_consensus.cc:2393] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:12.983779 15953 raft_consensus.cc:493] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:12.984759 15953 raft_consensus.cc:515] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:12.987684 15953 leader_election.cc:290] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:12.997119 13638 ts_tablet_manager.cc:1434] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20260810 13:54:12.895538 15702 ts_tablet_manager.cc:1929] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:12.997974 15702 log.cc:1199] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/64e93928dcb94ae296590c4dedfd1781
I20260810 13:54:12.998183 13638 tablet_bootstrap.cc:492] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:12.998687 15702 ts_tablet_manager.cc:1950] T 64e93928dcb94ae296590c4dedfd1781 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:12.857273 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc9c907fe50470ca860728883fb6d9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:12.948640 13018 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 555) took 1072 ms. Trace:
I20260810 13:54:13.001432 13018 rpcz_store.cc:276] 0810 13:54:11.876042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.876808 (+ 766us) service_pool.cc:224] Handling call
0810 13:54:12.060745 (+183937us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:12.060858 (+ 113us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:12.326954 (+266096us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.499107 (+172153us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:12.948577 (+449470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:12.948959 13011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 548) took 1076 ms. Trace:
W20260810 13:54:12.946313 12999 consensus_meta.cc:287] T 78e70ef9f0b642ab92d866cac1263cf8 P 88ed04d733ec447583fc897e233dd4b3: Time spent flushing consensus metadata: real 0.581s user 0.007s sys 0.000s
I20260810 13:54:13.002970 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:13.010584 13382 leader_election.cc:304] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:13.025521 15956 raft_consensus.cc:2749] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260810 13:54:13.028244 13382 leader_election.cc:343] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:13.030230 13382 leader_election.cc:304] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:13.002462 13011 rpcz_store.cc:276] 0810 13:54:11.872864 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.876161 (+ 3297us) service_pool.cc:224] Handling call
0810 13:54:12.113986 (+237825us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:12.114075 (+ 89us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:12.612615 (+498540us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.805888 (+193273us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:12.948898 (+143010us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:13.041280 13640 tablet_bootstrap.cc:654] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:13.044390 12740 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet 613d7ddce24b45c886139bf68c3c9a4d
I20260810 13:54:13.044543 15956 raft_consensus.cc:2749] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:13.056351 12432 master-stress-test.cc:581] Killed test thread 2/10
I20260810 13:54:13.056638 12432 master-stress-test.cc:579] Killing test thread 3/10
I20260810 13:54:13.081377 12999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 549) took 1208 ms. Trace:
I20260810 13:54:13.085248 12432 master-stress-test.cc:581] Killed test thread 3/10
I20260810 13:54:13.085541 12432 master-stress-test.cc:579] Killing test thread 4/10
W20260810 13:54:13.095646 12746 catalog_manager.cc:5979] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 83239e6cbf1c431fb2fb2a2dae105d61 has no consensus state
I20260810 13:54:13.102324 12744 catalog_manager.cc:6264] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: default.Table_276835c42e5a48309351dd4e441cc62f [id=4d5771db00ae42b9957c6453d83f81ae] alter complete (version 1)
I20260810 13:54:13.082343 12999 rpcz_store.cc:276] 0810 13:54:11.873244 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.900778 (+ 27534us) service_pool.cc:224] Handling call
0810 13:54:12.114647 (+213869us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:12.114723 (+ 76us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:12.332078 (+217355us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.080865 (+748787us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:13.081311 (+ 446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30589}
I20260810 13:54:12.841647 13041 raft_consensus.cc:3060] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:13.112452 12998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50548 (request call id 550) took 1239 ms. Trace:
I20260810 13:54:13.112805 12998 rpcz_store.cc:276] 0810 13:54:11.873504 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.873611 (+ 107us) service_pool.cc:224] Handling call
0810 13:54:12.042841 (+169230us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:12.042926 (+ 85us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:12.776890 (+733964us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.069796 (+292906us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:13.112396 (+ 42600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1986}
I20260810 13:54:13.114068 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 507) took 4346 ms. Trace:
I20260810 13:54:13.114403 15702 rpcz_store.cc:276] 0810 13:54:08.764501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:08.764607 (+ 106us) service_pool.cc:224] Handling call
0810 13:54:11.641949 (+2877342us) ts_tablet_manager.cc:1151] Deleting tablet 64e93928dcb94ae296590c4dedfd1781
0810 13:54:11.642010 (+ 61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.786764 (+1144754us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:12.895390 (+108626us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.110452 (+215062us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191483,"tablet-delete.queue_time_us":2876808}
W20260810 13:54:13.109808 15930 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.484s user 0.016s sys 0.029s
I20260810 13:54:12.842489 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:12.841629 15938 leader_election.cc:290] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.124513 15181 ts_manager.cc:194] Registered new tserver with Master: 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:13.125496 15216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51102 (request call id 0) took 13313 ms. Trace:
I20260810 13:54:13.132881 13040 raft_consensus.cc:2468] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:13.133970 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet cb8aea1057f445a9b060d138952324ca (table default.Table_d447b3e1ee6a423dbe29ddad01c780b8 [id=bd6753e3ed074939b250f9fa448e47ba]) successfully deleted
I20260810 13:54:13.145615 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 515) took 4100 ms. Trace:
I20260810 13:54:13.145970 15702 rpcz_store.cc:276] 0810 13:54:09.045270 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:09.045375 (+ 105us) service_pool.cc:224] Handling call
0810 13:54:13.123560 (+4078185us) ts_tablet_manager.cc:1151] Deleting tablet 247fb8b09c12407d8535c07c5d0687fe
0810 13:54:13.145222 (+ 21662us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.145548 (+ 326us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4069565}
I20260810 13:54:13.146591 13639 tablet_bootstrap.cc:654] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:13.150416 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 64e93928dcb94ae296590c4dedfd1781 (table default.Table_fbe0f651fe2e4328b7e2a126d989afab [id=da2f9e6861694d889e45f1fc34a63469]) successfully deleted
I20260810 13:54:13.165162 12749 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:48758 (request call id 723) took 1063 ms. Trace:
I20260810 13:54:13.169198 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 518) took 4121 ms. Trace:
I20260810 13:54:13.169613 15702 rpcz_store.cc:276] 0810 13:54:09.047509 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:09.047976 (+ 467us) service_pool.cc:224] Handling call
0810 13:54:13.146899 (+4098923us) ts_tablet_manager.cc:1151] Deleting tablet 11e3902adc094227830cf6ddab916916
0810 13:54:13.153199 (+ 6300us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.169123 (+ 15924us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4098419}
I20260810 13:54:13.170753 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:13.172051 13041 raft_consensus.cc:2468] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:13.165505 12749 rpcz_store.cc:276] 0810 13:54:12.101423 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:12.185577 (+ 84154us) service_pool.cc:224] Handling call
0810 13:54:12.244863 (+ 59286us) catalog_manager.cc:2127] Acquired catalog manager lock
0810 13:54:12.246743 (+ 1880us) catalog_manager.cc:2173] Created new table and tablet info
0810 13:54:13.164497 (+917754us) catalog_manager.cc:2233] Wrote table and tablets to system table
0810 13:54:13.164837 (+ 340us) catalog_manager.cc:2267] Inserted table and tablets into CatalogManager maps
0810 13:54:13.165099 (+ 262us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:13.055425 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:13.129439 (+ 74014us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:13.129466 (+ 27us) write_op.cc:435] Acquired schema lock
0810 13:54:13.129481 (+ 15us) tablet.cc:662] Decoding operations
0810 13:54:13.129759 (+ 278us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:13.129797 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:13.129820 (+ 23us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:13.130016 (+ 196us) tablet.cc:701] Row locks acquired
0810 13:54:13.130029 (+ 13us) write_op.cc:260] PREPARE: finished
0810 13:54:13.130137 (+ 108us) write_op.cc:270] Start()
0810 13:54:13.130218 (+ 81us) write_op.cc:276] Timestamp: P: 1786370053130045 usec, L: 0
0810 13:54:13.130232 (+ 14us) op_driver.cc:348] REPLICATION: starting
0810 13:54:13.130726 (+ 494us) log.cc:844] Serialized 433 byte log entry
0810 13:54:13.161152 (+ 30426us) op_driver.cc:464] REPLICATION: finished
0810 13:54:13.162961 (+ 1809us) write_op.cc:301] APPLY: starting
0810 13:54:13.163014 (+ 53us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:13.163114 (+ 100us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:13.163219 (+ 105us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:13.163647 (+ 428us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:13.163803 (+ 156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0810 13:54:13.163844 (+ 41us) write_op.cc:312] APPLY: finished
0810 13:54:13.164027 (+ 183us) log.cc:844] Serialized 29 byte log entry
0810 13:54:13.164171 (+ 144us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:13.164258 (+ 87us) write_op.cc:454] Released schema lock
0810 13:54:13.164288 (+ 30us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1615,"num_ops":2,"prepare.queue_time_us":504893,"raft.queue_time_us":327,"raft.run_cpu_time_us":798,"raft.run_wall_time_us":2687,"replication_time_us":30815}]]}
I20260810 13:54:13.174491 12432 master-stress-test.cc:581] Killed test thread 4/10
I20260810 13:54:13.174736 12432 master-stress-test.cc:579] Killing test thread 5/10
I20260810 13:54:13.175004 12432 master-stress-test.cc:581] Killed test thread 5/10
I20260810 13:54:13.175261 12432 master-stress-test.cc:579] Killing test thread 6/10
I20260810 13:54:13.175544 12432 master-stress-test.cc:581] Killed test thread 6/10
I20260810 13:54:13.175724 12432 master-stress-test.cc:579] Killing test thread 7/10
I20260810 13:54:13.176252 12432 master-stress-test.cc:581] Killed test thread 7/10
I20260810 13:54:13.176471 12432 master-stress-test.cc:579] Killing test thread 8/10
I20260810 13:54:13.178345 13021 tablet_service.cc:1558] Processing DeleteTablet for tablet b820c99b33264add8df5fd443981d0cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:46 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:13.178164 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 613d7ddce24b45c886139bf68c3c9a4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:12 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:13.178828 13004 tablet_service.cc:1558] Processing DeleteTablet for tablet ba05f4940220459f951adf3491f60b93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:13.161118 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:13.179374 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 247fb8b09c12407d8535c07c5d0687fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 247fb8b09c12407d8535c07c5d0687fe already in progress: creating tablet
I20260810 13:54:13.183252 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 526) took 2398 ms. Trace:
I20260810 13:54:13.183568 15702 rpcz_store.cc:276] 0810 13:54:10.784445 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.786471 (+ 2026us) service_pool.cc:224] Handling call
0810 13:54:13.170585 (+2384114us) ts_tablet_manager.cc:1151] Deleting tablet fd22f04344954142922942fc4b7cb157
0810 13:54:13.182974 (+ 12389us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.183198 (+ 224us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2383011}
I20260810 13:54:13.184500 15702 tablet_replica.cc:333] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
W20260810 13:54:13.187860 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.059s user 0.002s sys 0.001s
I20260810 13:54:13.194274 15953 raft_consensus.cc:493] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:13.194731 15953 raft_consensus.cc:515] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.196470 15953 leader_election.cc:290] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:13.197705 15348 ts_tablet_manager.cc:1929] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:13.198135 15348 log.cc:1199] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/00a7bce2378f482d81d2ad08e9d15b0c
I20260810 13:54:13.198848 15348 ts_tablet_manager.cc:1950] T 00a7bce2378f482d81d2ad08e9d15b0c P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:13.200901 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 483) took 9571 ms. Trace:
W20260810 13:54:13.202104 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 11e3902adc094227830cf6ddab916916 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11e3902adc094227830cf6ddab916916 already in progress: creating tablet
I20260810 13:54:13.203547 15702 raft_consensus.cc:2243] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:13.180922 15938 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:13.216842 15702 raft_consensus.cc:2272] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:13.218279 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 53022.7us
I20260810 13:54:13.224785 15348 rpcz_store.cc:276] 0810 13:54:03.629675 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.629805 (+ 130us) service_pool.cc:224] Handling call
0810 13:54:12.870557 (+9240752us) ts_tablet_manager.cc:1151] Deleting tablet 00a7bce2378f482d81d2ad08e9d15b0c
0810 13:54:12.870627 (+ 70us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.014476 (+143849us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.197570 (+183094us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.200847 (+ 3277us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9240230}
I20260810 13:54:13.225751 13640 tablet_bootstrap.cc:492] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:13.226238 15348 tablet_replica.cc:333] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:13.227213 15348 raft_consensus.cc:2243] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:13.227458 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:13.226277 13640 ts_tablet_manager.cc:1403] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.273s user 0.015s sys 0.007s
I20260810 13:54:13.228034 13470 raft_consensus.cc:2468] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:13.230734 13640 raft_consensus.cc:359] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.231467 13640 raft_consensus.cc:385] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:13.232625 15935 consensus_queue.cc:1048] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:13.233801 15702 ts_tablet_manager.cc:1916] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:13.219627 15938 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.239737 15938 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.242569 15930 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:50548 (request call id 539) took 2391 ms. Trace:
I20260810 13:54:13.254631 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 8fa729726a7f4603b0f5085a56cf89f6 (table default.Table_e383a6bbbf2247478200482d22a378e3 [id=223e495b001c43a8b728880aafcdb751]) successfully deleted
I20260810 13:54:13.255432 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet b820c99b33264add8df5fd443981d0cc (table default.Table_b48c394590b6458487d9402067fc9889 [id=8169bbe19c43404bb723ba96fce6d27b]) successfully deleted
W20260810 13:54:13.256170 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 already in progress: creating tablet
I20260810 13:54:13.258494 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet 613d7ddce24b45c886139bf68c3c9a4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:12 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:13.261404 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.069s user 0.004s sys 0.000s
I20260810 13:54:13.243007 15930 rpcz_store.cc:276] 0810 13:54:10.850758 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.892288 (+ 41530us) service_pool.cc:224] Handling call
0810 13:54:13.242440 (+2350152us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:10.894031 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:10.894775 (+ 744us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:10.894856 (+ 81us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:10.907157 (+ 12301us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:10.907305 (+ 148us) alter_schema_op.cc:128] START. Timestamp: 1786370050906627
0810 13:54:10.907324 (+ 19us) op_driver.cc:348] REPLICATION: starting
0810 13:54:10.907920 (+ 596us) log.cc:844] Serialized 173 byte log entry
0810 13:54:11.654230 (+746310us) op_driver.cc:464] REPLICATION: finished
0810 13:54:11.806103 (+151873us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:12.633538 (+827435us) log.cc:844] Serialized 5 byte log entry
0810 13:54:13.241180 (+607642us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.242098 (+ 918us) log.cc:844] Serialized 14 byte log entry
0810 13:54:13.242223 (+ 125us) alter_schema_op.cc:73] Released schema lock
0810 13:54:13.242275 (+ 52us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":151548,"prepare.queue_time_us":171,"prepare.run_cpu_time_us":11870,"prepare.run_wall_time_us":198142,"raft.queue_time_us":20778,"raft.run_cpu_time_us":1842,"raft.run_wall_time_us":1843,"replication_time_us":746788,"thread_start_us":815926,"threads_started":3,"wal-append.queue_time_us":597863,"wal-append.run_cpu_time_us":1686,"wal-append.run_wall_time_us":1209162}]]}
W20260810 13:54:13.283838 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 74228.2us
I20260810 13:54:13.287781 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.284487 12951 leader_election.cc:304] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:13.290438 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.292258 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.293280 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.293025 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.296052 13261 raft_consensus.cc:2468] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:13.298704 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.299373 13265 raft_consensus.cc:2468] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:13.300657 12952 leader_election.cc:304] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:13.302817 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.237015 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb30ebe9520d4224bdfd45a5e915d8bd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:13.310105 13470 raft_consensus.cc:3060] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:13.237937 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:13.245110 15953 raft_consensus.cc:493] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:13.313341 15953 raft_consensus.cc:515] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.315647 15953 leader_election.cc:290] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:13.304219 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:13.316416 13475 raft_consensus.cc:2468] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:13.318523 13427 tablet_service.cc:1558] Processing DeleteTablet for tablet 3610bc4f8a0742fdb69347b40a04f078 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:11 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:13.299160 15985 raft_consensus.cc:493] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:13.319617 15938 raft_consensus.cc:2804] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:13.319976 15938 raft_consensus.cc:493] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:13.320122 13639 tablet_bootstrap.cc:492] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:13.320276 15938 raft_consensus.cc:3060] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:13.320659 13639 ts_tablet_manager.cc:1403] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.560s user 0.009s sys 0.007s
I20260810 13:54:13.319818 15985 raft_consensus.cc:515] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.323483 13639 raft_consensus.cc:359] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.324123 13639 raft_consensus.cc:385] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:13.324456 13639 raft_consensus.cc:740] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:13.328493 13470 raft_consensus.cc:2468] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:13.227766 15348 raft_consensus.cc:2272] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:13.371549 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.107s user 0.003s sys 0.000s
I20260810 13:54:13.336918 13640 raft_consensus.cc:740] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:13.337421 15702 ts_tablet_manager.cc:1929] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:13.373801 15702 log.cc:1199] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/39ff3a48af494009bb53ee8d4e2a08cd
I20260810 13:54:13.374492 15702 ts_tablet_manager.cc:1950] T 39ff3a48af494009bb53ee8d4e2a08cd P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:13.332010 15938 raft_consensus.cc:515] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.332867 15935 raft_consensus.cc:2764] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:13.384307 13639 consensus_queue.cc:260] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.386410 13639 ts_tablet_manager.cc:1434] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.065s user 0.000s sys 0.005s
I20260810 13:54:13.387300 13639 tablet_bootstrap.cc:492] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:13.333485 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 49088.4us
I20260810 13:54:13.391830 15935 consensus_queue.cc:1048] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:13.397832 15348 ts_tablet_manager.cc:1916] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:12.976430 15321 rpcz_store.cc:276] 0810 13:54:10.052380 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.052952 (+ 572us) service_pool.cc:224] Handling call
0810 13:54:12.975835 (+2922883us) ts_tablet_manager.cc:1151] Deleting tablet 65c3b03d5f1543b28ea6c439c3cfb07e
0810 13:54:12.975872 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:12.976086 (+ 214us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2862670}
W20260810 13:54:13.402431 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 65c3b03d5f1543b28ea6c439c3cfb07e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65c3b03d5f1543b28ea6c439c3cfb07e already in progress: creating tablet
I20260810 13:54:13.406989 13638 tablet_bootstrap.cc:654] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:13.417400 13639 tablet_bootstrap.cc:654] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:13.422828 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:13.423425 13269 raft_consensus.cc:3060] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:13.430056 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 93098us
W20260810 13:54:13.431949 13167 leader_election.cc:343] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:13.412554 12951 leader_election.cc:304] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:13.435964 15935 raft_consensus.cc:2749] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:13.439069 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 525) took 2717 ms. Trace:
I20260810 13:54:13.439613 15702 rpcz_store.cc:276] 0810 13:54:10.721327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.785748 (+ 64421us) service_pool.cc:224] Handling call
0810 13:54:13.184349 (+2398601us) ts_tablet_manager.cc:1151] Deleting tablet 39ff3a48af494009bb53ee8d4e2a08cd
0810 13:54:13.184398 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.245742 (+ 61344us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.337293 (+ 91551us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.438986 (+101693us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":553,"tablet-delete.queue_time_us":2395159}
I20260810 13:54:13.441622 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 530) took 2637 ms. Trace:
I20260810 13:54:13.442046 15702 rpcz_store.cc:276] 0810 13:54:10.804400 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.804850 (+ 450us) service_pool.cc:224] Handling call
0810 13:54:13.440911 (+2636061us) ts_tablet_manager.cc:1151] Deleting tablet 350b68f6c1cf48ff8e5f8521e5a4dad6
0810 13:54:13.441209 (+ 298us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.441557 (+ 348us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2634823}
I20260810 13:54:13.442550 13167 leader_election.cc:304] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:13.443459 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.070s user 0.001s sys 0.000s
I20260810 13:54:13.449438 15994 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:54:13.450559 15994 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:13.454406 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 531) took 2649 ms. Trace:
I20260810 13:54:13.455241 15321 tablet_replica.cc:333] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:13.455977 13269 raft_consensus.cc:2468] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:13.457608 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 613d7ddce24b45c886139bf68c3c9a4d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:12 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:13.459648 12513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 556 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:13.460654 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 00a7bce2378f482d81d2ad08e9d15b0c (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]) successfully deleted
I20260810 13:54:13.467799 15994 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:13.469062 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 556 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:54:13.471232 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:13.483549 15994 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:13.495349 15882 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: acquiring CA information for follower catalog manager: success
I20260810 13:54:13.477392 13640 consensus_queue.cc:260] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:13.528194 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.060s user 0.002s sys 0.000s
I20260810 13:54:13.533993 13640 ts_tablet_manager.cc:1434] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.306s user 0.000s sys 0.005s
I20260810 13:54:13.542217 13640 tablet_bootstrap.cc:492] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:13.559417 15702 rpcz_store.cc:276] 0810 13:54:10.805055 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.805525 (+ 470us) service_pool.cc:224] Handling call
0810 13:54:13.454049 (+2648524us) ts_tablet_manager.cc:1151] Deleting tablet 65c3b03d5f1543b28ea6c439c3cfb07e
0810 13:54:13.454089 (+ 40us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.454341 (+ 252us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2646987}
I20260810 13:54:13.553097 13382 leader_election.cc:304] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:13.458959 15985 leader_election.cc:290] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.492282 15321 raft_consensus.cc:2243] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:13.524361 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.527439 13164 leader_election.cc:304] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:13.570724 15785 raft_consensus.cc:2764] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:13.581223 15953 consensus_queue.cc:1048] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:13.582938 13382 raft_consensus.cc:2686] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:54:13.583590 13382 leader_election.cc:343] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:13.584725 13382 leader_election.cc:343] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 39ff3a48af494009bb53ee8d4e2a08cd
I20260810 13:54:13.586251 15702 tablet_replica.cc:333] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:13.587183 15702 raft_consensus.cc:2243] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:13.588022 15702 raft_consensus.cc:2272] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:13.592927 15321 raft_consensus.cc:2272] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:13.444859 15938 leader_election.cc:290] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.455001 12951 leader_election.cc:304] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:13.594763 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 139830us
I20260810 13:54:13.596824 15938 raft_consensus.cc:2749] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:13.596338 15321 ts_tablet_manager.cc:1916] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:13.597602 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:13.599887 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:13.601372 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:13.601951 13639 tablet_bootstrap.cc:492] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:13.602367 13639 ts_tablet_manager.cc:1403] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.215s user 0.007s sys 0.002s
I20260810 13:54:13.602555 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:13.603331 13049 raft_consensus.cc:2393] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:13.605039 15985 raft_consensus.cc:2804] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:13.605413 15985 raft_consensus.cc:493] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:13.606360 15985 raft_consensus.cc:3060] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:13.611096 13639 raft_consensus.cc:359] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.611765 13639 raft_consensus.cc:385] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:13.611999 13639 raft_consensus.cc:740] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:13.613039 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 85839.3us
I20260810 13:54:13.615123 13167 leader_election.cc:304] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:13.616050 15986 raft_consensus.cc:2804] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
W20260810 13:54:13.616317 13167 leader_election.cc:343] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:13.618247 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet fd22f04344954142922942fc4b7cb157 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd22f04344954142922942fc4b7cb157 already in progress: creating tablet
I20260810 13:54:13.616557 15986 raft_consensus.cc:697] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:13.620121 15986 consensus_queue.cc:237] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.630738 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 39ff3a48af494009bb53ee8d4e2a08cd (table default.Table_71513d2e5b514e3689dd3832681e181c [id=10d47f8e5d674a1585588be79dbef00b]) successfully deleted
I20260810 13:54:13.648905 13164 leader_election.cc:304] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:13.651540 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]). Expected version 1 got 0
I20260810 13:54:13.656728 15946 raft_consensus.cc:2804] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:13.657092 15946 raft_consensus.cc:493] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:13.657605 15946 raft_consensus.cc:3060] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:13.665110 13638 tablet_bootstrap.cc:492] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:13.665810 13638 ts_tablet_manager.cc:1403] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.668s user 0.009s sys 0.006s
I20260810 13:54:13.673264 13638 raft_consensus.cc:359] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.674172 13638 raft_consensus.cc:385] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:13.674604 13638 raft_consensus.cc:740] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:13.675622 13638 consensus_queue.cc:260] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:13.678268 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 92765us
W20260810 13:54:13.693591 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 83239e6cbf1c431fb2fb2a2dae105d61 has no consensus state
I20260810 13:54:13.695426 13638 ts_tablet_manager.cc:1434] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.029s user 0.007s sys 0.001s
I20260810 13:54:13.709995 13638 tablet_bootstrap.cc:492] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:13.717564 13640 tablet_bootstrap.cc:654] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:13.737926 12744 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b449377349514576874b6c295ead5e9a (table default.Table_2695264893564646a621e76ff6443e84 [id=147b038d3de54c8d85e666747153cb7d]). Expected version 2 got 0
W20260810 13:54:13.741993 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.173s user 0.004s sys 0.000s
I20260810 13:54:13.685038 15985 raft_consensus.cc:515] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:13.687191 13164 leader_election.cc:343] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:13.746423 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 59267.1us
I20260810 13:54:13.756920 15985 leader_election.cc:290] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.759727 15785 raft_consensus.cc:493] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:13.760337 15785 raft_consensus.cc:515] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.763103 15785 leader_election.cc:290] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.765955 15986 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:13.766379 12739 catalog_manager.cc:6006] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Sending DeleteTablet for 3 replicas of tablet e828861d499a400c834b848acdb2afc5
I20260810 13:54:13.766817 15985 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:13.767927 12739 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:48758 (request call id 727) took 1496 ms. Trace:
I20260810 13:54:13.768457 15985 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.768239 12739 rpcz_store.cc:276] 0810 13:54:12.271376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:12.271598 (+ 222us) service_pool.cc:224] Handling call
0810 13:54:12.419424 (+147826us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c84d6 00007fec6df80b34 00007fec6df80ac2 00007fec6df809f1 00007fec6df8096c 00007fec6df7fc22 00007fec6c22207c 00007fec6c2214b6
0810 13:54:12.461358 (+ 41934us) catalog_manager.cc:2419] Looking up, locking, and authorizing table
0810 13:54:12.461937 (+ 579us) catalog_manager.cc:2841] Modifying in-memory table state
0810 13:54:12.462122 (+ 185us) catalog_manager.cc:2850] Locking tablets
0810 13:54:12.467451 (+ 5329us) catalog_manager.cc:2864] Removing table and tablets from system table
0810 13:54:13.765944 (+1298493us) catalog_manager.cc:2882] Removing table from by-name map
0810 13:54:13.766178 (+ 234us) catalog_manager.cc:2898] Committing in-memory state
0810 13:54:13.766286 (+ 108us) catalog_manager.cc:2902] Aborting table tasks
0810 13:54:13.767869 (+ 1583us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:13.183034 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0810 13:54:13.183412 (+ 378us) write_op.cc:432] Acquiring schema lock in shared mode
0810 13:54:13.183434 (+ 22us) write_op.cc:435] Acquired schema lock
0810 13:54:13.183447 (+ 13us) tablet.cc:662] Decoding operations
0810 13:54:13.183746 (+ 299us) write_op.cc:620] Acquiring the partition lock for write op
0810 13:54:13.183785 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0810 13:54:13.183811 (+ 26us) tablet.cc:685] Acquiring locks for 2 operations
0810 13:54:13.185637 (+ 1826us) tablet.cc:701] Row locks acquired
0810 13:54:13.185653 (+ 16us) write_op.cc:260] PREPARE: finished
0810 13:54:13.185763 (+ 110us) write_op.cc:270] Start()
0810 13:54:13.185836 (+ 73us) write_op.cc:276] Timestamp: P: 1786370053185667 usec, L: 0
0810 13:54:13.185862 (+ 26us) op_driver.cc:348] REPLICATION: starting
0810 13:54:13.186341 (+ 479us) log.cc:844] Serialized 725 byte log entry
0810 13:54:13.689202 (+502861us) op_driver.cc:464] REPLICATION: finished
0810 13:54:13.762613 (+ 73411us) write_op.cc:301] APPLY: starting
0810 13:54:13.762708 (+ 95us) tablet.cc:1367] starting BulkCheckPresence
0810 13:54:13.762816 (+ 108us) tablet.cc:1370] finished BulkCheckPresence
0810 13:54:13.762926 (+ 110us) tablet.cc:1372] starting ApplyRowOperation cycle
0810 13:54:13.763235 (+ 309us) tablet.cc:1383] finished ApplyRowOperation cycle
0810 13:54:13.763381 (+ 146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0810 13:54:13.763418 (+ 37us) write_op.cc:312] APPLY: finished
0810 13:54:13.763627 (+ 209us) log.cc:844] Serialized 29 byte log entry
0810 13:54:13.764324 (+ 697us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:13.764398 (+ 74us) write_op.cc:454] Released schema lock
0810 13:54:13.764432 (+ 34us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":334103936,"child_traces":[["op",{"apply.queue_time_us":73207,"apply.run_cpu_time_us":1526,"apply.run_wall_time_us":2043,"num_ops":2,"prepare.queue_time_us":388860,"prepare.run_cpu_time_us":2075,"prepare.run_wall_time_us":21746,"replication_time_us":503227,"threads_started":1}]]}
I20260810 13:54:13.773042 12432 master-stress-test.cc:581] Killed test thread 8/10
I20260810 13:54:13.773314 12432 master-stress-test.cc:579] Killing test thread 9/10
I20260810 13:54:13.681892 15946 raft_consensus.cc:515] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.770393 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet e828861d499a400c834b848acdb2afc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:12 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:13.766547 15986 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.786257 15946 leader_election.cc:290] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:13.807716 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 1ee6e694366543328526313d7018b5db (table default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9]) was not created within the allowed timeout. Replacing with a new tablet f45b7a9584e845c190566caae9bb8db1
W20260810 13:54:13.809760 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]) was not created within the allowed timeout. Replacing with a new tablet 7d2a5237ab97417cafb9af9ebeea0b3c
W20260810 13:54:13.812425 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 132927us
W20260810 13:54:13.814476 13382 leader_election.cc:343] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:13.814922 13382 leader_election.cc:304] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:13.815768 15969 raft_consensus.cc:2749] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:13.819561 13640 tablet_bootstrap.cc:492] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:13.820026 13640 ts_tablet_manager.cc:1403] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.278s user 0.006s sys 0.005s
W20260810 13:54:13.820839 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet a4b1451bb8254fcb8c507a837d6b2fa4 (table default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4]) was not created within the allowed timeout. Replacing with a new tablet 2d598ed1697744b29778a94a321392f6
W20260810 13:54:13.822361 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]) was not created within the allowed timeout. Replacing with a new tablet 5fb50ef4ab014c01a88cf3a482240c00
W20260810 13:54:13.823899 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]) was not created within the allowed timeout. Replacing with a new tablet ad814c5669e640d691c09df1a63eecb3
I20260810 13:54:13.824481 13640 raft_consensus.cc:359] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.825264 13640 raft_consensus.cc:385] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:13.825563 13640 raft_consensus.cc:740] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:13.828871 13640 consensus_queue.cc:260] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:13.837342 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.064s user 0.001s sys 0.000s
W20260810 13:54:13.837718 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 350b68f6c1cf48ff8e5f8521e5a4dad6 already in progress: creating tablet
W20260810 13:54:13.838766 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 65c3b03d5f1543b28ea6c439c3cfb07e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65c3b03d5f1543b28ea6c439c3cfb07e already in progress: creating tablet
W20260810 13:54:13.841629 13382 consensus_peers.cc:597] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64e93928dcb94ae296590c4dedfd1781. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:13.839354 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]) was not created within the allowed timeout. Replacing with a new tablet e60a2ced03dd44bda00093e597f87020
W20260810 13:54:13.842991 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet dfbb2036c800469f90ad4d5d211ac462 (table default.Table_2a27c95d054b44dd84ede3639a6395c5 [id=232f082ff5eb446bbb2e7869e83b2449]) was not created within the allowed timeout. Replacing with a new tablet 8c9272d4be1642f79872cdacfba6660b
W20260810 13:54:13.844015 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 094a3448b54c409281c31813e60dcb7f (table default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6]) was not created within the allowed timeout. Replacing with a new tablet 332670842aca4b56bcbf8d90ef1bac48
I20260810 13:54:13.846390 13382 leader_election.cc:304] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:13.851212 15969 raft_consensus.cc:2749] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:13.852375 13382 leader_election.cc:304] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:13.855906 16005 raft_consensus.cc:2749] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:13.704558 12994 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 38) took 1895 ms. Trace:
I20260810 13:54:13.614787 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:13.856576 12994 rpcz_store.cc:276] 0810 13:54:11.808981 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.809096 (+ 115us) service_pool.cc:224] Handling call
0810 13:54:13.704475 (+1895379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:13.695405 15938 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:13.836819 12952 leader_election.cc:304] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:13.694345 15935 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:13.860743 13640 ts_tablet_manager.cc:1434] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.040s user 0.008s sys 0.001s
I20260810 13:54:13.612589 13639 consensus_queue.cc:260] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.861687 13640 tablet_bootstrap.cc:492] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:13.861768 15982 raft_consensus.cc:493] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:13.862165 15982 raft_consensus.cc:515] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.861162 15938 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.826269 15986 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.865705 15982 leader_election.cc:290] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.866191 15938 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.866708 15938 raft_consensus.cc:2804] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:13.867118 15938 raft_consensus.cc:697] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:13.868152 13639 ts_tablet_manager.cc:1434] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.266s user 0.008s sys 0.002s
I20260810 13:54:13.867904 15938 consensus_queue.cc:237] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.869096 13639 tablet_bootstrap.cc:492] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:13.870776 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]) was not created within the allowed timeout. Replacing with a new tablet dbf8f89ee29543f7809900fad8e93a72
I20260810 13:54:13.862089 15935 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:13.873771 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]) was not created within the allowed timeout. Replacing with a new tablet bc916597c50a4b3f809a768c58866cd7
W20260810 13:54:13.874984 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 51813605283e43f2b4efe6fb2fab652c (table default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d]) was not created within the allowed timeout. Replacing with a new tablet b90c5833487f4473a44fb028ee044f04
W20260810 13:54:13.876169 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]) was not created within the allowed timeout. Replacing with a new tablet 7aff1f03cebe4656a868fe9b3e33ac25
I20260810 13:54:13.876538 13640 tablet_bootstrap.cc:654] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:13.854735 15702 ts_tablet_manager.cc:1916] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:13.848222 15348 ts_tablet_manager.cc:1929] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:13.876994 15348 log.cc:1199] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/d5aa1374d37a4918af34a5e9b15c16b3
I20260810 13:54:13.877728 15348 ts_tablet_manager.cc:1950] T d5aa1374d37a4918af34a5e9b15c16b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:13.878561 13382 leader_election.cc:304] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:13.879626 16005 raft_consensus.cc:2749] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:13.882606 15935 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:13.885556 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 137498us
W20260810 13:54:13.893353 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.053s user 0.004s sys 0.000s
I20260810 13:54:13.893550 13640 tablet_bootstrap.cc:492] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:13.893973 13640 ts_tablet_manager.cc:1403] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.000s
I20260810 13:54:13.896279 13640 raft_consensus.cc:359] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.896932 13640 raft_consensus.cc:385] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:13.849164 15321 ts_tablet_manager.cc:1929] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:13.887609 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.897181 13640 raft_consensus.cc:740] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:13.897522 13269 raft_consensus.cc:2468] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:13.898154 15321 log.cc:1199] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/ba05f4940220459f951adf3491f60b93
I20260810 13:54:13.898000 13640 consensus_queue.cc:260] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.887743 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.899048 15321 ts_tablet_manager.cc:1950] T ba05f4940220459f951adf3491f60b93 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:13.899241 13258 raft_consensus.cc:2468] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:13.888095 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:13.849561 15985 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.848659 13638 tablet_bootstrap.cc:654] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:13.902717 12952 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:13.903600 12952 leader_election.cc:304] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:13.880816 13382 leader_election.cc:343] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 39ff3a48af494009bb53ee8d4e2a08cd
I20260810 13:54:13.906323 13382 leader_election.cc:304] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:13.907883 15982 raft_consensus.cc:2804] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:13.908236 15982 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:13.908581 15982 raft_consensus.cc:3060] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:13.910145 16005 raft_consensus.cc:2749] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:13.910799 13640 ts_tablet_manager.cc:1434] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.017s user 0.005s sys 0.002s
I20260810 13:54:13.911724 13640 tablet_bootstrap.cc:492] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:13.912894 16012 raft_consensus.cc:2804] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:13.913296 16012 raft_consensus.cc:493] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:13.913620 16012 raft_consensus.cc:3060] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:13.924417 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 541) took 3763 ms. Trace:
I20260810 13:54:13.924844 15321 rpcz_store.cc:276] 0810 13:54:10.161261 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.161387 (+ 126us) service_pool.cc:224] Handling call
0810 13:54:13.401916 (+3240529us) ts_tablet_manager.cc:1151] Deleting tablet ba05f4940220459f951adf3491f60b93
0810 13:54:13.455011 (+ 53095us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.789603 (+334592us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.849044 (+ 59441us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.924308 (+ 75264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36016,"tablet-delete.queue_time_us":3239908}
I20260810 13:54:13.926306 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet ba05f4940220459f951adf3491f60b93 (table default.Table_27966be3dfde47f48e04540a47399a69 [id=3801464b14e64234ae26f024ec8a6b0b]) successfully deleted
I20260810 13:54:13.929812 15321 tablet_replica.cc:333] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:13.930626 15321 raft_consensus.cc:2243] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:13.930500 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac9e3d3430044a5e85e2d812b7e221f5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:13.931113 15321 raft_consensus.cc:2272] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:13.931080 13468 raft_consensus.cc:2468] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:13.933691 13639 tablet_bootstrap.cc:654] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:13.934324 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:13.938398 13640 tablet_bootstrap.cc:654] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:13.938647 16015 tablet.cc:1724] T b449377349514576874b6c295ead5e9a P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:13.942935 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 485) took 10176 ms. Trace:
I20260810 13:54:13.941979 15982 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.943326 15348 rpcz_store.cc:276] 0810 13:54:03.766717 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.768125 (+ 1408us) service_pool.cc:224] Handling call
0810 13:54:13.225981 (+9457856us) ts_tablet_manager.cc:1151] Deleting tablet d5aa1374d37a4918af34a5e9b15c16b3
0810 13:54:13.226119 (+ 138us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.657210 (+431091us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.848107 (+190897us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:13.942858 (+ 94751us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24664,"tablet-delete.queue_time_us":9435887}
I20260810 13:54:13.945292 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 484) took 10198 ms. Trace:
I20260810 13:54:13.945075 15982 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.945621 15348 rpcz_store.cc:276] 0810 13:54:03.746438 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:03.748330 (+ 1892us) service_pool.cc:224] Handling call
0810 13:54:13.944659 (+10196329us) ts_tablet_manager.cc:1151] Deleting tablet bf672d15f88c4f0dbdf2fdb6aefa1108
0810 13:54:13.944923 (+ 264us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.945231 (+ 308us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10147511}
I20260810 13:54:13.946563 15348 tablet_replica.cc:333] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:13.947324 15348 raft_consensus.cc:2243] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:13.947711 13638 tablet_bootstrap.cc:492] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:13.947777 15348 raft_consensus.cc:2272] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:13.947371 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:13.948182 13638 ts_tablet_manager.cc:1403] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.238s user 0.009s sys 0.002s
W20260810 13:54:13.951984 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet ff1229ebe9304f19ab84d5a172aba937 (table default.Table_5ac9d00cb7b3422e9810b51a4f20e029 [id=6f7b1b6d99b64d008a7c3c527f172e24]) was not created within the allowed timeout. Replacing with a new tablet ad72f8b8dfe3446aba921935ae098ed9
W20260810 13:54:13.953563 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]) was not created within the allowed timeout. Replacing with a new tablet fa96914e2902446dab7049a0177348c8
W20260810 13:54:13.954670 12836 catalog_manager.cc:6182] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: Tablet 515727ae51d94c009b4446c8b6e2c8f6 (table default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68]) was not created within the allowed timeout. Replacing with a new tablet c8f1cfe4dacf40b4809e17543fefd334
I20260810 13:54:13.927985 16017 tablet.cc:1724] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:13.964622 15348 ts_tablet_manager.cc:1916] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:13.965682 16012 raft_consensus.cc:515] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.979178 15982 raft_consensus.cc:493] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:13.979707 15982 raft_consensus.cc:515] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:13.984128 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:13.984717 13475 raft_consensus.cc:3060] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:13.980825 16012 leader_election.cc:290] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.986141 15982 leader_election.cc:290] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:13.992132 13475 raft_consensus.cc:2468] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:13.993947 13640 tablet_bootstrap.cc:492] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:13.997813 13640 ts_tablet_manager.cc:1403] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.086s user 0.013s sys 0.000s
I20260810 13:54:14.005957 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b35d369474ba9bee379089796bd3c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:14.013455 13640 raft_consensus.cc:359] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.014201 13640 raft_consensus.cc:385] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:14.014453 13640 raft_consensus.cc:740] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:14.015630 15321 ts_tablet_manager.cc:1916] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:14.016557 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:14.017165 13258 raft_consensus.cc:3060] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:14.017375 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:14.018597 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:13.948340 13265 raft_consensus.cc:3060] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:14.020958 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:14.021658 13269 raft_consensus.cc:2393] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:14.022487 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:14.023054 13472 raft_consensus.cc:3060] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:14.025007 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet d5aa1374d37a4918af34a5e9b15c16b3 (table default.Table_1be07447c0034861a4616ab195eb8e46 [id=6b29e21f3d24403c8fe03d131e5edb38]) successfully deleted
I20260810 13:54:14.028033 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:14.029049 13640 consensus_queue.cc:260] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.029834 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:14.030786 13474 raft_consensus.cc:2468] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:14.032403 13472 raft_consensus.cc:2468] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:14.035593 15348 ts_tablet_manager.cc:1929] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:14.036101 15348 log.cc:1199] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/39ff3a48af494009bb53ee8d4e2a08cd
I20260810 13:54:14.038344 13640 ts_tablet_manager.cc:1434] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.040s user 0.005s sys 0.001s
I20260810 13:54:14.040833 13265 raft_consensus.cc:2468] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:14.041589 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:14.042368 13040 raft_consensus.cc:2393] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:14.043846 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:14.044344 13040 raft_consensus.cc:3060] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:14.051935 13040 raft_consensus.cc:2468] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:14.052762 13268 raft_consensus.cc:1240] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:14.056262 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:14.056547 12951 leader_election.cc:343] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: d5aa1374d37a4918af34a5e9b15c16b3
I20260810 13:54:14.057425 12951 leader_election.cc:304] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:14.070075 13638 raft_consensus.cc:359] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.070777 13638 raft_consensus.cc:385] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:14.071101 13638 raft_consensus.cc:740] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:14.075768 15882 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 13:54:14.076990 15348 ts_tablet_manager.cc:1950] T 39ff3a48af494009bb53ee8d4e2a08cd P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:14.079308 16005 raft_consensus.cc:493] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:14.079768 16005 raft_consensus.cc:515] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:14.084211 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet bf672d15f88c4f0dbdf2fdb6aefa1108 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf672d15f88c4f0dbdf2fdb6aefa1108 already in progress: creating tablet
I20260810 13:54:14.086642 13258 raft_consensus.cc:2468] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:14.060091 13639 tablet_bootstrap.cc:492] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:14.072032 12952 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:14.089249 15938 raft_consensus.cc:2804] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:14.089555 12952 leader_election.cc:304] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:14.089785 16012 raft_consensus.cc:2804] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:14.090380 16012 raft_consensus.cc:697] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:14.090690 16019 raft_consensus.cc:2804] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:14.091156 16019 raft_consensus.cc:697] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:14.091360 16012 consensus_queue.cc:237] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.092500 16005 leader_election.cc:290] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:14.092967 13639 ts_tablet_manager.cc:1403] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.224s user 0.008s sys 0.004s
I20260810 13:54:14.089632 15938 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:14.092033 16019 consensus_queue.cc:237] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.093712 15938 raft_consensus.cc:3060] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:14.095441 13640 tablet_bootstrap.cc:492] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:14.095814 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet e828861d499a400c834b848acdb2afc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:12 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:14.084370 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:14.098402 13382 leader_election.cc:343] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:14.098773 13164 leader_election.cc:343] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 3a1b35d369474ba9bee379089796bd3c
W20260810 13:54:14.099310 13382 consensus_peers.cc:597] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:14.101112 13164 leader_election.cc:304] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:14.101905 15985 raft_consensus.cc:2804] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:14.102646 15985 raft_consensus.cc:697] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:14.103613 15985 consensus_queue.cc:237] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.114116 15321 ts_tablet_manager.cc:1929] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:14.114537 15321 log.cc:1199] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/64e93928dcb94ae296590c4dedfd1781
I20260810 13:54:14.115240 15321 ts_tablet_manager.cc:1950] T 64e93928dcb94ae296590c4dedfd1781 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:14.116393 13638 consensus_queue.cc:260] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.122653 13640 tablet_bootstrap.cc:654] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:14.129223 15702 ts_tablet_manager.cc:1929] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:14.129654 15702 log.cc:1199] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/8fa729726a7f4603b0f5085a56cf89f6
I20260810 13:54:14.130100 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 540) took 3969 ms. Trace:
I20260810 13:54:14.130431 15702 ts_tablet_manager.cc:1950] T 8fa729726a7f4603b0f5085a56cf89f6 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:14.130458 15321 rpcz_store.cc:276] 0810 13:54:10.160961 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.163305 (+ 2344us) service_pool.cc:224] Handling call
0810 13:54:13.929620 (+3766315us) ts_tablet_manager.cc:1151] Deleting tablet 64e93928dcb94ae296590c4dedfd1781
0810 13:54:13.929675 (+ 55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.048555 (+118880us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.113987 (+ 65432us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.130032 (+ 16045us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3765715}
I20260810 13:54:14.089622 12951 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:14.137390 16005 consensus_queue.cc:1059] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 13:54:14.137508 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 486) took 9890 ms. Trace:
I20260810 13:54:14.139375 16001 raft_consensus.cc:3055] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:14.139726 16001 raft_consensus.cc:740] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:14.140511 16001 consensus_queue.cc:260] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.142061 16001 raft_consensus.cc:3060] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:14.138087 15348 rpcz_store.cc:276] 0810 13:54:04.247316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.250433 (+ 3117us) service_pool.cc:224] Handling call
0810 13:54:13.946415 (+9695982us) ts_tablet_manager.cc:1151] Deleting tablet 39ff3a48af494009bb53ee8d4e2a08cd
0810 13:54:13.946469 (+ 54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.003737 (+ 57268us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.035439 (+ 31702us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.137385 (+101946us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9695242}
I20260810 13:54:14.131860 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 64e93928dcb94ae296590c4dedfd1781 (table default.Table_fbe0f651fe2e4328b7e2a126d989afab [id=da2f9e6861694d889e45f1fc34a63469]) successfully deleted
I20260810 13:54:14.164345 16011 raft_consensus.cc:2749] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:14.173810 13639 raft_consensus.cc:359] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.174499 13639 raft_consensus.cc:385] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:14.174759 13639 raft_consensus.cc:740] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:14.176906 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.108s user 0.004s sys 0.000s
I20260810 13:54:14.186066 13164 leader_election.cc:304] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
W20260810 13:54:14.184201 13382 leader_election.cc:343] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:14.188510 13382 leader_election.cc:304] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:14.189215 15969 raft_consensus.cc:2749] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:14.197034 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 39ff3a48af494009bb53ee8d4e2a08cd (table default.Table_71513d2e5b514e3689dd3832681e181c [id=10d47f8e5d674a1585588be79dbef00b]) successfully deleted
I20260810 13:54:14.196981 13639 consensus_queue.cc:260] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.198604 13639 ts_tablet_manager.cc:1434] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.105s user 0.004s sys 0.001s
I20260810 13:54:14.204121 15946 raft_consensus.cc:2764] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:14.204303 13640 tablet_bootstrap.cc:492] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:14.204743 13640 ts_tablet_manager.cc:1403] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.110s user 0.011s sys 0.003s
I20260810 13:54:14.204703 15946 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:14.205098 15946 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.206991 15946 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:14.210183 13640 raft_consensus.cc:359] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.210848 13640 raft_consensus.cc:385] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:14.211122 13640 raft_consensus.cc:740] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:14.211831 13640 consensus_queue.cc:260] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.225725 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 528) took 3422 ms. Trace:
I20260810 13:54:14.226140 15702 rpcz_store.cc:276] 0810 13:54:10.803382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.818824 (+ 15442us) service_pool.cc:224] Handling call
0810 13:54:13.586037 (+2767213us) ts_tablet_manager.cc:1151] Deleting tablet 8fa729726a7f4603b0f5085a56cf89f6
0810 13:54:13.586097 (+ 60us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:13.928125 (+342028us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.064628 (+136503us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.225664 (+161036us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2766507}
I20260810 13:54:14.227524 15702 tablet_replica.cc:333] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:14.238054 13638 ts_tablet_manager.cc:1434] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.290s user 0.005s sys 0.004s
I20260810 13:54:14.239022 13638 tablet_bootstrap.cc:492] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:14.241467 15702 raft_consensus.cc:2243] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:14.242103 15702 raft_consensus.cc:2272] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:14.229357 15938 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.245898 15348 tablet_replica.cc:333] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:14.246024 15321 tablet_replica.cc:333] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:14.246735 15348 raft_consensus.cc:2243] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:14.246964 15321 raft_consensus.cc:2243] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:14.247575 15321 pending_rounds.cc:70] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: Trying to abort 1 pending ops.
I20260810 13:54:14.247718 15348 raft_consensus.cc:2272] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:14.247852 15321 pending_rounds.cc:77] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971739637268480 op_type: NO_OP noop_request { }
I20260810 13:54:14.248431 15321 raft_consensus.cc:2889] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:14.250962 15348 ts_tablet_manager.cc:1916] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:14.231086 13639 tablet_bootstrap.cc:492] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:14.258246 15938 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:14.259621 15321 raft_consensus.cc:2272] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:14.270845 13638 tablet_bootstrap.cc:654] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:14.273229 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 87258.4us
I20260810 13:54:14.273885 13164 leader_election.cc:304] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:14.276948 13640 ts_tablet_manager.cc:1434] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.072s user 0.007s sys 0.000s
W20260810 13:54:14.277406 13167 leader_election.cc:343] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:14.277841 13167 leader_election.cc:304] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:14.278541 13640 tablet_bootstrap.cc:492] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:14.282150 15985 raft_consensus.cc:2804] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:14.282706 15985 raft_consensus.cc:697] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:14.282765 15702 ts_tablet_manager.cc:1916] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:14.283568 15985 consensus_queue.cc:237] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.285851 15986 raft_consensus.cc:2749] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:14.289379 13167 leader_election.cc:343] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:14.290522 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:14.290835 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:14.291090 13470 raft_consensus.cc:2468] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:14.291867 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:14.292110 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:14.292555 13472 raft_consensus.cc:3060] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:14.292886 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:14.297976 16015 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:50548 (request call id 568) took 1624 ms. Trace:
I20260810 13:54:14.298796 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:14.299420 13470 raft_consensus.cc:2393] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:14.302525 16048 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:54:14.303628 16048 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:14.304888 13167 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:14.310629 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet e828861d499a400c834b848acdb2afc5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:12 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:14.311045 13476 raft_consensus.cc:2468] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:14.317487 15785 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:14.319559 13167 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:14.320528 15946 raft_consensus.cc:2749] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:14.329032 16001 raft_consensus.cc:493] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:14.329916 16001 raft_consensus.cc:515] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.331478 15321 ts_tablet_manager.cc:1916] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:14.333086 16001 leader_election.cc:290] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:14.337373 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 63569.3us
I20260810 13:54:14.361884 16057 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:54:14.363077 16057 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:14.370976 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet ac9e3d3430044a5e85e2d812b7e221f5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:43 UTC) from {username='slave'} at 127.0.0.1:50548
I20260810 13:54:14.370975 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac9e3d3430044a5e85e2d812b7e221f5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:14.371871 13260 raft_consensus.cc:3060] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:14.373227 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet d5aa1374d37a4918af34a5e9b15c16b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:50548
W20260810 13:54:14.373826 12951 leader_election.cc:343] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: d5aa1374d37a4918af34a5e9b15c16b3
I20260810 13:54:14.382221 12513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 556 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:14.386030 13639 tablet_bootstrap.cc:654] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:14.340479 13472 raft_consensus.cc:2468] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:14.392549 16062 tablet.cc:1724] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:14.398415 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9453eab70fa04df8b0c89e6caf54c894" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:14.413452 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 818 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:54:14.413919 16048 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:14.417430 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac9e3d3430044a5e85e2d812b7e221f5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:14.418133 13480 raft_consensus.cc:2468] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:14.418360 13638 tablet_bootstrap.cc:492] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:14.418764 13638 ts_tablet_manager.cc:1403] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.180s user 0.008s sys 0.003s
W20260810 13:54:14.423372 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 48704.7us
I20260810 13:54:14.425307 16011 raft_consensus.cc:493] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:14.426035 16011 raft_consensus.cc:515] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.429669 13640 tablet_bootstrap.cc:654] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:14.430235 13382 leader_election.cc:343] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: b820c99b33264add8df5fd443981d0cc
I20260810 13:54:14.435055 13638 raft_consensus.cc:359] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.435664 13638 raft_consensus.cc:385] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:14.435964 13638 raft_consensus.cc:740] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:14.436854 13040 raft_consensus.cc:1240] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:14.438431 13260 raft_consensus.cc:2468] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:14.442049 16005 raft_consensus.cc:493] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:14.442644 16005 raft_consensus.cc:515] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.445752 12951 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:14.446961 16005 leader_election.cc:290] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:14.449148 12952 leader_election.cc:304] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:14.450325 15938 raft_consensus.cc:2804] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:14.451126 15938 raft_consensus.cc:697] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:14.458113 13638 consensus_queue.cc:260] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.463490 15938 consensus_queue.cc:237] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.467373 13638 ts_tablet_manager.cc:1434] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.048s user 0.006s sys 0.003s
I20260810 13:54:14.463919 15348 ts_tablet_manager.cc:1929] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:54:14.469619 15348 log.cc:1199] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/73ad47d29d61456891478a9544594a94
I20260810 13:54:14.470432 15348 ts_tablet_manager.cc:1950] T 73ad47d29d61456891478a9544594a94 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:14.471839 15321 ts_tablet_manager.cc:1929] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:14.472846 15321 log.cc:1199] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/fb30ebe9520d4224bdfd45a5e915d8bd
I20260810 13:54:14.473762 15321 ts_tablet_manager.cc:1950] T fb30ebe9520d4224bdfd45a5e915d8bd P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:14.479694 16011 leader_election.cc:290] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:14.479607 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:14.472467 13638 tablet_bootstrap.cc:492] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:14.488227 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 542) took 3970 ms. Trace:
I20260810 13:54:14.488617 15321 rpcz_store.cc:276] 0810 13:54:10.518229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.518498 (+ 269us) service_pool.cc:224] Handling call
0810 13:54:14.158193 (+3639695us) ts_tablet_manager.cc:1151] Deleting tablet fb30ebe9520d4224bdfd45a5e915d8bd
0810 13:54:14.245849 (+ 87656us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.428175 (+182326us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.471685 (+ 43510us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.488165 (+ 16480us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3639088}
I20260810 13:54:14.489832 16070 tablet.cc:1724] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:14.298331 16015 rpcz_store.cc:276] 0810 13:54:12.674068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:12.676872 (+ 2804us) service_pool.cc:224] Handling call
0810 13:54:14.297907 (+1621035us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:13.116888 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:13.117257 (+ 369us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:13.117284 (+ 27us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:13.117326 (+ 42us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:13.117436 (+ 110us) alter_schema_op.cc:128] START. Timestamp: 1786370053109648
0810 13:54:13.117456 (+ 20us) op_driver.cc:348] REPLICATION: starting
0810 13:54:13.117997 (+ 541us) log.cc:844] Serialized 173 byte log entry
0810 13:54:13.232408 (+114411us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b1800073de0. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1929bfec01 00007f1929c0b581 00007f1920d09e62 00007f1920d0c121 00007f1920d0c0d9 00007f1920d0c069 00007f1920d0c031 00007f1920d0b32d 00000000005bd8c4 00000000005bd6f9 00007f1920ced1ea
0810 13:54:13.888672 (+656264us) op_driver.cc:464] REPLICATION: finished
0810 13:54:13.938521 (+ 49849us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:13.939876 (+ 1355us) log.cc:844] Serialized 5 byte log entry
0810 13:54:14.296371 (+356495us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.297205 (+ 834us) log.cc:844] Serialized 14 byte log entry
0810 13:54:14.297773 (+ 568us) alter_schema_op.cc:73] Released schema lock
0810 13:54:14.297805 (+ 32us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":49636,"prepare.queue_time_us":439059,"prepare.run_cpu_time_us":8054,"prepare.run_wall_time_us":92122,"raft.queue_time_us":1257,"raft.run_cpu_time_us":1017,"raft.run_wall_time_us":10025,"replication_time_us":771101,"spinlock_wait_cycles":17528192,"thread_start_us":548119,"threads_started":3,"wal-append.queue_time_us":104341}]]}
I20260810 13:54:14.500375 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet fb30ebe9520d4224bdfd45a5e915d8bd (table default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]) successfully deleted
I20260810 13:54:14.500712 16071 tablet.cc:1724] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:14.502279 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 544) took 3958 ms. Trace:
I20260810 13:54:14.502732 15321 rpcz_store.cc:276] 0810 13:54:10.544242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.544374 (+ 132us) service_pool.cc:224] Handling call
0810 13:54:14.501511 (+3957137us) ts_tablet_manager.cc:1151] Deleting tablet 0f422b17b9a24f609b06625837947e64
0810 13:54:14.501634 (+ 123us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.502194 (+ 560us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3956534}
W20260810 13:54:14.507306 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 0f422b17b9a24f609b06625837947e64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f422b17b9a24f609b06625837947e64 already in progress: creating tablet
I20260810 13:54:14.517751 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 546) took 3948 ms. Trace:
I20260810 13:54:14.518201 15321 rpcz_store.cc:276] 0810 13:54:10.569048 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.569556 (+ 508us) service_pool.cc:224] Handling call
0810 13:54:14.517116 (+3947560us) ts_tablet_manager.cc:1151] Deleting tablet ffcb4016b1984ab9a00699bda1488664
0810 13:54:14.517212 (+ 96us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.517687 (+ 475us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3946952}
W20260810 13:54:14.521919 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 53361.5us
W20260810 13:54:14.524531 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 78856us
W20260810 13:54:14.522586 13382 leader_election.cc:343] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:14.526412 16011 raft_consensus.cc:2749] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:14.532943 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet ffcb4016b1984ab9a00699bda1488664 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffcb4016b1984ab9a00699bda1488664 already in progress: creating tablet
W20260810 13:54:14.533793 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:14.534593 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 545) took 3965 ms. Trace:
I20260810 13:54:14.536785 15321 rpcz_store.cc:276] 0810 13:54:10.568730 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.571584 (+ 2854us) service_pool.cc:224] Handling call
0810 13:54:14.533932 (+3962348us) ts_tablet_manager.cc:1151] Deleting tablet 3641ae594b104131bb55005bc1f61027
0810 13:54:14.534093 (+ 161us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.534522 (+ 429us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3961738}
I20260810 13:54:14.537434 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 2 candidate_status { last_received { term: 1 index: 556 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" is_pre_election: true
I20260810 13:54:14.540175 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:14.545079 13164 leader_election.cc:304] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:14.547675 15985 raft_consensus.cc:2764] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:14.552866 16057 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:14.553743 16057 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:14.557566 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 487) took 10268 ms. Trace:
I20260810 13:54:14.557231 16017 tablet.cc:1724] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:14.558033 15348 rpcz_store.cc:276] 0810 13:54:04.289655 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.289856 (+ 201us) service_pool.cc:224] Handling call
0810 13:54:14.151316 (+9861460us) ts_tablet_manager.cc:1151] Deleting tablet 73ad47d29d61456891478a9544594a94
0810 13:54:14.245748 (+ 94432us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.276481 (+ 30733us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.463785 (+187304us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.557468 (+ 93683us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9860163}
I20260810 13:54:14.559953 12951 leader_election.cc:304] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:14.589437 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:14.591214 13260 raft_consensus.cc:2468] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:14.596982 15982 raft_consensus.cc:2749] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:14.546180 13638 tablet_bootstrap.cc:654] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:14.609668 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 73ad47d29d61456891478a9544594a94 (table default.Table_c04efa0403424fbcb37f7215ea9dcd8b [id=41ab72dabf7e4cbaaa1c8010766780c4]) successfully deleted
W20260810 13:54:14.617023 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 77025.3us
I20260810 13:54:14.619134 15348 tablet_replica.cc:333] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:14.628232 16072 raft_consensus.cc:493] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:14.628983 16072 raft_consensus.cc:515] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.633483 16072 leader_election.cc:290] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:14.639407 16001 raft_consensus.cc:493] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:14.640272 16001 raft_consensus.cc:515] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.643887 16001 leader_election.cc:290] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:14.646832 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 552) took 3794 ms. Trace:
I20260810 13:54:14.647240 15321 rpcz_store.cc:276] 0810 13:54:10.852093 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.852245 (+ 152us) service_pool.cc:224] Handling call
0810 13:54:14.646107 (+3793862us) ts_tablet_manager.cc:1151] Deleting tablet a17d73c65f544b7c8566fd874ee87a25
0810 13:54:14.646189 (+ 82us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.646759 (+ 570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96640,"tablet-delete.queue_time_us":3793132}
I20260810 13:54:14.654886 13639 tablet_bootstrap.cc:492] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:14.655325 13639 ts_tablet_manager.cc:1403] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.427s user 0.010s sys 0.007s
I20260810 13:54:14.655951 15348 raft_consensus.cc:2243] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:14.661381 16077 tablet.cc:1724] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:14.666246 15348 raft_consensus.cc:2272] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:14.668512 15348 ts_tablet_manager.cc:1916] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:54:14.669447 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 3641ae594b104131bb55005bc1f61027 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3641ae594b104131bb55005bc1f61027 already in progress: creating tablet
I20260810 13:54:14.669909 12746 master_service.cc:960] ReplaceTablet: received request to replace tablet 2b88b4fa155d4364b4fa1b2c724755bb from {username='slave'} at 127.0.0.1:48758
W20260810 13:54:14.670218 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet a17d73c65f544b7c8566fd874ee87a25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a17d73c65f544b7c8566fd874ee87a25 already in progress: creating tablet
W20260810 13:54:14.670631 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 76468.2us
I20260810 13:54:14.672648 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 8fa729726a7f4603b0f5085a56cf89f6 (table default.Table_e383a6bbbf2247478200482d22a378e3 [id=223e495b001c43a8b728880aafcdb751]) successfully deleted
I20260810 13:54:14.677052 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 554) took 3758 ms. Trace:
I20260810 13:54:14.677651 15321 rpcz_store.cc:276] 0810 13:54:10.918355 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.918490 (+ 135us) service_pool.cc:224] Handling call
0810 13:54:14.648447 (+3729957us) ts_tablet_manager.cc:1151] Deleting tablet b0b44a300d4b4f41854371735ecbab1a
0810 13:54:14.658813 (+ 10366us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.676990 (+ 18177us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3729293}
W20260810 13:54:14.679049 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet b0b44a300d4b4f41854371735ecbab1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0b44a300d4b4f41854371735ecbab1a already in progress: creating tablet
I20260810 13:54:14.681021 13639 raft_consensus.cc:359] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.681697 13639 raft_consensus.cc:385] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:14.681973 13639 raft_consensus.cc:740] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:14.638775 13382 leader_election.cc:304] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:14.688817 15321 tablet_replica.cc:333] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:14.689709 15321 raft_consensus.cc:2243] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Raft consensus shutting down.
W20260810 13:54:14.689719 16062 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.295s user 0.012s sys 0.000s
I20260810 13:54:14.690665 15321 raft_consensus.cc:2272] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:14.697925 15804 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.053s user 0.004s sys 0.000s
I20260810 13:54:14.704128 13640 tablet_bootstrap.cc:492] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:14.705186 13640 ts_tablet_manager.cc:1403] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.427s user 0.015s sys 0.009s
W20260810 13:54:14.706440 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 67714.9us
I20260810 13:54:14.710994 15321 ts_tablet_manager.cc:1916] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:14.711607 16001 raft_consensus.cc:2804] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:14.712338 16001 raft_consensus.cc:493] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:14.712765 16001 raft_consensus.cc:3060] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:14.715464 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ce84eacbab61417a9497f8770b4da511 consensus state has no leader
I20260810 13:54:14.716676 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:14.730647 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9453eab70fa04df8b0c89e6caf54c894" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:14.734583 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:14.736461 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac9e3d3430044a5e85e2d812b7e221f5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:14.737788 15702 ts_tablet_manager.cc:1929] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:14.738190 15702 log.cc:1199] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/fb30ebe9520d4224bdfd45a5e915d8bd
I20260810 13:54:14.738936 15702 ts_tablet_manager.cc:1950] T fb30ebe9520d4224bdfd45a5e915d8bd P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:14.739662 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 532) took 3932 ms. Trace:
I20260810 13:54:14.739959 15702 rpcz_store.cc:276] 0810 13:54:10.807619 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.827267 (+ 19648us) service_pool.cc:224] Handling call
0810 13:54:14.227370 (+3400103us) ts_tablet_manager.cc:1151] Deleting tablet fb30ebe9520d4224bdfd45a5e915d8bd
0810 13:54:14.227407 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.528995 (+301588us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.737656 (+208661us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.739612 (+ 1956us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3399467}
I20260810 13:54:14.742030 13640 raft_consensus.cc:359] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.742812 13640 raft_consensus.cc:385] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:14.743063 13640 raft_consensus.cc:740] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:14.747866 13639 consensus_queue.cc:260] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.750339 13639 ts_tablet_manager.cc:1434] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.095s user 0.005s sys 0.003s
I20260810 13:54:14.757221 13639 tablet_bootstrap.cc:492] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:14.757475 15321 ts_tablet_manager.cc:1929] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:54:14.757830 15321 log.cc:1199] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/a43def9358894b2aa001a7db56706589
I20260810 13:54:14.758065 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350b68f6c1cf48ff8e5f8521e5a4dad6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:14.758567 15321 ts_tablet_manager.cc:1950] T a43def9358894b2aa001a7db56706589 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:14.775576 16071 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 596) took 1457 ms. Trace:
I20260810 13:54:14.777509 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 566) took 3524 ms. Trace:
I20260810 13:54:14.776001 16071 rpcz_store.cc:276] 0810 13:54:13.318547 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.318654 (+ 107us) service_pool.cc:224] Handling call
0810 13:54:14.775497 (+1456843us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:13.376308 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:13.380715 (+ 4407us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:13.380765 (+ 50us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:13.380822 (+ 57us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:13.380969 (+ 147us) alter_schema_op.cc:128] START. Timestamp: 1786370053380671
0810 13:54:13.380991 (+ 22us) op_driver.cc:348] REPLICATION: starting
0810 13:54:13.381551 (+ 560us) log.cc:844] Serialized 173 byte log entry
0810 13:54:14.459938 (+1078387us) op_driver.cc:464] REPLICATION: finished
0810 13:54:14.499375 (+ 39437us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:14.503020 (+ 3645us) log.cc:844] Serialized 5 byte log entry
0810 13:54:14.722006 (+218986us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.775229 (+ 53223us) log.cc:844] Serialized 14 byte log entry
0810 13:54:14.775342 (+ 113us) alter_schema_op.cc:73] Released schema lock
0810 13:54:14.775373 (+ 31us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":39188,"prepare.queue_time_us":322,"prepare.run_cpu_time_us":21406,"prepare.run_wall_time_us":418377,"raft.queue_time_us":104,"raft.run_cpu_time_us":952,"raft.run_wall_time_us":952,"replication_time_us":1078815,"spinlock_wait_cycles":26496,"thread_start_us":405026,"threads_started":2,"wal-append.queue_time_us":308177}]]}
I20260810 13:54:14.777828 15321 rpcz_store.cc:276] 0810 13:54:11.253596 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.253721 (+ 125us) service_pool.cc:224] Handling call
0810 13:54:14.688579 (+3434858us) ts_tablet_manager.cc:1151] Deleting tablet a43def9358894b2aa001a7db56706589
0810 13:54:14.688674 (+ 95us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.749375 (+ 60701us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.757363 (+ 7988us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.777441 (+ 20078us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3424558}
I20260810 13:54:14.779529 12721 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]) successfully deleted
I20260810 13:54:14.781172 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:14.782447 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 567) took 3522 ms. Trace:
I20260810 13:54:14.788486 15321 rpcz_store.cc:276] 0810 13:54:11.260044 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.260168 (+ 124us) service_pool.cc:224] Handling call
0810 13:54:14.781958 (+3521790us) ts_tablet_manager.cc:1151] Deleting tablet 995d901d22484799bd79fcad8103b8a5
0810 13:54:14.782039 (+ 81us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.782392 (+ 353us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3521096}
W20260810 13:54:14.789897 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 995d901d22484799bd79fcad8103b8a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 995d901d22484799bd79fcad8103b8a5 already in progress: creating tablet
I20260810 13:54:14.791081 16070 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:43224 (request call id 598) took 1396 ms. Trace:
W20260810 13:54:14.796435 13382 leader_election.cc:343] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: b820c99b33264add8df5fd443981d0cc
I20260810 13:54:14.796988 13382 leader_election.cc:304] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:14.797732 13382 raft_consensus.cc:2686] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260810 13:54:14.801479 13640 consensus_queue.cc:260] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.802342 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350b68f6c1cf48ff8e5f8521e5a4dad6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:14.803103 13638 tablet_bootstrap.cc:492] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:14.801056 15214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 818 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:14.804509 13638 ts_tablet_manager.cc:1403] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.334s user 0.024s sys 0.054s
I20260810 13:54:14.804618 15214 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9666026fb7e4c85b46c6aab952932fb in term 1.
I20260810 13:54:14.806562 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7
I20260810 13:54:14.807356 16048 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:14.807222 13638 raft_consensus.cc:359] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.807690 16048 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1298bde14cec4cd3a9d6338c7d47f0b7)
I20260810 13:54:14.807861 13638 raft_consensus.cc:385] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:14.808055 16048 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:14.808110 13638 raft_consensus.cc:740] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:14.808760 13638 consensus_queue.cc:260] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.820977 16001 raft_consensus.cc:515] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.821382 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 534) took 4012 ms. Trace:
I20260810 13:54:14.821717 15702 rpcz_store.cc:276] 0810 13:54:10.843152 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.843927 (+ 775us) service_pool.cc:224] Handling call
0810 13:54:14.820980 (+3977053us) ts_tablet_manager.cc:1151] Deleting tablet 0f422b17b9a24f609b06625837947e64
0810 13:54:14.821031 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.821309 (+ 278us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3976270}
I20260810 13:54:14.822934 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 535) took 3979 ms. Trace:
I20260810 13:54:14.823141 16001 leader_election.cc:290] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:14.823257 15702 rpcz_store.cc:276] 0810 13:54:10.843776 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.846788 (+ 3012us) service_pool.cc:224] Handling call
0810 13:54:14.822552 (+3975764us) ts_tablet_manager.cc:1151] Deleting tablet 3641ae594b104131bb55005bc1f61027
0810 13:54:14.822598 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.822870 (+ 272us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3975109}
I20260810 13:54:14.824441 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 536) took 3975 ms. Trace:
I20260810 13:54:14.829391 13638 ts_tablet_manager.cc:1434] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260810 13:54:14.791326 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 575) took 3092 ms. Trace:
I20260810 13:54:14.829845 15321 rpcz_store.cc:276] 0810 13:54:11.698998 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.699319 (+ 321us) service_pool.cc:224] Handling call
0810 13:54:14.790877 (+3091558us) ts_tablet_manager.cc:1151] Deleting tablet de012d382b194bf193fef76779abcf17
0810 13:54:14.790934 (+ 57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.791276 (+ 342us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3090877}
I20260810 13:54:14.834371 13640 ts_tablet_manager.cc:1434] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.129s user 0.002s sys 0.004s
I20260810 13:54:14.830322 13638 tablet_bootstrap.cc:492] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:14.849895 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet de012d382b194bf193fef76779abcf17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de012d382b194bf193fef76779abcf17 already in progress: creating tablet
I20260810 13:54:14.853099 13640 tablet_bootstrap.cc:492] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:14.854894 13638 tablet_bootstrap.cc:654] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:14.855525 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 576) took 2952 ms. Trace:
I20260810 13:54:14.791582 16070 rpcz_store.cc:276] 0810 13:54:13.395242 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.395436 (+ 194us) service_pool.cc:224] Handling call
0810 13:54:14.791000 (+1395564us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:13.685250 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:13.686014 (+ 764us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:13.686048 (+ 34us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:13.686092 (+ 44us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:13.686203 (+ 111us) alter_schema_op.cc:128] START. Timestamp: 1786370053712151
0810 13:54:13.686225 (+ 22us) op_driver.cc:348] REPLICATION: starting
0810 13:54:13.704911 (+ 18686us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b540004e320. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb881f53951 00007fb881f67900 00007fb881ff0f22 00007fb881fe6347 00007fb881fe6184 00007fb882475f61 00007fb882475738 00007fb88247a3d1 00007fb88247a389 00007fb88247a319 00007fb88247a2e1
0810 13:54:13.705498 (+ 587us) log.cc:844] Serialized 173 byte log entry
0810 13:54:14.441706 (+736208us) op_driver.cc:464] REPLICATION: finished
0810 13:54:14.489690 (+ 47984us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:14.492073 (+ 2383us) log.cc:844] Serialized 5 byte log entry
0810 13:54:14.726600 (+234527us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.789613 (+ 63013us) log.cc:844] Serialized 14 byte log entry
0810 13:54:14.790811 (+ 1198us) alter_schema_op.cc:73] Released schema lock
0810 13:54:14.790855 (+ 44us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":47707,"mutex_wait_us":56694,"prepare.queue_time_us":280920,"prepare.run_cpu_time_us":9927,"prepare.run_wall_time_us":125038,"raft.queue_time_us":995,"raft.run_cpu_time_us":1055,"raft.run_wall_time_us":1054,"replication_time_us":755323,"spinlock_wait_cycles":6801664,"thread_start_us":505071,"threads_started":3,"wal-append.queue_time_us":101942}]]}
W20260810 13:54:14.858083 13382 leader_election.cc:343] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:14.856829 15321 rpcz_store.cc:276] 0810 13:54:11.903228 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.904792 (+ 1564us) service_pool.cc:224] Handling call
0810 13:54:14.853621 (+2948829us) ts_tablet_manager.cc:1151] Deleting tablet 3610bc4f8a0742fdb69347b40a04f078
0810 13:54:14.855166 (+ 1545us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.855468 (+ 302us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2948237}
I20260810 13:54:14.858593 13382 leader_election.cc:304] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:14.859712 13382 leader_election.cc:343] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:14.860776 16072 raft_consensus.cc:2749] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:14.861824 16048 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
W20260810 13:54:14.863222 13382 leader_election.cc:343] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:14.863763 13382 leader_election.cc:343] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:14.869174 15348 ts_tablet_manager.cc:1929] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260810 13:54:14.869352 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 3610bc4f8a0742fdb69347b40a04f078 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3610bc4f8a0742fdb69347b40a04f078 already in progress: creating tablet
I20260810 13:54:14.869531 15348 log.cc:1199] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/b820c99b33264add8df5fd443981d0cc
I20260810 13:54:14.870141 15348 ts_tablet_manager.cc:1950] T b820c99b33264add8df5fd443981d0cc P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:14.870590 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 577) took 1613 ms. Trace:
I20260810 13:54:14.870949 15321 rpcz_store.cc:276] 0810 13:54:13.256865 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.257908 (+ 1043us) service_pool.cc:224] Handling call
0810 13:54:14.870165 (+1612257us) ts_tablet_manager.cc:1151] Deleting tablet 613d7ddce24b45c886139bf68c3c9a4d
0810 13:54:14.870207 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.870509 (+ 302us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1610555}
I20260810 13:54:14.872133 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 489) took 10380 ms. Trace:
W20260810 13:54:14.872334 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet 613d7ddce24b45c886139bf68c3c9a4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 613d7ddce24b45c886139bf68c3c9a4d already in progress: creating tablet
I20260810 13:54:14.873456 15321 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 578) took 1103 ms. Trace:
I20260810 13:54:14.873790 15321 rpcz_store.cc:276] 0810 13:54:13.770104 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.770229 (+ 125us) service_pool.cc:224] Handling call
0810 13:54:14.873105 (+1102876us) ts_tablet_manager.cc:1151] Deleting tablet e828861d499a400c834b848acdb2afc5
0810 13:54:14.873142 (+ 37us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.873404 (+ 262us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1094917}
W20260810 13:54:14.874974 12721 catalog_manager.cc:5030] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): delete failed for tablet e828861d499a400c834b848acdb2afc5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e828861d499a400c834b848acdb2afc5 already in progress: creating tablet
I20260810 13:54:14.883220 13640 tablet_bootstrap.cc:654] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:14.886245 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac9e3d3430044a5e85e2d812b7e221f5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:14.886741 13480 raft_consensus.cc:3060] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:14.888789 13382 leader_election.cc:343] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:14.889027 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet fb30ebe9520d4224bdfd45a5e915d8bd (table default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]) successfully deleted
I20260810 13:54:14.889142 13382 leader_election.cc:304] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:14.889977 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 0f422b17b9a24f609b06625837947e64 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f422b17b9a24f609b06625837947e64 already in progress: creating tablet
I20260810 13:54:14.890277 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:14.890419 16001 raft_consensus.cc:2749] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:14.890848 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 3641ae594b104131bb55005bc1f61027 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3641ae594b104131bb55005bc1f61027 already in progress: creating tablet
I20260810 13:54:14.891055 13472 raft_consensus.cc:2393] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
W20260810 13:54:14.891386 13382 leader_election.cc:343] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:14.891845 13382 leader_election.cc:304] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:14.892024 15938 consensus_queue.cc:1048] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:14.897290 12513 raft_consensus.cc:1240] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 2 FOLLOWER]: Rejecting Update request from peer 1298bde14cec4cd3a9d6338c7d47f0b7 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:14.899001 13639 tablet_bootstrap.cc:654] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:14.900981 16070 tablet.cc:1724] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:14.903409 16086 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 }, Status: INVALID_TERM, Last received: 1.818, Next index: 819, Last known committed idx: 818, Time since last communication: 0.001s
I20260810 13:54:14.906075 15214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 818 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d"
I20260810 13:54:14.906661 15214 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:14.907673 13480 raft_consensus.cc:2468] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:14.891888 15702 rpcz_store.cc:276] 0810 13:54:10.849382 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.850963 (+ 1581us) service_pool.cc:224] Handling call
0810 13:54:14.824107 (+3973144us) ts_tablet_manager.cc:1151] Deleting tablet ffcb4016b1984ab9a00699bda1488664
0810 13:54:14.824149 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.824394 (+ 245us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3972556}
I20260810 13:54:14.913978 13638 tablet_bootstrap.cc:492] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:14.914598 13638 ts_tablet_manager.cc:1403] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.084s user 0.012s sys 0.001s
I20260810 13:54:14.916889 16001 raft_consensus.cc:2749] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:14.912091 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet ffcb4016b1984ab9a00699bda1488664 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ffcb4016b1984ab9a00699bda1488664 already in progress: creating tablet
I20260810 13:54:14.920389 16012 consensus_queue.cc:1048] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:14.922571 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:14.923161 13264 raft_consensus.cc:3060] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:14.931685 13264 raft_consensus.cc:2468] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:14.934193 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 543) took 3981 ms. Trace:
I20260810 13:54:14.934235 12765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 818 } } ignore_live_leader: false dest_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7"
I20260810 13:54:14.934571 15702 rpcz_store.cc:276] 0810 13:54:10.953259 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.956862 (+ 3603us) service_pool.cc:224] Handling call
0810 13:54:14.910609 (+3953747us) ts_tablet_manager.cc:1151] Deleting tablet a17d73c65f544b7c8566fd874ee87a25
0810 13:54:14.910653 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.934133 (+ 23480us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3953050}
I20260810 13:54:14.935926 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 545) took 3954 ms. Trace:
I20260810 13:54:14.936872 16048 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 election: Requested vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:14.872435 15348 rpcz_store.cc:276] 0810 13:54:04.491796 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.492761 (+ 965us) service_pool.cc:224] Handling call
0810 13:54:14.559590 (+10066829us) ts_tablet_manager.cc:1151] Deleting tablet b820c99b33264add8df5fd443981d0cc
0810 13:54:14.618966 (+ 59376us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.755848 (+136882us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.869048 (+113200us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:14.872080 (+ 3032us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35957,"tablet-delete.queue_time_us":10066147}
I20260810 13:54:14.937772 15348 tablet_replica.cc:333] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:14.939888 12995 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:50534 (request call id 39) took 1823 ms. Trace:
W20260810 13:54:14.942798 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet a17d73c65f544b7c8566fd874ee87a25 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a17d73c65f544b7c8566fd874ee87a25 already in progress: creating tablet
I20260810 13:54:14.943156 12951 leader_election.cc:304] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:14.935835 15214 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9666026fb7e4c85b46c6aab952932fb in term 2.
I20260810 13:54:14.936096 13265 raft_consensus.cc:1275] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260810 13:54:14.946260 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7
I20260810 13:54:14.948104 16048 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:14.948360 15348 raft_consensus.cc:2243] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:14.949587 15348 pending_rounds.cc:70] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: Trying to abort 1 pending ops.
I20260810 13:54:14.957530 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet b820c99b33264add8df5fd443981d0cc (table default.Table_b48c394590b6458487d9402067fc9889 [id=8169bbe19c43404bb723ba96fce6d27b]) successfully deleted
I20260810 13:54:14.959196 13638 raft_consensus.cc:359] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.959903 13638 raft_consensus.cc:385] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:14.960178 13638 raft_consensus.cc:740] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:14.959945 16048 raft_consensus.cc:697] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 2 LEADER]: Becoming Leader. State: Replica: d9666026fb7e4c85b46c6aab952932fb, State: Running, Role: LEADER
I20260810 13:54:14.960866 13638 consensus_queue.cc:260] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.961535 16048 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 818, Committed index: 818, Last appended: 1.818, Last appended by leader: 818, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:14.964221 16012 raft_consensus.cc:3060] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:14.968837 15348 pending_rounds.cc:77] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971725067194368 op_type: NO_OP noop_request { }
I20260810 13:54:14.969384 16011 consensus_queue.cc:1048] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260810 13:54:14.969280 15348 raft_consensus.cc:2889] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:14.970889 15348 raft_consensus.cc:2272] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:14.936203 15702 rpcz_store.cc:276] 0810 13:54:10.981229 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.017969 (+ 36740us) service_pool.cc:224] Handling call
0810 13:54:14.935562 (+3917593us) ts_tablet_manager.cc:1151] Deleting tablet b0b44a300d4b4f41854371735ecbab1a
0810 13:54:14.935610 (+ 48us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:14.935875 (+ 265us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3875313}
I20260810 13:54:14.971879 15702 tablet_replica.cc:333] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:14.962419 13382 leader_election.cc:304] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:14.976735 16001 raft_consensus.cc:2804] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:14.977255 16001 raft_consensus.cc:697] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:14.978118 16001 consensus_queue.cc:237] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.940238 12995 rpcz_store.cc:276] 0810 13:54:13.116455 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.137226 (+ 20771us) service_pool.cc:224] Handling call
0810 13:54:13.981584 (+844358us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b5400113d54. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:14.637508 (+655924us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54000d2fd4. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e692d8 00007f1928ed84ed 00007f192762a104 00007f192762a092 00007f1927629fc1 00007f1927629f3c 00007f19276291f2 00007f1925b3a07c 00007f1925b394b6 00007f1925b38e5f
0810 13:54:14.939717 (+302209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":755272704}
I20260810 13:54:14.982030 16049 raft_consensus.cc:493] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:14.982620 16049 raft_consensus.cc:515] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:14.985782 16049 leader_election.cc:290] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:14.988224 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:14.988845 13480 raft_consensus.cc:2468] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:14.990331 13164 leader_election.cc:304] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:14.991130 15702 raft_consensus.cc:2243] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:14.991439 16050 raft_consensus.cc:2804] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:14.991794 15702 raft_consensus.cc:2272] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:14.991902 16050 raft_consensus.cc:493] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:14.992280 16050 raft_consensus.cc:3060] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:14.993973 15702 ts_tablet_manager.cc:1916] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:14.998121 13640 tablet_bootstrap.cc:492] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:14.998598 13640 ts_tablet_manager.cc:1403] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.146s user 0.010s sys 0.002s
I20260810 13:54:15.000064 15348 ts_tablet_manager.cc:1916] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:15.015172 13638 ts_tablet_manager.cc:1434] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.100s user 0.007s sys 0.000s
I20260810 13:54:15.011260 13640 raft_consensus.cc:359] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.016274 13640 raft_consensus.cc:385] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:15.008250 16050 raft_consensus.cc:515] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.016543 13640 raft_consensus.cc:740] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:15.025435 13640 consensus_queue.cc:260] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.027915 13640 ts_tablet_manager.cc:1434] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.029s user 0.008s sys 0.000s
I20260810 13:54:15.029755 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:15.030237 13480 raft_consensus.cc:3060] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:15.030560 16050 leader_election.cc:290] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:15.033209 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 90130.3us
I20260810 13:54:15.035739 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:15.038679 16015 tablet.cc:1724] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260810 13:54:15.039574 13480 raft_consensus.cc:2468] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:15.040735 13164 leader_election.cc:304] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:15.042423 16050 raft_consensus.cc:2804] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:15.043438 16050 raft_consensus.cc:697] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:15.044221 16050 consensus_queue.cc:237] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.050765 13638 tablet_bootstrap.cc:492] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:15.051061 16095 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:15.051683 16095 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1298bde14cec4cd3a9d6338c7d47f0b7, State: Running, Role: LEADER
I20260810 13:54:15.056559 13639 tablet_bootstrap.cc:492] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:15.056948 13640 tablet_bootstrap.cc:492] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:15.057341 13639 ts_tablet_manager.cc:1403] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.300s user 0.010s sys 0.002s
I20260810 13:54:15.074844 16095 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 818, Committed index: 818, Last appended: 1.818, Last appended by leader: 818, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:15.076579 15348 ts_tablet_manager.cc:1929] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:15.077008 15348 log.cc:1199] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/64e93928dcb94ae296590c4dedfd1781
I20260810 13:54:15.078245 15348 ts_tablet_manager.cc:1950] T 64e93928dcb94ae296590c4dedfd1781 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:15.080444 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 488) took 10589 ms. Trace:
I20260810 13:54:15.080751 15348 rpcz_store.cc:276] 0810 13:54:04.491529 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.492810 (+ 1281us) service_pool.cc:224] Handling call
0810 13:54:14.937586 (+10444776us) ts_tablet_manager.cc:1151] Deleting tablet 64e93928dcb94ae296590c4dedfd1781
0810 13:54:14.937653 (+ 67us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.046508 (+108855us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:15.068871 (+ 22363us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:15.080389 (+ 11518us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9742,"tablet-delete.queue_time_us":10443941}
I20260810 13:54:15.082302 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 490) took 10262 ms. Trace:
I20260810 13:54:15.082640 15348 rpcz_store.cc:276] 0810 13:54:04.819818 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:04.819982 (+ 164us) service_pool.cc:224] Handling call
0810 13:54:15.081810 (+10261828us) ts_tablet_manager.cc:1151] Deleting tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c
0810 13:54:15.081935 (+ 125us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.082234 (+ 299us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":10260792}
I20260810 13:54:15.084372 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 493) took 8911 ms. Trace:
I20260810 13:54:15.084668 15348 rpcz_store.cc:276] 0810 13:54:06.173073 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.214337 (+ 41264us) service_pool.cc:224] Handling call
0810 13:54:15.083986 (+8869649us) ts_tablet_manager.cc:1151] Deleting tablet 34b2314b771f41188bc8101c5ddffaf4
0810 13:54:15.084051 (+ 65us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.084321 (+ 270us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8859067}
I20260810 13:54:15.085903 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 494) took 8870 ms. Trace:
I20260810 13:54:15.086169 15348 rpcz_store.cc:276] 0810 13:54:06.215294 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.218654 (+ 3360us) service_pool.cc:224] Handling call
0810 13:54:15.085630 (+8866976us) ts_tablet_manager.cc:1151] Deleting tablet 39fd2ebed17e4c1e946d7783c41d15e6
0810 13:54:15.085666 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.085861 (+ 195us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8860527}
I20260810 13:54:15.095415 13639 raft_consensus.cc:359] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.096019 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 498) took 8810 ms. Trace:
I20260810 13:54:15.096326 15348 rpcz_store.cc:276] 0810 13:54:06.285946 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.286119 (+ 173us) service_pool.cc:224] Handling call
0810 13:54:15.086904 (+8800785us) ts_tablet_manager.cc:1151] Deleting tablet a7fb3f80f940435a902c355cb699b434
0810 13:54:15.095675 (+ 8771us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.095968 (+ 293us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8800085}
I20260810 13:54:15.098552 13640 tablet_bootstrap.cc:654] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:15.105439 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 511) took 8607 ms. Trace:
I20260810 13:54:15.105901 15348 rpcz_store.cc:276] 0810 13:54:06.497770 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:06.507319 (+ 9549us) service_pool.cc:224] Handling call
0810 13:54:15.104995 (+8597676us) ts_tablet_manager.cc:1151] Deleting tablet d891e763a1854b6a8bda1071448fd8e0
0810 13:54:15.105053 (+ 58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.105366 (+ 313us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8587614}
I20260810 13:54:15.116801 13639 raft_consensus.cc:385] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:15.117168 13639 raft_consensus.cc:740] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:15.117245 15348 tablet_replica.cc:333] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:15.117851 13639 consensus_queue.cc:260] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.118335 15348 raft_consensus.cc:2243] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:15.118957 15348 raft_consensus.cc:2272] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:15.120460 13639 ts_tablet_manager.cc:1434] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.063s user 0.004s sys 0.002s
I20260810 13:54:15.129637 15348 ts_tablet_manager.cc:1916] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:15.131495 13638 tablet_bootstrap.cc:654] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:15.135638 16015 tablet.cc:1724] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260810 13:54:14.996656 16012 raft_consensus.cc:2749] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:15.139554 16098 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9666026fb7e4c85b46c6aab952932fb. Latest consensus state: current_term: 2 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:15.149022 16098 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: This master's current role is: LEADER
I20260810 13:54:15.082048 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 64e93928dcb94ae296590c4dedfd1781 (table default.Table_fbe0f651fe2e4328b7e2a126d989afab [id=da2f9e6861694d889e45f1fc34a63469]) successfully deleted
W20260810 13:54:15.151117 12717 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 69094.7us
W20260810 13:54:15.151852 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae0c1bb5bf6b4a97b49e2eea18d4ae9c already in progress: creating tablet
W20260810 13:54:15.152421 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet 34b2314b771f41188bc8101c5ddffaf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 34b2314b771f41188bc8101c5ddffaf4 already in progress: creating tablet
I20260810 13:54:15.153964 16001 raft_consensus.cc:493] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:15.154052 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet a7fb3f80f940435a902c355cb699b434 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7fb3f80f940435a902c355cb699b434 already in progress: creating tablet
W20260810 13:54:15.154623 12717 catalog_manager.cc:5030] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): delete failed for tablet d891e763a1854b6a8bda1071448fd8e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d891e763a1854b6a8bda1071448fd8e0 already in progress: creating tablet
W20260810 13:54:15.143263 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet b0b44a300d4b4f41854371735ecbab1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b0b44a300d4b4f41854371735ecbab1a already in progress: creating tablet
I20260810 13:54:15.154474 16001 raft_consensus.cc:515] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.156574 16001 leader_election.cc:290] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:15.157992 16049 consensus_queue.cc:1048] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:15.160485 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:15.161845 13382 leader_election.cc:343] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.163118 16012 raft_consensus.cc:493] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:15.168460 16012 raft_consensus.cc:515] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.171411 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b35d369474ba9bee379089796bd3c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:15.173139 13260 raft_consensus.cc:2468] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:15.174326 12952 leader_election.cc:304] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:15.175076 15982 raft_consensus.cc:2804] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:15.175415 15982 raft_consensus.cc:493] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:15.175714 15982 raft_consensus.cc:3060] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:15.185218 16012 leader_election.cc:290] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:15.187604 15982 raft_consensus.cc:515] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.190135 13639 tablet_bootstrap.cc:492] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:15.195482 16095 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:15.201037 16110 log.cc:927] Time spent T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20260810 13:54:15.202126 16049 raft_consensus.cc:493] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:15.203131 16049 raft_consensus.cc:515] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.205641 16049 leader_election.cc:290] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:15.206702 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:15.207019 15702 ts_tablet_manager.cc:1929] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:54:15.207423 15702 log.cc:1199] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/a43def9358894b2aa001a7db56706589
I20260810 13:54:15.207337 13472 raft_consensus.cc:2468] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:15.208562 13164 leader_election.cc:304] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:15.209158 13638 tablet_bootstrap.cc:492] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:15.209374 16049 raft_consensus.cc:2804] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:15.209592 13638 ts_tablet_manager.cc:1403] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.159s user 0.009s sys 0.005s
I20260810 13:54:15.209738 16049 raft_consensus.cc:493] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:15.210083 16049 raft_consensus.cc:3060] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:15.211840 13382 leader_election.cc:343] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.215021 13472 raft_consensus.cc:1275] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260810 13:54:15.220562 13638 raft_consensus.cc:359] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.221251 13638 raft_consensus.cc:385] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:15.221503 13638 raft_consensus.cc:740] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:15.227309 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a1b35d369474ba9bee379089796bd3c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:15.227993 13260 raft_consensus.cc:3060] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:15.230508 13638 consensus_queue.cc:260] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.235140 13640 tablet_bootstrap.cc:492] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:15.235608 13640 ts_tablet_manager.cc:1403] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.184s user 0.030s sys 0.032s
I20260810 13:54:15.238389 13638 ts_tablet_manager.cc:1434] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.027s user 0.005s sys 0.000s
I20260810 13:54:15.243580 13639 tablet_bootstrap.cc:654] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:15.249428 13638 tablet_bootstrap.cc:492] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:15.250712 13640 raft_consensus.cc:359] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.251330 13640 raft_consensus.cc:385] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:15.251596 13640 raft_consensus.cc:740] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:15.259435 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:15.270417 16049 raft_consensus.cc:515] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.245386 15982 leader_election.cc:290] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:15.248960 15702 ts_tablet_manager.cc:1950] T a43def9358894b2aa001a7db56706589 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:15.248790 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:15.251714 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:15.252260 13640 consensus_queue.cc:260] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.275805 13640 ts_tablet_manager.cc:1434] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.040s user 0.007s sys 0.000s
I20260810 13:54:15.290030 16116 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260810 13:54:15.296030 13638 tablet_bootstrap.cc:654] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:15.309507 13640 tablet_bootstrap.cc:492] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:15.317663 13260 raft_consensus.cc:2468] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:15.319315 13640 tablet_bootstrap.cc:654] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:15.324297 12952 leader_election.cc:304] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:15.339679 16121 consensus_queue.cc:1048] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:15.333137 15938 raft_consensus.cc:2804] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:15.342422 15938 raft_consensus.cc:697] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:15.343317 15938 consensus_queue.cc:237] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.345247 16049 leader_election.cc:290] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:15.347566 12747 master_service.cc:960] ReplaceTablet: received request to replace tablet 0a6893b0b32646f6aeb72c866251a112 from {username='slave'} at 127.0.0.1:48758
I20260810 13:54:15.354023 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 557) took 3475 ms. Trace:
I20260810 13:54:15.354390 15702 rpcz_store.cc:276] 0810 13:54:11.878234 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.880755 (+ 2521us) service_pool.cc:224] Handling call
0810 13:54:14.971720 (+3090965us) ts_tablet_manager.cc:1151] Deleting tablet a43def9358894b2aa001a7db56706589
0810 13:54:14.971763 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.095686 (+123923us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:15.206876 (+111190us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:15.353963 (+147087us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25372,"tablet-delete.queue_time_us":2688346}
I20260810 13:54:15.355890 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 558) took 3477 ms. Trace:
I20260810 13:54:15.361825 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:15.362389 13477 raft_consensus.cc:3060] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:15.367666 16072 raft_consensus.cc:493] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:15.368161 16072 raft_consensus.cc:515] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.359016 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:15.370362 16072 leader_election.cc:290] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:15.357933 15702 rpcz_store.cc:276] 0810 13:54:11.878501 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:12.290925 (+412424us) service_pool.cc:224] Handling call
0810 13:54:15.355531 (+3064606us) ts_tablet_manager.cc:1151] Deleting tablet 995d901d22484799bd79fcad8103b8a5
0810 13:54:15.355575 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.355836 (+ 261us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3063232}
I20260810 13:54:15.371412 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 566) took 2708 ms. Trace:
I20260810 13:54:15.371714 15702 rpcz_store.cc:276] 0810 13:54:12.662856 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:12.662967 (+ 111us) service_pool.cc:224] Handling call
0810 13:54:15.371050 (+2708083us) ts_tablet_manager.cc:1151] Deleting tablet de012d382b194bf193fef76779abcf17
0810 13:54:15.371092 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.371358 (+ 266us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2701939}
I20260810 13:54:15.372802 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 567) took 2709 ms. Trace:
I20260810 13:54:15.373090 15702 rpcz_store.cc:276] 0810 13:54:12.663466 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:12.672490 (+ 9024us) service_pool.cc:224] Handling call
0810 13:54:15.372480 (+2699990us) ts_tablet_manager.cc:1151] Deleting tablet 3610bc4f8a0742fdb69347b40a04f078
0810 13:54:15.372515 (+ 35us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.372752 (+ 237us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2699342}
I20260810 13:54:15.374024 15702 tablet_replica.cc:333] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:15.380282 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:15.382512 13382 leader_election.cc:343] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.382694 13477 raft_consensus.cc:2468] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:15.384898 13041 raft_consensus.cc:3060] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:15.386571 13164 leader_election.cc:304] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:15.387251 16050 raft_consensus.cc:2804] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:15.387753 16050 raft_consensus.cc:697] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:15.388217 13638 tablet_bootstrap.cc:492] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:15.388616 13638 ts_tablet_manager.cc:1403] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.139s user 0.009s sys 0.005s
I20260810 13:54:15.388957 16050 consensus_queue.cc:237] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.391196 13638 raft_consensus.cc:359] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.391804 13638 raft_consensus.cc:385] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:15.392071 13638 raft_consensus.cc:740] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:15.393356 13638 consensus_queue.cc:260] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.395454 13638 ts_tablet_manager.cc:1434] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260810 13:54:15.400738 16121 consensus_queue.cc:1048] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:15.404908 16121 consensus_queue.cc:1048] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:15.406569 13640 tablet_bootstrap.cc:492] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:15.407002 13640 ts_tablet_manager.cc:1403] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.098s user 0.012s sys 0.001s
I20260810 13:54:15.408080 16012 consensus_queue.cc:1048] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:15.432777 15702 raft_consensus.cc:2243] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:15.433367 15702 raft_consensus.cc:2272] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 13:54:15.436993 12951 consensus_peers.cc:597] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5aa1374d37a4918af34a5e9b15c16b3. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:15.441900 13561 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.12.36.60:38017)
I20260810 13:54:15.445240 16012 consensus_queue.cc:1048] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260810 13:54:15.449589 15214 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 2 FOLLOWER]: Refusing update from remote peer d9666026fb7e4c85b46c6aab952932fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 556. Preceding OpId from leader: term: 2 index: 819. (index mismatch)
I20260810 13:54:15.452253 16098 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 819, Last known committed idx: 556, Time since last communication: 0.000s
W20260810 13:54:15.456208 12951 leader_election.cc:343] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 3a1b35d369474ba9bee379089796bd3c
W20260810 13:54:15.458328 12951 leader_election.cc:343] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 3a1b35d369474ba9bee379089796bd3c
I20260810 13:54:15.460072 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a1b35d369474ba9bee379089796bd3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:15.462527 13233 tablet_service.cc:1558] Processing DeleteTablet for tablet d5aa1374d37a4918af34a5e9b15c16b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:42314
I20260810 13:54:15.463301 13239 tablet_service.cc:1558] Processing DeleteTablet for tablet 65c3b03d5f1543b28ea6c439c3cfb07e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:09 UTC) from {username='slave'} at 127.0.0.1:42314
W20260810 13:54:15.432499 12746 catalog_manager.cc:6772] Illegal state: an error occurred while writing to the sys-catalog: replica 1298bde14cec4cd3a9d6338c7d47f0b7 is not leader of this config: current role FOLLOWER
I20260810 13:54:15.465415 13638 tablet_bootstrap.cc:492] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:15.471203 16128 raft_consensus.cc:493] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:15.433739 12749 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:15.471732 16128 raft_consensus.cc:515] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.455379 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:15.474515 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:15.435190 15702 ts_tablet_manager.cc:1916] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:15.474833 16128 leader_election.cc:290] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:15.475832 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:15.475330 12739 catalog_manager.cc:5719] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:15.476496 12739 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
W20260810 13:54:15.477262 13382 leader_election.cc:343] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.477286 12739 catalog_manager.cc:5719] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
E20260810 13:54:15.468171 12836 catalog_manager.cc:826] Error processing pending assignments: Illegal state: error persisting updated tablet metadata: Replica 1298bde14cec4cd3a9d6338c7d47f0b7 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:15.488075 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:15.460266 12745 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 105) took 1942 ms (client timeout 1000 ms). Trace:
W20260810 13:54:15.488816 12745 rpcz_store.cc:269] 0810 13:54:13.517502 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.517633 (+ 131us) service_pool.cc:224] Handling call
0810 13:54:15.460199 (+1942566us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4}
W20260810 13:54:15.490249 12749 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 107) took 2282 ms (client timeout 1000 ms). Trace:
W20260810 13:54:15.490619 12749 rpcz_store.cc:269] 0810 13:54:13.191149 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.191368 (+ 219us) service_pool.cc:224] Handling call
0810 13:54:13.309282 (+117914us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b54000104d4. stack: 00007fec673bfcf3 00007fec673bfbf0 00007fec66f6d574 0000000000516de4 0000000000516d79 00007fec6e4c1470 00007fec6e56031a 00007fec702ca05c 00007fec703c6c7e 00007fec6df74fb4 00007fec6df74f42 00007fec6df74e71 00007fec6df74dec 00007fec6df740a2 00007fec6c22207c 00007fec6c2214b6
0810 13:54:15.473764 (+2164482us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":35609984}
I20260810 13:54:15.494825 13639 tablet_bootstrap.cc:492] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:15.495289 13639 ts_tablet_manager.cc:1403] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.305s user 0.008s sys 0.002s
I20260810 13:54:15.498457 13639 raft_consensus.cc:359] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.499154 13639 raft_consensus.cc:385] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:15.499472 13639 raft_consensus.cc:740] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:15.500170 16095 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:15.500727 16095 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:15.505318 13640 raft_consensus.cc:359] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.505981 13640 raft_consensus.cc:385] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:15.506242 13640 raft_consensus.cc:740] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:15.506906 13640 consensus_queue.cc:260] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.517248 15348 ts_tablet_manager.cc:1929] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:15.517374 12765 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 2 FOLLOWER]: Refusing update from remote peer d9666026fb7e4c85b46c6aab952932fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 818. Preceding OpId from leader: term: 2 index: 819. (index mismatch)
I20260810 13:54:15.517709 15348 log.cc:1199] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/8fa729726a7f4603b0f5085a56cf89f6
I20260810 13:54:15.518577 15348 ts_tablet_manager.cc:1950] T 8fa729726a7f4603b0f5085a56cf89f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:15.519145 16048 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 819, Last known committed idx: 818, Time since last communication: 0.000s
I20260810 13:54:15.528003 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 524) took 8346 ms. Trace:
I20260810 13:54:15.528378 15348 rpcz_store.cc:276] 0810 13:54:07.182017 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.182115 (+ 98us) service_pool.cc:224] Handling call
0810 13:54:15.117043 (+7934928us) ts_tablet_manager.cc:1151] Deleting tablet 8fa729726a7f4603b0f5085a56cf89f6
0810 13:54:15.117102 (+ 59us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.404765 (+287663us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:15.517115 (+112350us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:15.527931 (+ 10816us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7924700}
I20260810 13:54:15.533811 12717 catalog_manager.cc:5050] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): tablet 8fa729726a7f4603b0f5085a56cf89f6 (table default.Table_e383a6bbbf2247478200482d22a378e3 [id=223e495b001c43a8b728880aafcdb751]) successfully deleted
I20260810 13:54:15.534228 15348 tablet_replica.cc:333] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:15.534942 15348 raft_consensus.cc:2243] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:15.535422 15348 raft_consensus.cc:2272] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:15.537462 16095 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:15.539608 13639 consensus_queue.cc:260] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.542868 15214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 818 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:15.543682 15214 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1298bde14cec4cd3a9d6338c7d47f0b7 in term 2.
E20260810 13:54:15.481292 12739 catalog_manager.cc:5874] Error updating tablets from 218e946161f64d1d92427684ac15e4fb: Illegal state: replica 1298bde14cec4cd3a9d6338c7d47f0b7 is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: true updated_tablets { tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "953f83dab3ca406f8638e446911614b0" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" state: RUNNING consensus_state { current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27319 live_row_count: 0 } } updated_tablets { tablet_id: "b449377349514576874b6c295ead5e9a" state: RUNNING consensus_state { current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } } } schema_version: 2 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "ac9e3d3430044a5e85e2d812b7e221f5" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "1ee6e694366543328526313d7018b5db" state: RUNNING consensus_state { current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27275 live_row_count: 0 } } updated_tablets { tablet_id: "3a1b35d369474ba9bee379089796bd3c" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } removed_tablet_ids: "fb30ebe9520d4224bdfd45a5e915d8bd" sequence_number: 105
I20260810 13:54:15.546501 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d; no voters:
I20260810 13:54:15.553524 15348 ts_tablet_manager.cc:1916] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:15.547819 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:15.555727 13639 ts_tablet_manager.cc:1434] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.060s user 0.006s sys 0.001s
I20260810 13:54:15.556136 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:15.556344 13041 raft_consensus.cc:2468] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:15.558236 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:15.558946 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]). Expected version 1 got 0
I20260810 13:54:15.559700 12744 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]). Expected version 1 got 0
I20260810 13:54:15.565208 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:15.571022 12721 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet a43def9358894b2aa001a7db56706589 (table default.Table_25022662dc9f47efbf32de19c684ea1b [id=fb2df53a2f9540d88c5c64b110471c2e]) successfully deleted
W20260810 13:54:15.571755 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 995d901d22484799bd79fcad8103b8a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 995d901d22484799bd79fcad8103b8a5 already in progress: creating tablet
W20260810 13:54:15.572386 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet de012d382b194bf193fef76779abcf17 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de012d382b194bf193fef76779abcf17 already in progress: creating tablet
W20260810 13:54:15.573006 12721 catalog_manager.cc:5030] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): delete failed for tablet 3610bc4f8a0742fdb69347b40a04f078 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3610bc4f8a0742fdb69347b40a04f078 already in progress: creating tablet
W20260810 13:54:15.573715 13382 leader_election.cc:343] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.575476 13382 leader_election.cc:304] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:15.577647 16072 raft_consensus.cc:2749] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:15.576807 12750 catalog_manager.cc:5719] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 1 to 2, leader changed from 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3) to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 2 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:15.582098 12750 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:15.594447 13640 ts_tablet_manager.cc:1434] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.187s user 0.009s sys 0.000s
W20260810 13:54:15.599012 13167 leader_election.cc:343] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:15.601971 13382 leader_election.cc:343] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.602422 13382 leader_election.cc:304] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:15.603164 16128 raft_consensus.cc:2749] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:15.603483 13382 leader_election.cc:343] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.603857 13382 leader_election.cc:304] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:15.604467 16128 raft_consensus.cc:2749] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:15.605532 13640 tablet_bootstrap.cc:492] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:15.605510 13639 tablet_bootstrap.cc:492] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:15.607771 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
E20260810 13:54:15.586086 12750 catalog_manager.cc:5874] Error updating tablets from 88ed04d733ec447583fc897e233dd4b3: Illegal state: replica 1298bde14cec4cd3a9d6338c7d47f0b7 is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: true updated_tablets { tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" state: RUNNING consensus_state { current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" state: RUNNING consensus_state { current_term: 2 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } } } schema_version: 3 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27760 live_row_count: 0 } } updated_tablets { tablet_id: "65c3b03d5f1543b28ea6c439c3cfb07e" state: RUNNING consensus_state { current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { } } updated_tablets { tablet_id: "1ee6e694366543328526313d7018b5db" state: RUNNING consensus_state { current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "b449377349514576874b6c295ead5e9a" state: RUNNING consensus_state { current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } } } schema_version: 2 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27350 live_row_count: 0 } } updated_tablets { tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" state: RUNNING consensus_state { current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27350 live_row_count: 0 } } updated_tablets { tablet_id: "d5aa1374d37a4918af34a5e9b15c16b3" state: RUNNING consensus_state { current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27241 live_row_count: 0 } } updated_tablets { tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" state: RUNNING consensus_state { current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 27541 live_row_count: 0 } } sequence_number: 100
W20260810 13:54:15.640551 12739 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:48345 (request call id 106) took 1101 ms (client timeout 1000 ms). Trace:
W20260810 13:54:15.641063 12739 rpcz_store.cc:269] 0810 13:54:14.539317 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:14.539480 (+ 163us) service_pool.cc:224] Handling call
0810 13:54:15.481098 (+941618us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:15.481118 (+ 20us) write_op.cc:454] Released schema lock
0810 13:54:15.640481 (+159363us) inbound_call.cc:177] Queueing failure response
Related trace 'op':
0810 13:54:15.480912 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 1298bde14cec4cd3a9d6338c7d47f0b7 is not leader of this config: current role FOLLOWER)
0810 13:54:15.480944 (+ 32us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:15.480961 (+ 17us) write_op.cc:454] Released schema lock
0810 13:54:15.480980 (+ 19us) write_op.cc:335] FINISH: Op aborted
Metrics: {"reported_tablets":9,"child_traces":[["op",{}]]}
I20260810 13:54:15.644083 13638 tablet_bootstrap.cc:654] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:15.646715 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet 73ad47d29d61456891478a9544594a94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:03 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:54:15.647990 12744 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:34657 (request call id 108) took 1468 ms (client timeout 1000 ms). Trace:
W20260810 13:54:15.650038 12750 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:47731 (request call id 101) took 958 ms (client timeout 1000 ms). Trace:
W20260810 13:54:15.649608 12744 rpcz_store.cc:269] 0810 13:54:14.179739 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:14.179878 (+ 139us) service_pool.cc:224] Handling call
0810 13:54:15.647901 (+1468023us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":9}
W20260810 13:54:15.650465 12750 rpcz_store.cc:269] 0810 13:54:14.691316 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:14.691453 (+ 137us) service_pool.cc:224] Handling call
0810 13:54:15.585879 (+894426us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:15.585900 (+ 21us) write_op.cc:454] Released schema lock
0810 13:54:15.649978 (+ 64078us) inbound_call.cc:177] Queueing failure response
Related trace 'op':
0810 13:54:15.585677 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica 1298bde14cec4cd3a9d6338c7d47f0b7 is not leader of this config: current role FOLLOWER)
0810 13:54:15.585717 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:15.585748 (+ 31us) write_op.cc:454] Released schema lock
0810 13:54:15.585766 (+ 18us) write_op.cc:335] FINISH: Op aborted
Metrics: {"reported_tablets":8,"child_traces":[["op",{}]]}
I20260810 13:54:15.658041 13423 tablet_service.cc:1558] Processing DeleteTablet for tablet 9453eab70fa04df8b0c89e6caf54c894 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:41 UTC) from {username='slave'} at 127.0.0.1:43224
I20260810 13:54:15.658387 13448 tablet_service.cc:1558] Processing DeleteTablet for tablet 8fa729726a7f4603b0f5085a56cf89f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:53:47 UTC) from {username='slave'} at 127.0.0.1:43224
W20260810 13:54:15.663450 13167 leader_election.cc:343] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.679658 13640 tablet_bootstrap.cc:654] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:15.685434 16141 tablet_replica.cc:333] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:15.703593 16001 raft_consensus.cc:493] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:15.704137 16001 raft_consensus.cc:515] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.705466 16143 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:15.707315 16001 leader_election.cc:290] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:15.709996 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfbb2036c800469f90ad4d5d211ac462" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:15.710561 16095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9666026fb7e4c85b46c6aab952932fb. Latest consensus state: current_term: 2 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
W20260810 13:54:15.712080 13382 leader_election.cc:343] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.714195 16095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:54:15.733323 16143 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:15.733877 16143 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:15.739001 13638 tablet_bootstrap.cc:492] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:15.739711 13638 ts_tablet_manager.cc:1403] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.274s user 0.001s sys 0.013s
I20260810 13:54:15.750795 16141 raft_consensus.cc:2243] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:15.751430 16141 raft_consensus.cc:2272] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:15.751274 15938 consensus_queue.cc:1048] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:15.753656 16141 ts_tablet_manager.cc:1916] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:15.782469 16048 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:15.782961 16049 raft_consensus.cc:493] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:15.783355 16048 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: This master's current role is: LEADER
I20260810 13:54:15.783468 16049 raft_consensus.cc:515] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.784956 13640 tablet_bootstrap.cc:492] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:15.785355 13640 ts_tablet_manager.cc:1403] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.181s user 0.007s sys 0.008s
I20260810 13:54:15.786828 15938 consensus_queue.cc:1048] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:15.787770 13640 raft_consensus.cc:359] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.788373 13640 raft_consensus.cc:385] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:15.788635 13640 raft_consensus.cc:740] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:15.789796 13640 consensus_queue.cc:260] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.792949 16049 leader_election.cc:290] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:15.797430 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:15.798007 13480 raft_consensus.cc:2468] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:15.799149 13164 leader_election.cc:304] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:15.799970 16049 raft_consensus.cc:2804] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:15.800390 16049 raft_consensus.cc:493] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:15.801175 16049 raft_consensus.cc:3060] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:15.803889 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:15.826857 13640 ts_tablet_manager.cc:1434] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.041s user 0.007s sys 0.000s
I20260810 13:54:15.829502 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:15.831384 13638 raft_consensus.cc:359] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.832557 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfbb2036c800469f90ad4d5d211ac462" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:15.844578 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6453dd9e48244c87b339ec515898bb0c consensus state has no leader
I20260810 13:54:15.835968 13640 tablet_bootstrap.cc:492] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:15.849713 13638 raft_consensus.cc:385] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:15.851814 13382 leader_election.cc:343] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.852625 13382 leader_election.cc:304] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:15.853447 16001 raft_consensus.cc:2749] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:15.850603 13167 leader_election.cc:343] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:15.856853 13638 raft_consensus.cc:740] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:15.816191 16143 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:15.876868 12765 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 3 FOLLOWER]: Rejecting Update request from peer d9666026fb7e4c85b46c6aab952932fb for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:15.812327 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9f48e93a010b4fc5b43124a1f8248ddf [id=011f63bf5ea44f918070a9ead229fa95]
I20260810 13:54:15.883523 16157 consensus_queue.cc:1059] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 }, Status: INVALID_TERM, Last received: 2.819, Next index: 820, Last known committed idx: 818, Time since last communication: 0.001s
I20260810 13:54:15.884756 16048 raft_consensus.cc:3055] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:15.885303 16048 raft_consensus.cc:740] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9666026fb7e4c85b46c6aab952932fb, State: Running, Role: LEADER
I20260810 13:54:15.886569 16048 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 819, Committed index: 819, Last appended: 2.819, Last appended by leader: 819, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:15.888290 16048 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:15.903396 15214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 819 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d"
I20260810 13:54:15.904371 15214 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:15.927340 13640 tablet_bootstrap.cc:654] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:15.928742 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e317f4e20e124c60bbed5450c6c3ca07 [id=01638b930a5e4b46925cdbfd23f204ea]
W20260810 13:54:15.907894 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47478.4us
I20260810 13:54:15.949781 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_230d8010fef046048e532692ee7681c8 [id=01dba6a69dec44aeb2f402dddb3e0cae]
I20260810 13:54:15.952256 15702 ts_tablet_manager.cc:1929] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:15.952829 15702 log.cc:1199] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/ba05f4940220459f951adf3491f60b93
I20260810 13:54:15.954617 15702 ts_tablet_manager.cc:1950] T ba05f4940220459f951adf3491f60b93 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:15.963578 15214 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1298bde14cec4cd3a9d6338c7d47f0b7 in term 3.
I20260810 13:54:15.965787 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]
I20260810 13:54:15.901600 16143 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 3 election: Requested vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:15.970165 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e8a597f1c0ec4cd8878f49046eb45e66 [id=047df8b2dabc4682a2227e841b10a53c]
I20260810 13:54:15.970860 12836 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 13:54:15.976761 13638 consensus_queue.cc:260] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:15.980118 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d; no voters:
I20260810 13:54:15.980978 16143 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:15.982692 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8054f93e82de4c898987acb86f25e5d0 [id=0685b3b0945a493db836d29e5993e447]
I20260810 13:54:15.982193 16143 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 3 LEADER]: Becoming Leader. State: Replica: 1298bde14cec4cd3a9d6338c7d47f0b7, State: Running, Role: LEADER
I20260810 13:54:15.984449 16143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 818, Committed index: 818, Last appended: 2.819, Last appended by leader: 819, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:15.995942 13638 ts_tablet_manager.cc:1434] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.256s user 0.003s sys 0.003s
I20260810 13:54:15.997902 13638 tablet_bootstrap.cc:492] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:16.006167 12473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:16.008250 16165 log.cc:927] Time spent T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.111s user 0.000s sys 0.000s
I20260810 13:54:16.019613 13639 tablet_bootstrap.cc:654] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:16.031533 15348 ts_tablet_manager.cc:1929] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:16.032065 15348 log.cc:1199] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/ba05f4940220459f951adf3491f60b93
I20260810 13:54:15.984486 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a8f5484f0ff14287be783696e6d8525d [id=06f3859cd5e748a3800b66ecf0a93c28]
I20260810 13:54:16.038192 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]
I20260810 13:54:16.040582 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b392780f45ab4b899ddb12eefbcdd556 [id=0a7b7ff4685e4a8884b4aab7a835890d]
W20260810 13:54:16.044641 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 141097us
I20260810 13:54:16.046087 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3fb4e7e2f617464f930b338a8ece6e38 [id=0acde9f8e2f7483c9eb7f3df14b0859d]
I20260810 13:54:16.071610 16095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1298bde14cec4cd3a9d6338c7d47f0b7. Latest consensus state: current_term: 3 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:16.072314 16095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: This master's current role is: LEADER
I20260810 13:54:16.090592 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_88dee97116de4d0dac8a7af552b06f14 [id=0b34e431b94a4d24ad26858d4630420f]
I20260810 13:54:16.092152 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 571) took 2916 ms. Trace:
I20260810 13:54:16.092368 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f0a8373b96114e0c896e54dcb940f74d [id=0c70c375ac604d158df38f374fc3c1d1]
I20260810 13:54:16.092567 16050 raft_consensus.cc:493] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:16.093043 16050 raft_consensus.cc:515] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.094977 16050 leader_election.cc:290] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:16.087325 13640 tablet_bootstrap.cc:492] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:16.096593 13640 ts_tablet_manager.cc:1403] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.262s user 0.013s sys 0.021s
I20260810 13:54:16.097237 16050 raft_consensus.cc:493] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:16.096882 15348 ts_tablet_manager.cc:1950] T ba05f4940220459f951adf3491f60b93 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:16.097673 16050 raft_consensus.cc:515] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.099156 13640 raft_consensus.cc:359] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.099705 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 523) took 8918 ms. Trace:
I20260810 13:54:16.099792 13640 raft_consensus.cc:385] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:16.100555 13640 raft_consensus.cc:740] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:16.100970 16050 leader_election.cc:290] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:16.101272 13640 consensus_queue.cc:260] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.102828 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b82b59b066c4240a387e7de48de9c70" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:16.103410 13474 raft_consensus.cc:2468] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:16.105309 13640 ts_tablet_manager.cc:1434] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.008s user 0.003s sys 0.002s
I20260810 13:54:16.106784 13164 leader_election.cc:304] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:16.110728 16121 raft_consensus.cc:2804] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:16.111081 16121 raft_consensus.cc:493] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:16.111991 16121 raft_consensus.cc:3060] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:16.112965 13640 tablet_bootstrap.cc:492] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:16.116393 16177 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260810 13:54:16.126904 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_1668535b5107458a842c0def2c55461f [id=0cdd1449d5734d559f49933deef6bb19]
I20260810 13:54:16.130394 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]
I20260810 13:54:16.100170 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:16.149324 13480 raft_consensus.cc:2468] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:16.100003 15348 rpcz_store.cc:276] 0810 13:54:07.181757 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.184642 (+ 2885us) service_pool.cc:224] Handling call
0810 13:54:15.534083 (+8349441us) ts_tablet_manager.cc:1151] Deleting tablet ba05f4940220459f951adf3491f60b93
0810 13:54:15.534127 (+ 44us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.705079 (+170952us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:16.031380 (+326301us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:16.099650 (+ 68270us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8341410}
I20260810 13:54:16.151063 13640 tablet_bootstrap.cc:654] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:16.170039 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 527) took 8202 ms. Trace:
I20260810 13:54:16.170624 15348 rpcz_store.cc:276] 0810 13:54:07.967814 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.967922 (+ 108us) service_pool.cc:224] Handling call
0810 13:54:16.169641 (+8201719us) ts_tablet_manager.cc:1151] Deleting tablet 1a4fe8abad5649f2a42686c00148d957
0810 13:54:16.169691 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.169971 (+ 280us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8100576}
I20260810 13:54:16.171921 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9]
I20260810 13:54:16.172210 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 528) took 8204 ms. Trace:
I20260810 13:54:16.175284 15348 rpcz_store.cc:276] 0810 13:54:07.968095 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.969320 (+ 1225us) service_pool.cc:224] Handling call
0810 13:54:16.171702 (+8202382us) ts_tablet_manager.cc:1151] Deleting tablet d0e488e3e89047b18178c9cb64d74bef
0810 13:54:16.171745 (+ 43us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.172152 (+ 407us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8102015}
I20260810 13:54:16.160310 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:16.179410 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 526) took 8217 ms. Trace:
I20260810 13:54:16.161510 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b82b59b066c4240a387e7de48de9c70" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:16.180239 12729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 0.675s (SENT) [suppressed 2 similar messages]
I20260810 13:54:16.180207 13639 tablet_bootstrap.cc:492] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:16.181545 13639 ts_tablet_manager.cc:1403] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.576s user 0.009s sys 0.011s
I20260810 13:54:16.183575 15348 rpcz_store.cc:276] 0810 13:54:07.966432 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.966993 (+ 561us) service_pool.cc:224] Handling call
0810 13:54:16.179104 (+8212111us) ts_tablet_manager.cc:1151] Deleting tablet 8d647bf5c1ba42f48186661310065448
0810 13:54:16.179143 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.179360 (+ 217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8109277}
I20260810 13:54:16.186789 15702 rpcz_store.cc:276] 0810 13:54:13.175906 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.178724 (+ 2818us) service_pool.cc:224] Handling call
0810 13:54:15.373892 (+2195168us) ts_tablet_manager.cc:1151] Deleting tablet ba05f4940220459f951adf3491f60b93
0810 13:54:15.373928 (+ 36us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.680829 (+306901us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:15.856234 (+175405us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:16.092083 (+235849us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57816,"tablet-delete.queue_time_us":2193964}
I20260810 13:54:16.187291 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 529) took 8217 ms. Trace:
I20260810 13:54:16.187562 15348 rpcz_store.cc:276] 0810 13:54:07.970103 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:07.971089 (+ 986us) service_pool.cc:224] Handling call
0810 13:54:16.186986 (+8215897us) ts_tablet_manager.cc:1151] Deleting tablet ff9ccbe2b9e3466dbc5fd23b2ea5a6a4
0810 13:54:16.187025 (+ 39us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.187242 (+ 217us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8096609}
I20260810 13:54:16.188822 15348 tablet_replica.cc:333] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:16.189479 13640 tablet_bootstrap.cc:492] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:16.191152 13640 ts_tablet_manager.cc:1403] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.079s user 0.009s sys 0.004s
I20260810 13:54:16.193970 13640 raft_consensus.cc:359] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.190436 15348 raft_consensus.cc:2243] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:16.200567 15348 raft_consensus.cc:2272] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:16.202309 15348 ts_tablet_manager.cc:1916] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:16.200135 13640 raft_consensus.cc:385] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:16.205464 13640 raft_consensus.cc:740] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:16.206233 13640 consensus_queue.cc:260] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.206558 16050 raft_consensus.cc:493] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:16.207446 16050 raft_consensus.cc:515] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.208228 13640 ts_tablet_manager.cc:1434] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260810 13:54:16.209996 16050 leader_election.cc:290] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:16.205027 16175 log.cc:927] Time spent T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.102s user 0.000s sys 0.000s
I20260810 13:54:16.006891 16141 ts_tablet_manager.cc:1929] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:16.025363 16049 raft_consensus.cc:515] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.219587 16049 leader_election.cc:290] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:16.221051 16141 log.cc:1199] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/3a1b35d369474ba9bee379089796bd3c
I20260810 13:54:16.221400 13640 tablet_bootstrap.cc:492] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:16.222837 16141 ts_tablet_manager.cc:1950] T 3a1b35d369474ba9bee379089796bd3c P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
W20260810 13:54:16.225534 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 45321.8us
I20260810 13:54:16.226186 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_94153e136b9f4ea9aeb589c1a0322981 [id=12299e0dca554badab42ee7a73ea9723]
I20260810 13:54:16.240840 16168 raft_consensus.cc:493] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:16.234809 13639 raft_consensus.cc:359] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.156576 16121 raft_consensus.cc:515] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.233721 13638 tablet_bootstrap.cc:654] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:16.243168 13639 raft_consensus.cc:385] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:16.249719 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e424bd25638b4b23b721c8529aa42285 [id=126e0229d9904feba5c16222cecf5140]
I20260810 13:54:16.246966 13639 raft_consensus.cc:740] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:16.252447 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_72e9522a295642b28aa17f724e010d9e [id=143a3ec1ee2d409fa9de19aa1c8c8ab3]
W20260810 13:54:16.256553 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:16.271064 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 570) took 3095 ms. Trace:
I20260810 13:54:16.271577 15702 rpcz_store.cc:276] 0810 13:54:13.175656 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.178231 (+ 2575us) service_pool.cc:224] Handling call
0810 13:54:16.215474 (+3037243us) ts_tablet_manager.cc:1151] Deleting tablet b820c99b33264add8df5fd443981d0cc
0810 13:54:16.270769 (+ 55295us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.270996 (+ 227us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3035424}
I20260810 13:54:16.273072 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 569) took 3097 ms. Trace:
I20260810 13:54:16.273484 15702 rpcz_store.cc:276] 0810 13:54:13.175376 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.178033 (+ 2657us) service_pool.cc:224] Handling call
0810 13:54:16.272711 (+3094678us) ts_tablet_manager.cc:1151] Deleting tablet 613d7ddce24b45c886139bf68c3c9a4d
0810 13:54:16.272757 (+ 46us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.273016 (+ 259us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3092427}
I20260810 13:54:16.262360 13639 consensus_queue.cc:260] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.300740 16180 consensus_queue.cc:1048] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:16.241650 16168 raft_consensus.cc:515] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.305186 16168 leader_election.cc:290] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:16.306843 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9453eab70fa04df8b0c89e6caf54c894" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:16.307459 13260 raft_consensus.cc:2468] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:16.309466 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2695264893564646a621e76ff6443e84 [id=147b038d3de54c8d85e666747153cb7d]
I20260810 13:54:16.309894 12952 leader_election.cc:304] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:16.312870 16168 raft_consensus.cc:2804] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:16.313308 16168 raft_consensus.cc:493] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:16.313753 16168 raft_consensus.cc:3060] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:16.314399 13639 ts_tablet_manager.cc:1434] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.131s user 0.011s sys 0.004s
W20260810 13:54:16.317955 13167 leader_election.cc:343] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:16.318974 13167 leader_election.cc:343] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:16.322185 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]
I20260810 13:54:16.324312 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 572) took 2002 ms. Trace:
I20260810 13:54:16.324766 15702 rpcz_store.cc:276] 0810 13:54:14.310327 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:14.310496 (+ 169us) service_pool.cc:224] Handling call
0810 13:54:16.274448 (+1963952us) ts_tablet_manager.cc:1151] Deleting tablet e828861d499a400c834b848acdb2afc5
0810 13:54:16.274490 (+ 42us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.312659 (+ 38169us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1949310}
I20260810 13:54:16.325937 15702 tablet_replica.cc:333] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:16.326812 15702 raft_consensus.cc:2243] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:16.327791 15702 raft_consensus.cc:2272] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:16.330957 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68]
I20260810 13:54:16.329896 13639 tablet_bootstrap.cc:492] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:16.340658 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9453eab70fa04df8b0c89e6caf54c894" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:16.341676 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:16.365468 13050 raft_consensus.cc:3060] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:16.342767 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b82b59b066c4240a387e7de48de9c70" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:16.374169 13050 raft_consensus.cc:2468] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:16.380466 15702 ts_tablet_manager.cc:1916] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:16.385027 16128 raft_consensus.cc:493] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:16.386118 16128 raft_consensus.cc:515] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.389693 13640 tablet_bootstrap.cc:654] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:16.394999 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c752da6252ce4541be9cef2bce47bfe3 [id=178f273145a74eb2a2de7da53f248126]
I20260810 13:54:16.396355 16128 leader_election.cc:290] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:16.448791 13382 consensus_peers.cc:597] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:16.453306 16121 leader_election.cc:290] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:16.462949 15348 ts_tablet_manager.cc:1929] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:16.463559 15348 log.cc:1199] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/32721630ac494c07b015c02f4741cad8
I20260810 13:54:16.464442 15348 ts_tablet_manager.cc:1950] T 32721630ac494c07b015c02f4741cad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:16.465577 16196 tablet.cc:1724] T fe5796052fd94c1e8fce159a6a90830c P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:16.467093 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d]
I20260810 13:54:16.479501 13640 tablet_bootstrap.cc:492] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:16.480754 13640 ts_tablet_manager.cc:1403] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.260s user 0.004s sys 0.017s
I20260810 13:54:16.486347 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_57980e60ac6549c8b24861967f6cc198 [id=18ade4a3af044a498725f45a06e04b81]
I20260810 13:54:16.488125 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]
W20260810 13:54:16.499979 13167 consensus_peers.cc:597] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:16.501119 13167 leader_election.cc:343] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:16.501847 13167 leader_election.cc:304] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:16.513391 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 66716us
I20260810 13:54:16.514369 13164 leader_election.cc:304] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:16.515276 16185 raft_consensus.cc:2804] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:16.515897 16185 raft_consensus.cc:697] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:16.520120 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9453eab70fa04df8b0c89e6caf54c894" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:16.521034 13474 raft_consensus.cc:2468] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:16.527557 16050 raft_consensus.cc:2804] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:16.528069 16050 raft_consensus.cc:493] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:16.528517 16050 raft_consensus.cc:3060] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:16.506608 12473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:16.531777 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 [id=19cf8ac217b34ed1b6ceccb40508fd56]
W20260810 13:54:16.533233 12952 consensus_peers.cc:597] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a1b35d369474ba9bee379089796bd3c. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:16.530089 13639 tablet_bootstrap.cc:654] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:16.517148 16185 consensus_queue.cc:237] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.550740 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]
I20260810 13:54:16.534731 16198 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:16.550599 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 48806.5us
I20260810 13:54:16.551435 16198 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:16.554622 15209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 819 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:16.522799 13640 raft_consensus.cc:359] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.557710 13640 raft_consensus.cc:385] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:16.558156 13640 raft_consensus.cc:740] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:16.558526 16186 raft_consensus.cc:493] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:16.559088 16186 raft_consensus.cc:515] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.559191 13640 consensus_queue.cc:260] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.561911 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9453eab70fa04df8b0c89e6caf54c894" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:16.562602 13477 raft_consensus.cc:2468] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:16.576445 13638 tablet_bootstrap.cc:492] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:16.578325 16186 leader_election.cc:290] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:16.581285 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:16.581571 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b82b59b066c4240a387e7de48de9c70" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:16.581979 13477 raft_consensus.cc:3060] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:16.582180 13476 raft_consensus.cc:3060] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:16.595854 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 530) took 7616 ms. Trace:
I20260810 13:54:16.596650 16198 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:16.596410 15348 rpcz_store.cc:276] 0810 13:54:08.979368 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:08.979472 (+ 104us) service_pool.cc:224] Handling call
0810 13:54:16.188650 (+7209178us) ts_tablet_manager.cc:1151] Deleting tablet 32721630ac494c07b015c02f4741cad8
0810 13:54:16.188713 (+ 63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.247392 (+ 58679us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:16.462661 (+215269us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:16.595748 (+133087us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3457,"tablet-delete.queue_time_us":7208635}
I20260810 13:54:16.599831 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 544) took 7338 ms. Trace:
I20260810 13:54:16.600255 15348 rpcz_store.cc:276] 0810 13:54:09.261591 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:09.263212 (+ 1621us) service_pool.cc:224] Handling call
0810 13:54:16.599327 (+7336115us) ts_tablet_manager.cc:1151] Deleting tablet 247fb8b09c12407d8535c07c5d0687fe
0810 13:54:16.599422 (+ 95us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.599773 (+ 351us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7335394}
I20260810 13:54:16.601706 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 546) took 7339 ms. Trace:
I20260810 13:54:16.609520 16168 raft_consensus.cc:515] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.610826 13040 raft_consensus.cc:2393] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:16.613014 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_98fbef24cbef43679502dae9e67e35cf [id=1e5fe6bb81ec41d3be1b189a0631e695]
I20260810 13:54:16.615571 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]
I20260810 13:54:16.639317 13638 ts_tablet_manager.cc:1403] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.642s user 0.014s sys 0.004s
W20260810 13:54:16.602089 13164 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 65404.5us
W20260810 13:54:16.643052 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:16.651302 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:16.659029 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:16.664443 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6d071c01702c4d3cb0e693f02ef8a90f [id=20edfa4b7c00446bae121b000f8faf5f]
I20260810 13:54:16.665910 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:16.613307 13476 raft_consensus.cc:2468] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:16.630810 13477 raft_consensus.cc:2468] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:16.596087 13640 ts_tablet_manager.cc:1434] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.112s user 0.007s sys 0.000s
W20260810 13:54:16.679668 13382 leader_election.cc:343] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:16.692128 13638 raft_consensus.cc:359] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.692893 13638 raft_consensus.cc:385] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:16.693770 16186 raft_consensus.cc:493] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:16.693905 16168 leader_election.cc:290] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:16.694235 16186 raft_consensus.cc:515] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.696146 16186 leader_election.cc:290] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:16.688884 15348 rpcz_store.cc:276] 0810 13:54:09.262701 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:09.263043 (+ 342us) service_pool.cc:224] Handling call
0810 13:54:16.601250 (+7338207us) ts_tablet_manager.cc:1151] Deleting tablet 11e3902adc094227830cf6ddab916916
0810 13:54:16.601303 (+ 53us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.601656 (+ 353us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7336790}
I20260810 13:54:16.707983 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:16.710526 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9453eab70fa04df8b0c89e6caf54c894" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:16.711328 13258 raft_consensus.cc:3060] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:16.712431 13640 tablet_bootstrap.cc:492] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:16.720238 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_734de53e103d480c93e2779ef687142e [id=23152d9b944747f89cd06ee3a569b5b3]
I20260810 13:54:16.722276 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2a27c95d054b44dd84ede3639a6395c5 [id=232f082ff5eb446bbb2e7869e83b2449]
I20260810 13:54:16.724347 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]
I20260810 13:54:16.607388 16050 raft_consensus.cc:515] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.633358 16141 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 581) took 1173 ms. Trace:
I20260810 13:54:16.727198 16141 rpcz_store.cc:276] 0810 13:54:15.459798 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.459941 (+ 143us) service_pool.cc:224] Handling call
0810 13:54:15.685213 (+225272us) ts_tablet_manager.cc:1151] Deleting tablet 3a1b35d369474ba9bee379089796bd3c
0810 13:54:15.685268 (+ 55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:15.942114 (+256846us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:16.006753 (+ 64639us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:16.633279 (+626526us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64189,"tablet-delete.queue_time_us":224660,"thread_start_us":245955,"threads_started":1}
I20260810 13:54:16.733664 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 554) took 6637 ms. Trace:
I20260810 13:54:16.734097 15348 rpcz_store.cc:276] 0810 13:54:10.096579 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.107724 (+ 11145us) service_pool.cc:224] Handling call
0810 13:54:16.701864 (+6594140us) ts_tablet_manager.cc:1151] Deleting tablet fd22f04344954142922942fc4b7cb157
0810 13:54:16.732774 (+ 30910us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.733599 (+ 825us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6580837}
I20260810 13:54:16.734180 16202 tablet.cc:1724] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:16.735817 15348 tablet_replica.cc:333] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:16.738243 16186 consensus_queue.cc:1048] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:16.693172 13638 raft_consensus.cc:740] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:16.742242 13638 consensus_queue.cc:260] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.744871 13638 ts_tablet_manager.cc:1434] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.105s user 0.007s sys 0.000s
W20260810 13:54:16.746311 13382 leader_election.cc:343] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:16.746696 13382 leader_election.cc:304] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:16.747716 16186 raft_consensus.cc:2749] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:16.749275 12951 consensus_peers.cc:597] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a1b35d369474ba9bee379089796bd3c. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:16.752307 13382 leader_election.cc:343] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:16.766901 13640 tablet_bootstrap.cc:654] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:16.769874 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_004ad2bd15214f94a0c183ec75f725ca [id=240ee1976c8f40c59438f7f22839e297]
I20260810 13:54:16.771575 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]
I20260810 13:54:16.773312 16050 leader_election.cc:290] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:16.805425 16141 tablet_replica.cc:333] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:16.806403 16141 raft_consensus.cc:2243] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:16.806933 16141 raft_consensus.cc:2272] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:16.807631 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]
I20260810 13:54:16.809607 16141 ts_tablet_manager.cc:1916] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:16.813490 13258 raft_consensus.cc:2468] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:16.818825 15702 ts_tablet_manager.cc:1929] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:16.816566 13638 tablet_bootstrap.cc:492] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:16.825513 13164 leader_election.cc:304] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:16.832664 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]
I20260810 13:54:16.841197 13640 tablet_bootstrap.cc:492] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:16.842173 15702 log.cc:1199] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:16.844929 16185 raft_consensus.cc:2764] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:16.848704 13640 ts_tablet_manager.cc:1403] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.136s user 0.008s sys 0.004s
I20260810 13:54:16.851655 13640 raft_consensus.cc:359] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.852317 13640 raft_consensus.cc:385] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:16.853368 15702 ts_tablet_manager.cc:1950] T ac9e3d3430044a5e85e2d812b7e221f5 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:16.855856 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]
W20260810 13:54:16.858588 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5579f4f12fb9495390d8261d24d120d8 consensus state has no leader
I20260810 13:54:16.862365 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 573) took 2492 ms. Trace:
I20260810 13:54:16.860389 16185 consensus_queue.cc:1048] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260810 13:54:16.867358 16185 consensus_queue.cc:1048] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:16.869817 13638 tablet_bootstrap.cc:654] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:16.856326 13639 tablet_bootstrap.cc:492] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:16.876368 13164 leader_election.cc:304] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:16.873334 15702 rpcz_store.cc:276] 0810 13:54:14.370254 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:14.370836 (+ 582us) service_pool.cc:224] Handling call
0810 13:54:16.325777 (+1954941us) ts_tablet_manager.cc:1151] Deleting tablet ac9e3d3430044a5e85e2d812b7e221f5
0810 13:54:16.325824 (+ 47us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.721636 (+395812us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:16.818680 (+ 97044us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:16.862297 (+ 43617us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1954349}
I20260810 13:54:16.889058 16121 raft_consensus.cc:2804] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:16.889546 16121 raft_consensus.cc:697] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:16.852597 13640 raft_consensus.cc:740] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:16.890401 16121 consensus_queue.cc:237] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.895792 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]
I20260810 13:54:16.897466 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_40e69780eeb744aa8a192c8623bc7d4b [id=2ef48298f4404224bb44136ff71befd8]
I20260810 13:54:16.892762 13640 consensus_queue.cc:260] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.900182 13640 ts_tablet_manager.cc:1434] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.051s user 0.005s sys 0.000s
W20260810 13:54:16.902209 12729 leader_election.cc:336] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317): Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 0.675s (SENT)
I20260810 13:54:16.887121 13639 ts_tablet_manager.cc:1403] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.560s user 0.031s sys 0.021s
W20260810 13:54:16.913493 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 130475us
I20260810 13:54:16.918251 13640 tablet_bootstrap.cc:492] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:16.928109 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:16.942945 13638 tablet_bootstrap.cc:492] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:16.943921 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]
I20260810 13:54:16.961696 13638 ts_tablet_manager.cc:1403] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.145s user 0.009s sys 0.002s
I20260810 13:54:16.962373 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:54:16.965437 12729 leader_election.cc:336] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317): Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 0.531s (SENT)
I20260810 13:54:16.965389 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:16.966002 13477 raft_consensus.cc:3060] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:16.975387 13477 raft_consensus.cc:2468] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:16.977721 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]
W20260810 13:54:16.977860 12473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:16.981052 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]
I20260810 13:54:16.983085 13640 tablet_bootstrap.cc:654] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:16.983024 13638 raft_consensus.cc:359] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:16.990790 12952 leader_election.cc:304] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:16.991757 16204 raft_consensus.cc:2804] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:16.992599 16204 raft_consensus.cc:697] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:16.993640 16204 consensus_queue.cc:237] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.006114 15702 tablet_replica.cc:333] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:17.006937 15702 raft_consensus.cc:2243] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:17.007718 15702 raft_consensus.cc:2272] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:17.014065 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_da87a4b83c12422e999c5b88c825d890 [id=3064108a10bd4f76b2be6614ebed22fc]
I20260810 13:54:17.015040 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9453eab70fa04df8b0c89e6caf54c894" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:17.015637 13480 raft_consensus.cc:3060] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:17.021169 16128 raft_consensus.cc:493] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:17.021636 16128 raft_consensus.cc:515] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:17.023641 16128 leader_election.cc:290] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:17.026322 15702 ts_tablet_manager.cc:1916] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 13:54:17.040705 13382 leader_election.cc:343] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.043711 13640 tablet_bootstrap.cc:492] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:17.044139 13640 ts_tablet_manager.cc:1403] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.126s user 0.011s sys 0.000s
I20260810 13:54:17.047753 13640 raft_consensus.cc:359] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.048543 13640 raft_consensus.cc:385] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:17.056792 13382 leader_election.cc:343] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.057394 13382 leader_election.cc:304] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:17.058553 16128 raft_consensus.cc:2749] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:17.059497 16128 raft_consensus.cc:493] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:17.059504 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]
I20260810 13:54:17.059967 16128 raft_consensus.cc:515] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.062167 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6]
I20260810 13:54:17.062358 16128 leader_election.cc:290] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:17.064505 13480 raft_consensus.cc:2468] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
W20260810 13:54:17.076628 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:17.032768 13167 leader_election.cc:343] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:17.086205 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 53499.1us
I20260810 13:54:17.049269 13640 raft_consensus.cc:740] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.089744 13638 raft_consensus.cc:385] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.089440 13640 consensus_queue.cc:260] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.090306 13638 raft_consensus.cc:740] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.091164 13640 ts_tablet_manager.cc:1434] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20260810 13:54:17.092228 13640 tablet_bootstrap.cc:492] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:17.097930 16219 tablet.cc:1724] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:17.064850 16141 ts_tablet_manager.cc:1929] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:17.101881 16141 log.cc:1199] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/d5aa1374d37a4918af34a5e9b15c16b3
I20260810 13:54:17.102859 16141 ts_tablet_manager.cc:1950] T d5aa1374d37a4918af34a5e9b15c16b3 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:17.106189 16141 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 582) took 1644 ms. Trace:
I20260810 13:54:17.109506 13639 raft_consensus.cc:359] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.110155 13639 raft_consensus.cc:385] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.110414 13639 raft_consensus.cc:740] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.110453 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:17.110998 13639 consensus_queue.cc:260] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.115458 15348 raft_consensus.cc:2243] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:17.115991 15348 raft_consensus.cc:2272] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:17.118281 15348 ts_tablet_manager.cc:1916] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:17.118336 13639 ts_tablet_manager.cc:1434] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.208s user 0.017s sys 0.005s
I20260810 13:54:17.124517 16186 raft_consensus.cc:493] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:17.125308 16186 raft_consensus.cc:515] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.127189 16186 leader_election.cc:290] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:17.126953 13639 tablet_bootstrap.cc:492] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:17.129878 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c]
I20260810 13:54:17.131750 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dfe0fd41b106448e8a729e593ac63e5a [id=342af46254364715a3eb6166299c7275]
I20260810 13:54:17.109154 15213 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 3 FOLLOWER]: Rejecting Update request from peer d9666026fb7e4c85b46c6aab952932fb for earlier term 2. Current term is 3. Ops: [1.557-2.819]
I20260810 13:54:17.159065 15702 ts_tablet_manager.cc:1929] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:17.160867 15702 log.cc:1199] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/d5aa1374d37a4918af34a5e9b15c16b3
I20260810 13:54:17.173336 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4b2d4fca101f4cbc9f296c50ca183066 [id=35087d7e2d0642a59670773333dda055]
I20260810 13:54:17.180787 15702 ts_tablet_manager.cc:1950] T d5aa1374d37a4918af34a5e9b15c16b3 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
W20260810 13:54:17.182166 12471 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.584s (SENT) [suppressed 1 similar messages]
I20260810 13:54:17.183377 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:17.185989 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:17.196399 13640 tablet_bootstrap.cc:654] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:17.213541 13639 tablet_bootstrap.cc:654] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:17.217667 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9d26366e03454a73ae877683e6700ff0 [id=3587a6d27d294470ac7551a3bb96a701]
I20260810 13:54:17.223484 16141 rpcz_store.cc:276] 0810 13:54:15.461697 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.462245 (+ 548us) service_pool.cc:224] Handling call
0810 13:54:16.728740 (+1266495us) ts_tablet_manager.cc:1151] Deleting tablet d5aa1374d37a4918af34a5e9b15c16b3
0810 13:54:16.805273 (+ 76533us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:16.858996 (+ 53723us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:17.064672 (+205676us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:17.106127 (+ 41455us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1265773}
W20260810 13:54:17.229403 13382 leader_election.cc:343] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.230038 13382 leader_election.cc:304] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:17.233547 16186 raft_consensus.cc:2749] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:17.235404 15348 ts_tablet_manager.cc:1929] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:17.235832 15348 log.cc:1199] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/350b68f6c1cf48ff8e5f8521e5a4dad6
W20260810 13:54:17.243865 13382 leader_election.cc:343] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: a43def9358894b2aa001a7db56706589
I20260810 13:54:17.221014 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_51b05316075a49bc898ede0e35031c70 [id=359af78e1c844299a56756c90613d641]
W20260810 13:54:17.246266 13382 leader_election.cc:343] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.188117 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:17.221355 13164 leader_election.cc:304] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:17.248339 16121 raft_consensus.cc:2804] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:17.248842 16121 raft_consensus.cc:697] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:17.249701 16121 consensus_queue.cc:237] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.222064 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:17.091003 13638 consensus_queue.cc:260] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.256119 13638 ts_tablet_manager.cc:1434] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.276s user 0.005s sys 0.000s
I20260810 13:54:17.258033 13638 tablet_bootstrap.cc:492] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:17.266633 13639 tablet_bootstrap.cc:492] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:17.267088 13639 ts_tablet_manager.cc:1403] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.142s user 0.008s sys 0.002s
W20260810 13:54:17.267665 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 46402.3us
I20260810 13:54:17.271920 16141 tablet_replica.cc:333] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:17.277439 15348 ts_tablet_manager.cc:1950] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:17.278944 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]
I20260810 13:54:17.307911 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2416e07beb8d42a6a48de9dab42936cf [id=39551fb5d1804467bb58d5b00de27be4]
I20260810 13:54:17.319684 13640 tablet_bootstrap.cc:492] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:17.320214 13640 ts_tablet_manager.cc:1403] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.228s user 0.011s sys 0.000s
I20260810 13:54:17.323057 13640 raft_consensus.cc:359] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.323813 13640 raft_consensus.cc:385] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.324339 13640 raft_consensus.cc:740] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.325073 13640 consensus_queue.cc:260] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.327150 13640 ts_tablet_manager.cc:1434] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260810 13:54:17.327551 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 81317.2us
I20260810 13:54:17.328220 13639 raft_consensus.cc:359] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.328948 13639 raft_consensus.cc:385] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.329212 13639 raft_consensus.cc:740] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.329872 13639 consensus_queue.cc:260] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.341591 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]
I20260810 13:54:17.347016 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d460b63b63de413ebdeeb708b4be6b10 [id=3d7325460d7842658631298c2538a71c]
I20260810 13:54:17.351416 13638 tablet_bootstrap.cc:654] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:17.361241 15702 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50548 (request call id 574) took 2989 ms. Trace:
I20260810 13:54:17.361452 13639 ts_tablet_manager.cc:1434] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.094s user 0.007s sys 0.001s
I20260810 13:54:17.361562 15702 rpcz_store.cc:276] 0810 13:54:14.372651 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:14.373110 (+ 459us) service_pool.cc:224] Handling call
0810 13:54:16.890940 (+2517830us) ts_tablet_manager.cc:1151] Deleting tablet d5aa1374d37a4918af34a5e9b15c16b3
0810 13:54:17.005972 (+115032us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:17.088290 (+ 82318us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:17.158937 (+ 70647us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:17.361182 (+202245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28602,"tablet-delete.queue_time_us":2505593}
I20260810 13:54:17.362398 13639 tablet_bootstrap.cc:492] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:17.378558 16141 raft_consensus.cc:2243] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:17.379290 16141 raft_consensus.cc:2272] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:17.381901 16141 ts_tablet_manager.cc:1916] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:17.376755 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 558) took 7244 ms. Trace:
I20260810 13:54:17.384989 15348 rpcz_store.cc:276] 0810 13:54:10.132185 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.132328 (+ 143us) service_pool.cc:224] Handling call
0810 13:54:16.735611 (+6603283us) ts_tablet_manager.cc:1151] Deleting tablet 350b68f6c1cf48ff8e5f8521e5a4dad6
0810 13:54:16.735662 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:17.126740 (+391078us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:17.235275 (+108535us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:17.376614 (+141339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":378492,"tablet-delete.queue_time_us":6547992}
I20260810 13:54:17.386415 15348 tablet_replica.cc:333] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
W20260810 13:54:17.387939 13382 leader_election.cc:343] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.378078 13640 tablet_bootstrap.cc:492] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:17.394694 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4f780597fcec4261acd040c8816826c4 [id=3e00d0fc074747809ebc1f6b3696649d]
I20260810 13:54:17.398515 13040 raft_consensus.cc:3060] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:17.402307 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a0e9339c31fa470380def2ad49326176 [id=3e51b3dca7144d7b8494e0a36e61706a]
W20260810 13:54:17.415560 13382 leader_election.cc:343] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: a43def9358894b2aa001a7db56706589
I20260810 13:54:17.416019 13382 leader_election.cc:304] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:17.431624 12473 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:17.420725 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]
I20260810 13:54:17.438391 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fd80397e5f4247339b3e3d483a671afa [id=3f7a51368fe34ca6b66f5c810e94ae60]
I20260810 13:54:17.453577 16012 raft_consensus.cc:493] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:17.454468 13639 tablet_bootstrap.cc:654] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:17.454090 16012 raft_consensus.cc:515] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.456853 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_83164f9e96c540f58a5af47229b70854 [id=3f7f1db8228e4efa9b34bc33cb13be40]
I20260810 13:54:17.463258 16012 leader_election.cc:290] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:17.475970 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 [id=3fa9cd2a62034a4d81a0b740d5c31447]
I20260810 13:54:17.481031 13640 tablet_bootstrap.cc:654] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:17.483496 13639 tablet_bootstrap.cc:492] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:17.502225 16128 raft_consensus.cc:2749] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:17.505636 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 90108.7us
I20260810 13:54:17.516999 13639 ts_tablet_manager.cc:1403] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.155s user 0.010s sys 0.003s
I20260810 13:54:17.517061 13638 tablet_bootstrap.cc:492] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:17.517486 13638 ts_tablet_manager.cc:1403] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.260s user 0.013s sys 0.004s
I20260810 13:54:17.520008 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_57828eb9ca764faf923e3e68fd0233a8 [id=3fff8bc92af84e59a10a592e85ad8503]
I20260810 13:54:17.521536 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e9c73c2f54b54ea485cdcadc15b0a420 [id=41772225716845f794c8c7d1ab21fd32]
I20260810 13:54:17.527518 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b82b59b066c4240a387e7de48de9c70" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:17.530357 13639 raft_consensus.cc:359] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.531051 13639 raft_consensus.cc:385] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.531319 13639 raft_consensus.cc:740] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.531929 13639 consensus_queue.cc:260] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:17.535567 13382 leader_election.cc:343] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.539062 13382 leader_election.cc:304] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:17.519948 13638 raft_consensus.cc:359] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.543123 13638 raft_consensus.cc:385] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.543758 13638 raft_consensus.cc:740] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.544456 16232 raft_consensus.cc:493] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:17.545096 16232 raft_consensus.cc:515] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.545356 13638 consensus_queue.cc:260] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.550388 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_def78e8fb6b74845bf2ef24bcef6691b [id=42af124147fe44c1875a9803af2e97a9]
I20260810 13:54:17.547171 16232 leader_election.cc:290] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:17.551601 16128 raft_consensus.cc:2749] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:17.552772 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]
W20260810 13:54:17.553122 13382 leader_election.cc:343] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.554234 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f7160fbf49d74f79b79a300e67af5cbf [id=440aa3e8a24a415eb98a448b4848e76d]
I20260810 13:54:17.555651 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]
I20260810 13:54:17.558158 13639 ts_tablet_manager.cc:1434] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260810 13:54:17.559127 13639 tablet_bootstrap.cc:492] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:17.573686 13638 ts_tablet_manager.cc:1434] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.056s user 0.006s sys 0.001s
I20260810 13:54:17.594417 13382 leader_election.cc:304] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:17.595546 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:17.607977 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:17.609153 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c39a51586fe847b990c6d2c59e2280ff [id=44428a121dc24f5ba5e5d74158f9f4d0]
I20260810 13:54:17.582909 13640 tablet_bootstrap.cc:492] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:17.613320 13640 ts_tablet_manager.cc:1403] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.235s user 0.007s sys 0.004s
I20260810 13:54:17.615924 16186 raft_consensus.cc:2749] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:17.618338 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 65244us
I20260810 13:54:17.623814 13640 raft_consensus.cc:359] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.624522 13640 raft_consensus.cc:385] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.626891 13639 tablet_bootstrap.cc:654] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:17.630129 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_51d643dcb2a5451e9cff367f2b3649c5 [id=46372d6eedfe4d56b2f2ce9a85f7f1fc]
I20260810 13:54:17.631453 16121 raft_consensus.cc:493] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:17.631911 16121 raft_consensus.cc:515] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.633864 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_586e39daebb14dfaa08b3cc251eeb18a [id=46490c79e3814a82b21ab79f2a53814e]
I20260810 13:54:17.634012 16121 leader_election.cc:290] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:17.638021 13167 leader_election.cc:343] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.664932 16232 raft_consensus.cc:493] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:17.665499 16232 raft_consensus.cc:515] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.665944 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]
I20260810 13:54:17.667469 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_87c087a440044f9483716cce60bb4777 [id=4777400951884e84a747cbc635b6a087]
I20260810 13:54:17.667794 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b82b59b066c4240a387e7de48de9c70" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:17.668594 13477 raft_consensus.cc:2393] T 8b82b59b066c4240a387e7de48de9c70 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:17.674892 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:17.676347 16232 leader_election.cc:290] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:17.680459 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:17.624812 13640 raft_consensus.cc:740] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.695030 13639 tablet_bootstrap.cc:492] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:17.695510 13639 ts_tablet_manager.cc:1403] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.137s user 0.010s sys 0.000s
I20260810 13:54:17.695005 13640 consensus_queue.cc:260] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.697031 13640 ts_tablet_manager.cc:1434] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.083s user 0.006s sys 0.001s
I20260810 13:54:17.698187 13639 raft_consensus.cc:359] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.698845 13639 raft_consensus.cc:385] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.699138 13639 raft_consensus.cc:740] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.700106 13638 tablet_bootstrap.cc:492] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:17.699744 13639 consensus_queue.cc:260] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.705641 13638 tablet_bootstrap.cc:654] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:17.713244 13167 leader_election.cc:343] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.713403 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1]
I20260810 13:54:17.714888 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f6d23e8eec824ef08b26dec8c7c6d010 [id=4d373c8f174b46e99209a83ab947b204]
I20260810 13:54:17.716302 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_276835c42e5a48309351dd4e441cc62f [id=4d5771db00ae42b9957c6453d83f81ae]
W20260810 13:54:17.716988 12951 consensus_peers.cc:597] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:17.719216 12951 leader_election.cc:304] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:17.719866 16244 raft_consensus.cc:3060] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:17.722116 13167 leader_election.cc:343] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:17.734701 13639 ts_tablet_manager.cc:1434] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.039s user 0.007s sys 0.000s
W20260810 13:54:17.736622 12952 consensus_peers.cc:597] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:17.747553 13638 tablet_bootstrap.cc:492] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:17.747979 13638 ts_tablet_manager.cc:1403] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.048s user 0.007s sys 0.001s
I20260810 13:54:17.752137 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:17.752995 13477 raft_consensus.cc:2468] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:17.761899 16141 ts_tablet_manager.cc:1929] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:17.762291 16141 log.cc:1199] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/65c3b03d5f1543b28ea6c439c3cfb07e
W20260810 13:54:17.762780 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 43633us
I20260810 13:54:17.763085 16141 ts_tablet_manager.cc:1950] T 65c3b03d5f1543b28ea6c439c3cfb07e P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:17.765864 13640 tablet_bootstrap.cc:492] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:17.769347 13639 tablet_bootstrap.cc:492] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:17.774138 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_312808fed3bf45e8923e2b1be7f4d9fa [id=4de804595a6142819c0ea2f64fd1e34c]
I20260810 13:54:17.777150 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_10638f441f654317829d436d2e7eb979 [id=4f21b5213a724ce5989d7684473d65e9]
I20260810 13:54:17.782847 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d171e1a65676495882912f18dddff2ee [id=4f6c1859cd1a481da7b9b3c2013365c3]
I20260810 13:54:17.753464 13638 raft_consensus.cc:359] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.798923 13638 raft_consensus.cc:385] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.799217 13638 raft_consensus.cc:740] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.800403 13638 consensus_queue.cc:260] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.802249 16244 raft_consensus.cc:2749] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:17.807569 13639 tablet_bootstrap.cc:654] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:17.798128 12471 leader_election.cc:336] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.584s (SENT)
I20260810 13:54:17.824319 12471 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9666026fb7e4c85b46c6aab952932fb; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d
I20260810 13:54:17.827101 15214 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 3 FOLLOWER]: Refusing update from remote peer 1298bde14cec4cd3a9d6338c7d47f0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 556. Preceding OpId from leader: term: 3 index: 820. (index mismatch)
I20260810 13:54:17.830240 15214 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51102 (request call id 3) took 1370 ms. Trace:
I20260810 13:54:17.830583 15214 rpcz_store.cc:276] 0810 13:54:16.459638 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:16.459797 (+ 159us) service_pool.cc:224] Handling call
0810 13:54:17.826616 (+1366819us) raft_consensus.cc:1471] Updating replica for 0 ops
0810 13:54:17.827538 (+ 922us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:17.830034 (+ 2496us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400040450. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90268951 00007efd902fec8d 00007efd9135d229 00007efd8f9dbd34 00007efd8f9dbcc2 00007efd8f9dbbf1 00007efd8f9dbb6c 00007efd8f9dae22 00007efd8dfca07c 00007efd8dfc94b6 00007efd8dfc8e5f
0810 13:54:17.830174 (+ 140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3142794112}
I20260810 13:54:17.831820 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e16662a9b5514b04b2d2fad48ad3d82f [id=51cc3d6cb6d248fc94d93654adfc72c0]
I20260810 13:54:17.838384 13638 ts_tablet_manager.cc:1434] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.090s user 0.008s sys 0.003s
I20260810 13:54:17.850704 16261 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260810 13:54:17.851469 12471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 53396.6us
I20260810 13:54:17.858423 13164 leader_election.cc:304] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:17.863230 13639 tablet_bootstrap.cc:492] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:17.863688 13639 ts_tablet_manager.cc:1403] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.095s user 0.006s sys 0.004s
I20260810 13:54:17.871270 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]
W20260810 13:54:17.874394 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d5aa1374d37a4918af34a5e9b15c16b3 (table default.Table_1be07447c0034861a4616ab195eb8e46 [id=6b29e21f3d24403c8fe03d131e5edb38], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d5aa1374d37a4918af34a5e9b15c16b3 consensus state has no leader
I20260810 13:54:17.875057 16263 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 820, Last known committed idx: 556, Time since last communication: 0.001s
I20260810 13:54:17.878269 16141 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42314 (request call id 583) took 2416 ms. Trace:
I20260810 13:54:17.861001 15213 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51926 (request call id 3) took 1937 ms. Trace:
I20260810 13:54:17.881495 16232 raft_consensus.cc:2804] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:17.882952 16232 raft_consensus.cc:493] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:17.883366 16232 raft_consensus.cc:3060] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:17.883636 13638 tablet_bootstrap.cc:492] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:17.881906 16141 rpcz_store.cc:276] 0810 13:54:15.462042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.463054 (+ 1012us) service_pool.cc:224] Handling call
0810 13:54:17.268375 (+1805321us) ts_tablet_manager.cc:1151] Deleting tablet 65c3b03d5f1543b28ea6c439c3cfb07e
0810 13:54:17.271741 (+ 3366us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:17.656345 (+384604us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:17.761770 (+105425us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:17.870687 (+108917us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a6b52 00007f91209141d9 00007f911fb2c4e8 00007f911fbf3562 00007f911fc240e0 00007f911fc0a64d 00007f911fc0a5f9 00007f911fc0a589 00007f911fc0a551
0810 13:54:17.878193 (+ 7506us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81556,"spinlock_wait_cycles":242196736,"tablet-delete.queue_time_us":1804630}
I20260810 13:54:17.894505 13639 raft_consensus.cc:359] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.895179 13639 raft_consensus.cc:385] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:17.895452 13639 raft_consensus.cc:740] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:17.787842 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:17.813733 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:17.896098 13474 raft_consensus.cc:2468] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:17.896150 13477 raft_consensus.cc:2468] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:17.911396 16185 consensus_queue.cc:1048] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:17.873534 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]
I20260810 13:54:17.900652 15213 rpcz_store.cc:276] 0810 13:54:15.920903 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.921298 (+ 395us) service_pool.cc:224] Handling call
0810 13:54:16.387036 (+465738us) raft_consensus.cc:1471] Updating replica for 263 ops
0810 13:54:17.139962 (+752926us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:17.857073 (+717111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:17.914043 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7c53cfb1808c47e59a8e23b0e6325acd [id=5558467decbe4ca29c989c08073be0de]
I20260810 13:54:17.916280 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]
I20260810 13:54:17.921033 13640 tablet_bootstrap.cc:700] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent opening tablet: real 0.142s user 0.002s sys 0.000s
I20260810 13:54:17.921770 13640 tablet_bootstrap.cc:654] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:17.926847 15348 raft_consensus.cc:2243] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:17.927434 15348 raft_consensus.cc:2272] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:17.896111 13639 consensus_queue.cc:260] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.929816 15348 ts_tablet_manager.cc:1916] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:17.929999 13639 ts_tablet_manager.cc:1434] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.066s user 0.007s sys 0.000s
I20260810 13:54:17.930912 13639 tablet_bootstrap.cc:492] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:17.943408 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]
I20260810 13:54:17.956060 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7e2df1474a324a139e9e31ca581a4f34 [id=5b1484c8fdc64ee6a07bd203fa140fcb]
I20260810 13:54:17.958192 13639 tablet_bootstrap.cc:654] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:17.979571 13638 tablet_bootstrap.cc:654] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:17.985255 16242 consensus_queue.cc:1048] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:17.986408 16244 raft_consensus.cc:493] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:17.986912 16244 raft_consensus.cc:515] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:17.992097 13640 tablet_bootstrap.cc:492] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:17.992586 13640 ts_tablet_manager.cc:1403] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.227s user 0.009s sys 0.002s
I20260810 13:54:17.993803 16242 raft_consensus.cc:493] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:17.994252 16242 raft_consensus.cc:515] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.006464 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_bd734d41b4c04e8fae8551c8d2f341dc [id=5b4eac88920044a7ba18bf40b8783a9d]
I20260810 13:54:18.007216 16242 leader_election.cc:290] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.009441 16267 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.011729 16267 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:17.983355 16232 raft_consensus.cc:515] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.020838 16244 leader_election.cc:290] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.038497 16232 leader_election.cc:290] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.041190 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:54:18.045810 13167 leader_election.cc:343] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:18.053841 16185 consensus_queue.cc:1048] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:18.055263 16185 consensus_queue.cc:1048] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:18.059087 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:18.057958 13164 leader_election.cc:304] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:18.070962 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 99028.8us
I20260810 13:54:18.071995 16050 raft_consensus.cc:2804] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:18.072407 16050 raft_consensus.cc:493] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:18.072892 16050 raft_consensus.cc:3060] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:18.082973 16232 consensus_queue.cc:1048] T 8b82b59b066c4240a387e7de48de9c70 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:18.085345 13164 leader_election.cc:304] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:18.084347 16050 raft_consensus.cc:515] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.090683 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ed026dd607ea4b2e8b1f22bee438879d [id=5b919872756647048ea2e4fecbe78537]
I20260810 13:54:18.103945 16185 raft_consensus.cc:2804] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:18.109965 13638 tablet_bootstrap.cc:492] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:18.091897 16267 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:18.111483 16185 raft_consensus.cc:493] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:18.111918 16185 raft_consensus.cc:3060] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:18.112859 13638 ts_tablet_manager.cc:1403] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.229s user 0.008s sys 0.006s
I20260810 13:54:18.115669 13638 raft_consensus.cc:359] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.122138 16050 leader_election.cc:290] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.120182 13638 raft_consensus.cc:385] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.126753 13638 raft_consensus.cc:740] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.142333 13639 tablet_bootstrap.cc:492] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:18.142767 13639 ts_tablet_manager.cc:1403] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.212s user 0.010s sys 0.000s
I20260810 13:54:18.150655 16274 raft_consensus.cc:493] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.151361 16274 raft_consensus.cc:515] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.157845 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:18.159011 13477 raft_consensus.cc:2468] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:18.160660 16244 raft_consensus.cc:493] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.161267 16244 raft_consensus.cc:515] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.161653 13639 raft_consensus.cc:359] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.162290 13639 raft_consensus.cc:385] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.162529 13639 raft_consensus.cc:740] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.163141 13639 consensus_queue.cc:260] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.163558 16244 leader_election.cc:290] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.167862 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350b68f6c1cf48ff8e5f8521e5a4dad6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:18.137941 13638 consensus_queue.cc:260] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.171509 13638 ts_tablet_manager.cc:1434] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.058s user 0.001s sys 0.006s
I20260810 13:54:18.172473 13638 tablet_bootstrap.cc:492] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:18.177559 13640 raft_consensus.cc:359] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.178272 13640 raft_consensus.cc:385] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.178546 16274 leader_election.cc:290] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:18.183425 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:18.185703 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:18.188364 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:18.138769 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b5e6f89f8d854f7e991193036d4d8321 [id=5d59e07d6bc5465eaaf40d68610bc154]
I20260810 13:54:18.178553 13640 raft_consensus.cc:740] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:18.202448 13167 leader_election.cc:343] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:18.205426 15348 ts_tablet_manager.cc:1929] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:18.206509 16185 raft_consensus.cc:515] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.201366 13639 ts_tablet_manager.cc:1434] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.058s user 0.008s sys 0.000s
I20260810 13:54:18.209192 13640 consensus_queue.cc:260] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.224807 15348 log.cc:1199] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/65c3b03d5f1543b28ea6c439c3cfb07e
I20260810 13:54:18.234794 13639 tablet_bootstrap.cc:492] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:18.235236 12952 leader_election.cc:343] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:18.239522 12952 leader_election.cc:343] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:18.241556 13639 tablet_bootstrap.cc:654] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:18.256995 15348 ts_tablet_manager.cc:1950] T 65c3b03d5f1543b28ea6c439c3cfb07e P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:18.267447 13639 tablet_bootstrap.cc:492] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:18.267855 13040 raft_consensus.cc:3060] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:18.267931 13639 ts_tablet_manager.cc:1403] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.000s
I20260810 13:54:18.270921 13639 raft_consensus.cc:359] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.271700 13639 raft_consensus.cc:385] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.272017 13639 raft_consensus.cc:740] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.279940 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:18.242758 13638 tablet_bootstrap.cc:654] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:18.283183 16185 leader_election.cc:290] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.288763 13639 consensus_queue.cc:260] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.292229 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]
I20260810 13:54:18.294261 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d4a38708152b4705af7eaf9af6ddc436 [id=5edfc8942f7145adae70b892942fbd64]
I20260810 13:54:18.298851 16275 raft_consensus.cc:493] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.299320 16275 raft_consensus.cc:515] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.301581 16275 leader_election.cc:290] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:18.302481 13640 ts_tablet_manager.cc:1434] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.309s user 0.006s sys 0.002s
W20260810 13:54:18.313705 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 113942us
I20260810 13:54:18.314924 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:18.322278 13638 tablet_bootstrap.cc:492] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:18.322748 13638 ts_tablet_manager.cc:1403] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.150s user 0.008s sys 0.005s
I20260810 13:54:18.326680 16050 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.327229 16050 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.330845 16050 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.331745 13638 raft_consensus.cc:359] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.332435 13638 raft_consensus.cc:385] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.332737 13638 raft_consensus.cc:740] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.333439 13638 consensus_queue.cc:260] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.291428 13639 ts_tablet_manager.cc:1434] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.023s user 0.007s sys 0.000s
I20260810 13:54:18.349588 13638 ts_tablet_manager.cc:1434] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.027s user 0.006s sys 0.002s
I20260810 13:54:18.361012 13639 tablet_bootstrap.cc:492] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:18.371091 13639 tablet_bootstrap.cc:654] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:18.372335 12951 leader_election.cc:304] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:18.373298 16242 raft_consensus.cc:2804] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:18.373632 16242 raft_consensus.cc:493] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:18.373963 16242 raft_consensus.cc:3060] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:18.383158 16242 raft_consensus.cc:515] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.386034 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 559) took 8253 ms. Trace:
I20260810 13:54:18.386451 15348 rpcz_store.cc:276] 0810 13:54:10.132488 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:10.132584 (+ 96us) service_pool.cc:224] Handling call
0810 13:54:17.386228 (+7253644us) ts_tablet_manager.cc:1151] Deleting tablet 65c3b03d5f1543b28ea6c439c3cfb07e
0810 13:54:17.386285 (+ 57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:17.942176 (+555891us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:18.205286 (+263110us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:18.385963 (+180677us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":626473,"tablet-delete.queue_time_us":7198416}
I20260810 13:54:18.388337 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:18.388041 13638 tablet_bootstrap.cc:492] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:18.394973 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:18.422348 16232 raft_consensus.cc:493] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.422938 16232 raft_consensus.cc:515] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.425755 16232 leader_election.cc:290] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.467749 13640 tablet_bootstrap.cc:492] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:18.470865 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:18.473456 13639 tablet_bootstrap.cc:492] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:18.473908 13639 ts_tablet_manager.cc:1403] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.113s user 0.012s sys 0.003s
I20260810 13:54:18.477985 13640 tablet_bootstrap.cc:654] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:18.481896 16232 raft_consensus.cc:493] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.482434 16232 raft_consensus.cc:515] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.486868 13638 tablet_bootstrap.cc:654] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:18.497020 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 124770us
W20260810 13:54:18.497802 12951 leader_election.cc:343] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 350b68f6c1cf48ff8e5f8521e5a4dad6
I20260810 13:54:18.497560 13639 raft_consensus.cc:359] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.498351 13639 raft_consensus.cc:385] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.498696 13639 raft_consensus.cc:740] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.499416 13639 consensus_queue.cc:260] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:18.500948 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 134326us
W20260810 13:54:18.502508 13382 leader_election.cc:343] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:18.505162 15348 tablet_replica.cc:333] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:18.506043 15348 raft_consensus.cc:2243] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:18.506768 16242 leader_election.cc:290] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.392979 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_856a1bf64ef9498890c9b6d98edcc8ad [id=60b4f30b701344d79b0c64b4e8127dbd]
I20260810 13:54:18.508984 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8eeb870902124e9696cfa7e98dfa0e88 [id=614fbd4b5dd440cb8f5a6fa4d994266d]
I20260810 13:54:18.498251 12951 leader_election.cc:304] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:18.540896 12951 leader_election.cc:304] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:18.545387 15348 raft_consensus.cc:2272] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:18.547693 15348 ts_tablet_manager.cc:1916] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:18.550753 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:18.551298 13477 raft_consensus.cc:3060] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:18.558714 13638 tablet_bootstrap.cc:492] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:18.559159 13638 ts_tablet_manager.cc:1403] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.176s user 0.007s sys 0.013s
I20260810 13:54:18.559185 13477 raft_consensus.cc:2468] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:18.561751 16244 raft_consensus.cc:2749] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:18.561733 13638 raft_consensus.cc:359] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.562358 13638 raft_consensus.cc:385] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.562633 13638 raft_consensus.cc:740] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.562983 16242 raft_consensus.cc:2749] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:18.563285 13638 consensus_queue.cc:260] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.569830 16232 leader_election.cc:290] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.530652 16296 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.578125 16296 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:18.581379 15213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 819 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:18.582058 15213 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9666026fb7e4c85b46c6aab952932fb in term 3.
I20260810 13:54:18.584102 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb; no voters:
I20260810 13:54:18.587728 16296 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:18.588742 16296 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260810 13:54:18.590346 16296 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:18.591470 16296 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 3 FOLLOWER]: Advancing to term 4
I20260810 13:54:18.594267 13639 ts_tablet_manager.cc:1434] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.120s user 0.010s sys 0.009s
I20260810 13:54:18.614801 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:18.624193 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_32a20912aef145aabc1b19b2b796c682 [id=6180bc58d52049fa82f92dc5e5a6b891]
I20260810 13:54:18.631203 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0cd1166b3e534639918d41544e409ec7 [id=631d4e81ac6b445183e988a0821e0e61]
I20260810 13:54:18.645498 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:18.646107 13468 raft_consensus.cc:3060] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:18.652529 12952 leader_election.cc:343] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:18.648207 13638 ts_tablet_manager.cc:1434] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.083s user 0.009s sys 0.001s
I20260810 13:54:18.660897 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:18.661486 13476 raft_consensus.cc:3060] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:18.669621 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:18.671213 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:18.671741 13480 raft_consensus.cc:2468] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:18.677682 13468 raft_consensus.cc:2468] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:18.678576 13476 raft_consensus.cc:2468] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:18.687165 13640 tablet_bootstrap.cc:492] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:18.687618 13640 ts_tablet_manager.cc:1403] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.220s user 0.005s sys 0.006s
I20260810 13:54:18.689581 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:18.702816 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5d55900f1adf4aca973dbf4e94ca29c3 [id=63c1004ec7f44526929d7b9f809c0e04]
W20260810 13:54:18.685336 12473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 101314us
I20260810 13:54:18.711081 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:18.717175 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:18.717833 13476 raft_consensus.cc:2468] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:18.731868 13639 tablet_bootstrap.cc:492] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:18.731876 16296 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:18.738027 13639 tablet_bootstrap.cc:654] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:18.746651 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:18.756376 13638 tablet_bootstrap.cc:492] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:18.762367 13638 tablet_bootstrap.cc:654] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:18.774430 13639 tablet_bootstrap.cc:492] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:18.774870 13639 ts_tablet_manager.cc:1403] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.043s user 0.008s sys 0.003s
I20260810 13:54:18.782163 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:18.782776 13050 raft_consensus.cc:2468] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:18.782621 13639 raft_consensus.cc:359] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.783325 13639 raft_consensus.cc:385] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.783609 13639 raft_consensus.cc:740] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.784241 13639 consensus_queue.cc:260] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.785300 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:18.793373 13639 ts_tablet_manager.cc:1434] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.018s user 0.005s sys 0.002s
I20260810 13:54:18.794348 13639 tablet_bootstrap.cc:492] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:18.796881 13638 tablet_bootstrap.cc:492] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:18.797297 13638 ts_tablet_manager.cc:1403] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.041s user 0.006s sys 0.004s
I20260810 13:54:18.799782 13638 raft_consensus.cc:359] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.800403 13638 raft_consensus.cc:385] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.802816 13639 tablet_bootstrap.cc:654] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:18.810621 13640 raft_consensus.cc:359] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.811424 13640 raft_consensus.cc:385] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.811745 13640 raft_consensus.cc:740] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.807338 13638 raft_consensus.cc:740] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.834617 13639 tablet_bootstrap.cc:492] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:18.835047 13639 ts_tablet_manager.cc:1403] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.041s user 0.009s sys 0.000s
I20260810 13:54:18.836933 16274 raft_consensus.cc:493] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.837420 16274 raft_consensus.cc:515] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.837610 13639 raft_consensus.cc:359] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.838258 13639 raft_consensus.cc:385] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.838536 13639 raft_consensus.cc:740] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:18.839892 16274 leader_election.cc:290] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:18.828830 13638 consensus_queue.cc:260] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.839154 13639 consensus_queue.cc:260] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.850215 13639 ts_tablet_manager.cc:1434] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260810 13:54:18.855273 13639 tablet_bootstrap.cc:492] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:18.872272 13639 tablet_bootstrap.cc:654] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:18.885447 13167 leader_election.cc:343] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:18.889140 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:18.809499 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_96cdf642a68642ce9fe947569577b42a [id=667ccf7ba20c49b2be82e167aa212ecd]
I20260810 13:54:18.894402 13638 ts_tablet_manager.cc:1434] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.097s user 0.011s sys 0.000s
I20260810 13:54:18.895241 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3ffb4babc30c4b76ae97168cb6dbdeee [id=66920d867573408d811d1fa6b877d355]
I20260810 13:54:18.899691 15213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 819 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d"
I20260810 13:54:18.900306 15213 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 3 FOLLOWER]: Advancing to term 4
I20260810 13:54:18.901101 13164 leader_election.cc:304] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:18.902531 16050 raft_consensus.cc:2804] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:18.902973 16050 raft_consensus.cc:697] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:18.903750 16050 consensus_queue.cc:237] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.907688 15213 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9666026fb7e4c85b46c6aab952932fb in term 4.
I20260810 13:54:18.909299 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb; no voters:
I20260810 13:54:18.910244 16306 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 4 FOLLOWER]: Leader election won for term 4
W20260810 13:54:18.927091 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f425739a239144048975fb15a26d197e consensus state has no leader
I20260810 13:54:18.812620 13640 consensus_queue.cc:260] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.936364 16296 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 4 election: Requested vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:18.939077 13638 tablet_bootstrap.cc:492] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:18.944634 13640 ts_tablet_manager.cc:1434] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.257s user 0.007s sys 0.000s
I20260810 13:54:18.971452 16185 raft_consensus.cc:493] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.972090 16185 raft_consensus.cc:515] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.975373 16185 leader_election.cc:290] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:18.978714 13639 tablet_bootstrap.cc:492] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:18.979135 13639 ts_tablet_manager.cc:1403] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.124s user 0.016s sys 0.017s
I20260810 13:54:18.980201 16306 raft_consensus.cc:697] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 4 LEADER]: Becoming Leader. State: Replica: d9666026fb7e4c85b46c6aab952932fb, State: Running, Role: LEADER
I20260810 13:54:18.983489 13639 raft_consensus.cc:359] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:18.986871 13164 leader_election.cc:343] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:18.989753 13167 leader_election.cc:343] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:18.990222 13167 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:18.987957 13639 raft_consensus.cc:385] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:18.993194 16185 raft_consensus.cc:2749] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:18.991520 13167 leader_election.cc:304] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:18.991636 13639 raft_consensus.cc:740] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:18.997073 13167 consensus_peers.cc:597] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:18.997720 13167 leader_election.cc:343] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:18.946576 16274 raft_consensus.cc:493] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:18.973706 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:19.022570 13480 raft_consensus.cc:3060] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:19.045235 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]
I20260810 13:54:19.047029 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_cc339254bace4b5e87544b721a6493a5 [id=685e6bce7ba5467693e2b0e1c739897b]
I20260810 13:54:19.048561 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]
I20260810 13:54:19.050184 13640 tablet_bootstrap.cc:492] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:19.003738 13382 leader_election.cc:343] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:19.052111 13382 leader_election.cc:304] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:19.053134 16275 raft_consensus.cc:2749] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:19.054735 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 57040.6us
I20260810 13:54:19.011116 16185 consensus_queue.cc:1048] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260810 13:54:19.016592 13638 tablet_bootstrap.cc:654] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:18.998242 16232 raft_consensus.cc:2804] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:19.056430 16232 raft_consensus.cc:493] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:19.057076 16232 raft_consensus.cc:3060] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:19.004920 13639 consensus_queue.cc:260] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.076483 16242 raft_consensus.cc:493] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:19.077849 16242 raft_consensus.cc:515] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.081717 16242 leader_election.cc:290] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:19.087687 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 76739.6us
I20260810 13:54:19.088464 13164 leader_election.cc:304] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:19.089660 13164 leader_election.cc:304] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:19.090484 16320 raft_consensus.cc:2804] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:19.090977 16320 raft_consensus.cc:697] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:19.091777 16320 consensus_queue.cc:237] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.022084 16274 raft_consensus.cc:515] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.099879 16299 raft_consensus.cc:493] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:19.100317 16299 raft_consensus.cc:515] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.097718 16274 leader_election.cc:290] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:19.102324 16299 leader_election.cc:290] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:19.124883 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 121168us
W20260810 13:54:19.126011 13382 leader_election.cc:343] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:19.128803 13382 leader_election.cc:343] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:19.129211 13382 leader_election.cc:304] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:19.134106 16299 raft_consensus.cc:493] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:19.134577 16299 raft_consensus.cc:515] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.136412 16299 leader_election.cc:290] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:19.148883 16323 raft_consensus.cc:2804] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:19.149525 16323 raft_consensus.cc:697] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:19.150830 16323 consensus_queue.cc:237] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:18.982064 16306 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 819, Committed index: 819, Last appended: 2.819, Last appended by leader: 819, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:19.165835 15348 ts_tablet_manager.cc:1929] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:19.199637 16296 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9666026fb7e4c85b46c6aab952932fb. Latest consensus state: current_term: 4 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:19.200716 16296 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: This master's current role is: LEADER
I20260810 13:54:19.206887 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad]
I20260810 13:54:19.208539 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_77e30d5f98584b9e9711faa0b7a824df [id=6afc4e9a485640dda167bbaa0d6b347e]
I20260810 13:54:19.233824 16299 consensus_queue.cc:1048] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:19.236042 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:19.168895 16275 raft_consensus.cc:2749] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:19.243010 15348 log.cc:1199] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:19.243769 13640 tablet_bootstrap.cc:654] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:19.156863 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 67265.9us
W20260810 13:54:19.165275 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 96470.3us
I20260810 13:54:19.184952 13638 tablet_bootstrap.cc:492] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:19.249754 13638 ts_tablet_manager.cc:1403] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.311s user 0.012s sys 0.011s
I20260810 13:54:19.253773 16050 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:19.254443 16050 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.252522 13638 raft_consensus.cc:359] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.257323 13638 raft_consensus.cc:385] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:19.257593 13638 raft_consensus.cc:740] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:19.259394 16050 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:19.260308 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:19.260924 13041 raft_consensus.cc:2468] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:19.266333 13164 leader_election.cc:304] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:19.258255 13638 consensus_queue.cc:260] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.268172 16185 raft_consensus.cc:2804] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:19.268586 13638 ts_tablet_manager.cc:1434] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260810 13:54:19.268551 16185 raft_consensus.cc:493] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:19.269080 16185 raft_consensus.cc:3060] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:19.269548 13638 tablet_bootstrap.cc:492] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:19.220175 16232 raft_consensus.cc:515] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.296245 16232 leader_election.cc:290] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:19.323884 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:19.325320 16299 raft_consensus.cc:493] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:19.325791 16299 raft_consensus.cc:515] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.327859 16299 leader_election.cc:290] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:19.243803 15348 ts_tablet_manager.cc:1950] T ac9e3d3430044a5e85e2d812b7e221f5 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:19.213455 13480 raft_consensus.cc:2468] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:19.233279 16274 raft_consensus.cc:493] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:19.339913 16274 raft_consensus.cc:515] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.342736 16274 leader_election.cc:290] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:19.350123 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]
I20260810 13:54:19.352806 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]
I20260810 13:54:19.369467 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:19.370095 13470 raft_consensus.cc:2468] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:54:19.311291 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 57875us
I20260810 13:54:19.318697 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:19.380124 13167 leader_election.cc:304] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:19.393699 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:19.394310 13043 raft_consensus.cc:3060] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:19.401933 13043 raft_consensus.cc:2468] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
W20260810 13:54:19.403230 13167 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:19.403951 13167 leader_election.cc:304] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:19.404708 16322 raft_consensus.cc:2804] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:19.405121 16322 raft_consensus.cc:493] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:19.405791 16322 raft_consensus.cc:3060] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:19.409358 16323 raft_consensus.cc:2804] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:19.424885 16323 raft_consensus.cc:697] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:19.425743 16299 raft_consensus.cc:493] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:19.426198 16299 raft_consensus.cc:515] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.426172 16323 consensus_queue.cc:237] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.428166 16299 leader_election.cc:290] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:19.433483 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 560) took 8277 ms. Trace:
I20260810 13:54:19.433930 15348 rpcz_store.cc:276] 0810 13:54:11.155602 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.155702 (+ 100us) service_pool.cc:224] Handling call
0810 13:54:18.387837 (+7232135us) ts_tablet_manager.cc:1151] Deleting tablet ac9e3d3430044a5e85e2d812b7e221f5
0810 13:54:18.505033 (+117196us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:18.947439 (+442406us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:19.164831 (+217392us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:19.433408 (+268577us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":191337,"spinlock_wait_cycles":17664,"tablet-delete.queue_time_us":7231611}
I20260810 13:54:19.435530 15348 tablet_replica.cc:333] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:19.452656 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:19.459353 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:19.459992 13470 raft_consensus.cc:2468] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:19.465646 16185 raft_consensus.cc:515] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.485918 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:19.486479 13470 raft_consensus.cc:2468] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:19.493094 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9]
I20260810 13:54:19.494675 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5ac9d00cb7b3422e9810b51a4f20e029 [id=6f7b1b6d99b64d008a7c3c527f172e24]
I20260810 13:54:19.501613 13639 ts_tablet_manager.cc:1434] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.522s user 0.042s sys 0.047s
W20260810 13:54:19.510870 15135 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 1.446s (SENT)
W20260810 13:54:19.509781 13639 ts_tablet_manager.cc:1467] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3: Tablet startup took 529ms
I20260810 13:54:19.526871 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:19.527596 13477 raft_consensus.cc:2468] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:19.529035 13640 tablet_bootstrap.cc:492] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:19.529524 13640 ts_tablet_manager.cc:1403] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.480s user 0.010s sys 0.006s
I20260810 13:54:19.530418 16185 leader_election.cc:290] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:19.436563 15348 raft_consensus.cc:2243] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:19.540671 15348 raft_consensus.cc:2272] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:19.543236 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:54:19.532827 13639 ts_tablet_manager.cc:1469] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3: Trace:
0810 13:53:42.105157 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:42.105868 (+ 711us) service_pool.cc:224] Handling call
0810 13:53:42.107682 (+ 1814us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:42.107791 (+ 109us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:42.411262 (+303471us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:42.862863 (+451601us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:42.863301 (+ 438us) inbound_call.cc:177] Queueing success response
0810 13:54:18.854958 (+35991657us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:54:18.979391 (+124433us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:54:18.979863 (+ 472us) tablet_replica.cc:261] Starting instrumentation
0810 13:54:18.980339 (+ 476us) tablet_replica.cc:280] Starting consensus
0810 13:54:19.385403 (+405064us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5400061654. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1927dd8951 00007f1927e6650e 00007f1927e6506d 00007f19282b750e 00007f1928f1db9a 00007f1928f31b11 00007f1928f31ab9 00007f1928f31a49 00007f1928f31a11 00007f1928f30ced 00000000005bd8c4
Metrics: {"raft.queue_time_us":14387,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":186,"spinlock_wait_cycles":3662080,"tablet-open.queue_time_us":35991755}
I20260810 13:54:19.549598 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfbb2036c800469f90ad4d5d211ac462" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:19.560662 16274 raft_consensus.cc:493] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:19.563805 16274 raft_consensus.cc:515] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.563937 13480 raft_consensus.cc:2468] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:19.565925 16274 leader_election.cc:290] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:19.533830 13638 tablet_bootstrap.cc:654] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:19.572715 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:19.546959 13167 leader_election.cc:343] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:19.561278 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:19.592798 15348 ts_tablet_manager.cc:1916] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:19.532523 13640 raft_consensus.cc:359] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.598134 13640 raft_consensus.cc:385] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:19.598425 13640 raft_consensus.cc:740] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:19.599061 13640 consensus_queue.cc:260] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.606765 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:19.611382 13382 leader_election.cc:343] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:19.620703 13638 tablet_bootstrap.cc:492] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:19.621132 13638 ts_tablet_manager.cc:1403] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.352s user 0.017s sys 0.005s
I20260810 13:54:19.482538 16322 raft_consensus.cc:515] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.623459 13258 raft_consensus.cc:2393] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:19.623688 13638 raft_consensus.cc:359] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.624322 13638 raft_consensus.cc:385] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:19.628676 15214 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 4 FOLLOWER]: Refusing update from remote peer d9666026fb7e4c85b46c6aab952932fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 556. Preceding OpId from leader: term: 4 index: 820. (index mismatch)
I20260810 13:54:19.632539 16322 leader_election.cc:290] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:19.645038 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:19.645817 13043 raft_consensus.cc:3060] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:19.651563 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_772227d6702d4cf7bf6729e922d3eea5 [id=6ffcaf4f90f14e24b6d02b21e2936bd3]
I20260810 13:54:19.655467 16185 raft_consensus.cc:493] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:19.656018 16185 raft_consensus.cc:515] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:19.658226 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 45608.5us
I20260810 13:54:19.624583 13638 raft_consensus.cc:740] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:19.669931 13638 consensus_queue.cc:260] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:19.671680 13382 leader_election.cc:343] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: fb30ebe9520d4224bdfd45a5e915d8bd
I20260810 13:54:19.672005 13638 ts_tablet_manager.cc:1434] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.051s user 0.007s sys 0.000s
I20260810 13:54:19.673707 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfbb2036c800469f90ad4d5d211ac462" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:19.675460 13639 tablet_bootstrap.cc:492] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:19.684962 13258 raft_consensus.cc:2468] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:19.669054 13640 ts_tablet_manager.cc:1434] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.139s user 0.009s sys 0.001s
I20260810 13:54:19.697463 16185 leader_election.cc:290] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:19.699298 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:19.700098 13041 raft_consensus.cc:2393] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:19.691768 13638 tablet_bootstrap.cc:492] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:19.753746 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 50650.2us
I20260810 13:54:19.630648 16296 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 820, Last known committed idx: 556, Time since last communication: 0.000s
I20260810 13:54:19.755703 12951 leader_election.cc:304] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:19.756273 15213 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 4 FOLLOWER]: Rejecting Update request from peer 1298bde14cec4cd3a9d6338c7d47f0b7 for earlier term 3. Current term is 4. Ops: [1.557-3.820]
I20260810 13:54:19.756906 12951 leader_election.cc:304] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:19.758476 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:19.758909 16351 raft_consensus.cc:2804] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:19.759085 13041 raft_consensus.cc:2468] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:19.759343 16351 raft_consensus.cc:697] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
W20260810 13:54:19.559693 12471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 51166.8us
I20260810 13:54:19.773671 16299 raft_consensus.cc:2804] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:19.774060 16299 raft_consensus.cc:493] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:19.774362 16299 raft_consensus.cc:3060] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:19.780375 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 99167.7us
I20260810 13:54:19.760141 16351 consensus_queue.cc:237] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.801661 16263 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 }, Status: INVALID_TERM, Last received: 1.556, Next index: 557, Last known committed idx: 556, Time since last communication: 0.000s
I20260810 13:54:19.803875 13639 tablet_bootstrap.cc:654] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:19.819559 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8606de06b2994b3291a5ee1e28ad7100 [id=7162bee4392749a38057f272df172987]
I20260810 13:54:19.823207 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 [id=766aaf50fb2f4fbca53416a8e853f9c1]
I20260810 13:54:19.823956 13638 tablet_bootstrap.cc:654] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:19.826395 13640 tablet_bootstrap.cc:492] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:19.831722 13640 tablet_bootstrap.cc:654] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:19.798134 12952 leader_election.cc:343] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:19.848121 12952 leader_election.cc:343] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:19.849401 12952 leader_election.cc:343] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:19.862110 16299 raft_consensus.cc:515] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.864030 16299 leader_election.cc:290] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:19.879932 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 122333us
W20260810 13:54:19.889396 13167 consensus_peers.cc:597] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:19.911957 13639 tablet_bootstrap.cc:492] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:19.912370 13639 ts_tablet_manager.cc:1403] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.237s user 0.010s sys 0.003s
W20260810 13:54:19.936313 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 75b8030450554de3b97266f348329ea6 consensus state has no leader
I20260810 13:54:19.940974 13043 raft_consensus.cc:2468] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
W20260810 13:54:19.943797 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:19.954991 13640 tablet_bootstrap.cc:492] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:19.955504 13640 ts_tablet_manager.cc:1403] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.129s user 0.006s sys 0.010s
I20260810 13:54:19.959110 16360 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 3 LEADER]: Stepping down as leader of term 3
I20260810 13:54:19.959627 16360 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1298bde14cec4cd3a9d6338c7d47f0b7, State: Running, Role: LEADER
I20260810 13:54:19.979728 16360 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 818, Committed index: 818, Last appended: 3.820, Last appended by leader: 820, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:19.983197 16360 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 3 FOLLOWER]: Advancing to term 4
I20260810 13:54:19.992575 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:19.993206 13269 raft_consensus.cc:3060] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.012717 13269 raft_consensus.cc:2468] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:19.945927 12951 leader_election.cc:304] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:19.946012 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:20.027275 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 81436.6us
I20260810 13:54:20.027593 16356 raft_consensus.cc:2804] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:20.027959 12951 leader_election.cc:304] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:20.028132 16356 raft_consensus.cc:493] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:20.028620 16356 raft_consensus.cc:3060] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.028818 16357 raft_consensus.cc:2764] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:19.946830 13639 raft_consensus.cc:359] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:19.949757 12952 leader_election.cc:304] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:20.031834 13639 raft_consensus.cc:385] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.032133 13639 raft_consensus.cc:740] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:20.032230 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 82546us
I20260810 13:54:20.032750 16357 raft_consensus.cc:2804] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:20.033118 16357 raft_consensus.cc:493] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:19.993949 13640 raft_consensus.cc:359] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.033417 16357 raft_consensus.cc:3060] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.030781 12951 leader_election.cc:304] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:20.034785 13640 raft_consensus.cc:385] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.034973 16349 raft_consensus.cc:2804] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:20.035332 16349 raft_consensus.cc:493] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:20.035629 16349 raft_consensus.cc:3060] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.036168 13640 raft_consensus.cc:740] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.040771 13640 consensus_queue.cc:260] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:20.047578 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 56572.9us
I20260810 13:54:20.060315 13639 consensus_queue.cc:260] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.063699 13639 ts_tablet_manager.cc:1434] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.151s user 0.007s sys 0.005s
I20260810 13:54:20.066713 13638 tablet_bootstrap.cc:492] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:20.067662 13638 ts_tablet_manager.cc:1403] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.393s user 0.021s sys 0.006s
I20260810 13:54:20.070338 13640 ts_tablet_manager.cc:1434] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.115s user 0.009s sys 0.000s
W20260810 13:54:20.056895 13382 leader_election.cc:343] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: fb30ebe9520d4224bdfd45a5e915d8bd
I20260810 13:54:20.071056 13382 leader_election.cc:304] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:20.072023 13382 raft_consensus.cc:2686] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:54:20.073096 13382 leader_election.cc:343] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:20.073846 13382 leader_election.cc:304] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:20.081348 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:20.082165 13639 tablet_bootstrap.cc:492] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:20.086170 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9]
I20260810 13:54:20.088011 16356 raft_consensus.cc:515] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.089947 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:20.100417 16275 raft_consensus.cc:2749] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:20.103533 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:20.104130 13468 raft_consensus.cc:2468] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:54:20.114741 13167 consensus_peers.cc:597] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:20.116993 13638 raft_consensus.cc:359] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.117601 13638 raft_consensus.cc:385] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.117865 13638 raft_consensus.cc:740] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.118438 13638 consensus_queue.cc:260] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.101491 12952 leader_election.cc:304] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:20.100104 16357 raft_consensus.cc:515] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.120018 16342 raft_consensus.cc:2804] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:20.120479 16342 raft_consensus.cc:697] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:20.121445 16342 consensus_queue.cc:237] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.123435 13639 tablet_bootstrap.cc:654] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:20.126421 13167 leader_election.cc:304] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:20.126673 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]
I20260810 13:54:20.128713 16185 raft_consensus.cc:2804] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:20.129722 16185 raft_consensus.cc:697] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:20.130780 16185 consensus_queue.cc:237] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.064229 16349 raft_consensus.cc:515] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.132912 16357 leader_election.cc:290] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:20.140491 16357 raft_consensus.cc:493] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:20.141009 16357 raft_consensus.cc:515] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.143616 16357 leader_election.cc:290] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:20.155144 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfbb2036c800469f90ad4d5d211ac462" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:20.155812 13260 raft_consensus.cc:3060] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.170804 13639 tablet_bootstrap.cc:492] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:20.171306 13639 ts_tablet_manager.cc:1403] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.089s user 0.008s sys 0.002s
I20260810 13:54:20.174175 16349 leader_election.cc:290] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:20.174676 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:20.173975 13639 raft_consensus.cc:359] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.175216 13639 raft_consensus.cc:385] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.175504 13639 raft_consensus.cc:740] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.176198 13639 consensus_queue.cc:260] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.153533 16356 leader_election.cc:290] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:20.181442 13640 tablet_bootstrap.cc:492] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:20.184780 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:20.187204 13639 ts_tablet_manager.cc:1434] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.016s user 0.008s sys 0.000s
I20260810 13:54:20.188222 13639 tablet_bootstrap.cc:492] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:20.191913 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:20.195415 13260 raft_consensus.cc:2468] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:20.196928 13640 tablet_bootstrap.cc:654] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:20.194542 12952 leader_election.cc:343] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:20.197623 12952 leader_election.cc:343] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:20.198805 12952 leader_election.cc:304] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:20.199710 16342 raft_consensus.cc:2804] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:20.200192 16342 raft_consensus.cc:697] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:20.201076 16342 consensus_queue.cc:237] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.206807 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:20.207412 13477 raft_consensus.cc:3060] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.201689 13639 tablet_bootstrap.cc:654] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:20.216297 13477 raft_consensus.cc:2468] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:20.227249 13639 tablet_bootstrap.cc:492] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:20.227712 13639 ts_tablet_manager.cc:1403] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.000s
I20260810 13:54:20.230400 13639 raft_consensus.cc:359] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.231087 13639 raft_consensus.cc:385] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.231385 13639 raft_consensus.cc:740] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.232015 13639 consensus_queue.cc:260] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.235895 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:20.236490 13468 raft_consensus.cc:3060] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.239588 13639 ts_tablet_manager.cc:1434] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.012s user 0.005s sys 0.003s
I20260810 13:54:20.244056 13639 tablet_bootstrap.cc:492] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:20.250335 13639 tablet_bootstrap.cc:654] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:20.253120 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 [id=7a54639f4e1a4f1a82278d5d64b347b8]
I20260810 13:54:20.254632 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 [id=7a8b712d0b1a4766ab00cd2c4739c311]
I20260810 13:54:20.256078 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ee9ef5f74a944eaabe6af879e8ab15a2 [id=7a8f1c3ab411436fa3940b3261d0e05f]
I20260810 13:54:20.265913 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:20.266665 13470 raft_consensus.cc:2393] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:20.270756 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:20.271574 13477 raft_consensus.cc:3060] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.120491 13638 ts_tablet_manager.cc:1434] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.053s user 0.002s sys 0.000s
I20260810 13:54:20.294629 13639 tablet_bootstrap.cc:492] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:20.295089 13639 ts_tablet_manager.cc:1403] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.001s
I20260810 13:54:20.294935 13468 raft_consensus.cc:2468] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:20.297849 13639 raft_consensus.cc:359] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.298563 13639 raft_consensus.cc:385] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.299053 13639 raft_consensus.cc:740] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.299749 13639 consensus_queue.cc:260] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.302111 13639 ts_tablet_manager.cc:1434] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20260810 13:54:20.305815 13638 tablet_bootstrap.cc:492] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:20.315754 15348 ts_tablet_manager.cc:1929] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:20.317562 15348 log.cc:1199] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/fb30ebe9520d4224bdfd45a5e915d8bd
I20260810 13:54:20.318341 15348 ts_tablet_manager.cc:1950] T fb30ebe9520d4224bdfd45a5e915d8bd P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:20.333935 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 [id=7b407001f6d54bd2929f1f0d141b065e]
I20260810 13:54:20.335714 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_acc827f97bb244f59d2eed071cc9bd55 [id=7b4d23c35bc14f8598821f2838a18148]
I20260810 13:54:20.342417 13639 tablet_bootstrap.cc:492] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:20.349053 13639 tablet_bootstrap.cc:654] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:20.361865 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:20.366973 13640 tablet_bootstrap.cc:492] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:20.367527 13640 ts_tablet_manager.cc:1403] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.186s user 0.003s sys 0.006s
I20260810 13:54:20.370523 13639 tablet_bootstrap.cc:492] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:20.370970 13639 ts_tablet_manager.cc:1403] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.029s user 0.010s sys 0.001s
I20260810 13:54:20.373751 13639 raft_consensus.cc:359] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.374452 13639 raft_consensus.cc:385] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.374728 13639 raft_consensus.cc:740] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.380981 13639 consensus_queue.cc:260] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.383351 13639 ts_tablet_manager.cc:1434] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
W20260810 13:54:20.384037 13164 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:20.384312 13639 tablet_bootstrap.cc:492] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:20.384405 13164 leader_election.cc:304] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:20.389168 16232 raft_consensus.cc:2749] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:20.392017 13640 raft_consensus.cc:359] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.402712 13043 raft_consensus.cc:3060] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.410508 13639 tablet_bootstrap.cc:654] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:20.423816 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b33cb4c7a80141c49d306885213f30a9 [id=7dff57e81c064728a8160d5c02c11de5]
I20260810 13:54:20.428901 13164 leader_election.cc:304] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:20.429621 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:20.429668 16232 raft_consensus.cc:3060] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.431960 13639 tablet_bootstrap.cc:492] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:20.432408 13639 ts_tablet_manager.cc:1403] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.048s user 0.009s sys 0.000s
I20260810 13:54:20.435053 13639 raft_consensus.cc:359] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.435727 13639 raft_consensus.cc:385] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.436003 13639 raft_consensus.cc:740] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.436667 13639 consensus_queue.cc:260] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.440403 16322 consensus_queue.cc:1048] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:20.441218 13639 ts_tablet_manager.cc:1434] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260810 13:54:20.457558 13639 tablet_bootstrap.cc:492] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:20.467597 13639 tablet_bootstrap.cc:654] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:20.471793 16356 raft_consensus.cc:493] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:20.474400 16356 raft_consensus.cc:515] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.491392 16356 leader_election.cc:290] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:20.493209 13167 consensus_peers.cc:597] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:20.510878 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:20.511813 13260 raft_consensus.cc:2393] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:20.512547 13639 tablet_bootstrap.cc:492] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:20.513033 13639 ts_tablet_manager.cc:1403] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.056s user 0.017s sys 0.002s
I20260810 13:54:20.517349 13639 raft_consensus.cc:359] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.518062 13639 raft_consensus.cc:385] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.518345 13639 raft_consensus.cc:740] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.519022 13639 consensus_queue.cc:260] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.535074 13638 tablet_bootstrap.cc:654] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:20.520639 13639 ts_tablet_manager.cc:1434] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 13:54:20.540311 13639 tablet_bootstrap.cc:492] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:20.540920 16360 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:20.541738 16360 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:20.546497 13639 tablet_bootstrap.cc:654] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:20.556861 13640 raft_consensus.cc:385] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.557246 13640 raft_consensus.cc:740] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.558377 13640 consensus_queue.cc:260] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.561610 13640 ts_tablet_manager.cc:1434] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.194s user 0.007s sys 0.002s
I20260810 13:54:20.601292 16360 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:20.573655 16232 raft_consensus.cc:2749] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:20.577193 13164 leader_election.cc:304] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:20.606866 15213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 820 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:20.607594 15213 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1298bde14cec4cd3a9d6338c7d47f0b7 in term 4.
I20260810 13:54:20.609088 16185 raft_consensus.cc:2804] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:20.610159 16322 consensus_queue.cc:1048] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:20.612285 16322 consensus_queue.cc:1048] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260810 13:54:20.628232 16400 consensus_queue.cc:1048] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:20.647891 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]
I20260810 13:54:20.659018 16185 raft_consensus.cc:697] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:20.660284 16185 consensus_queue.cc:237] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.609109 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d; no voters:
I20260810 13:54:20.673628 16360 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260810 13:54:20.674060 16360 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:20.674402 16360 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 4 FOLLOWER]: Advancing to term 5
W20260810 13:54:20.708024 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 98980.1us
I20260810 13:54:20.394696 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 561) took 9238 ms. Trace:
I20260810 13:54:20.711036 15348 rpcz_store.cc:276] 0810 13:54:11.156465 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.156560 (+ 95us) service_pool.cc:224] Handling call
0810 13:54:19.435348 (+8278788us) ts_tablet_manager.cc:1151] Deleting tablet fb30ebe9520d4224bdfd45a5e915d8bd
0810 13:54:19.435414 (+ 66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:20.051855 (+616441us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:20.315589 (+263734us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:20.394622 (+ 79033us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":192463,"tablet-delete.queue_time_us":8278286}
I20260810 13:54:20.581902 16275 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:20.583536 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:20.590456 13477 raft_consensus.cc:2468] T 51813605283e43f2b4efe6fb2fab652c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:20.713042 13480 raft_consensus.cc:3060] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.661473 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfbb2036c800469f90ad4d5d211ac462" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:20.714046 13468 raft_consensus.cc:3060] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.662845 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:20.664469 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:20.720920 13476 raft_consensus.cc:3060] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.721431 13480 raft_consensus.cc:2468] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:20.666504 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:20.724920 13475 raft_consensus.cc:3060] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:20.673789 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:20.730007 13464 raft_consensus.cc:2393] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:20.713065 16275 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.739475 16275 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:20.755496 13476 raft_consensus.cc:2468] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:20.756800 13638 tablet_bootstrap.cc:492] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:20.757261 13638 ts_tablet_manager.cc:1403] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.452s user 0.012s sys 0.001s
I20260810 13:54:20.769811 13475 raft_consensus.cc:2468] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
W20260810 13:54:20.770676 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 65116us
I20260810 13:54:20.771406 13382 leader_election.cc:304] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:20.772635 16410 raft_consensus.cc:2764] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260810 13:54:20.773623 13382 leader_election.cc:343] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:20.762987 13468 raft_consensus.cc:2468] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:20.782023 13638 raft_consensus.cc:359] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.782876 13638 raft_consensus.cc:385] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.783210 13638 raft_consensus.cc:740] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.783994 13638 consensus_queue.cc:260] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.794720 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 562) took 9637 ms. Trace:
I20260810 13:54:20.795060 15348 rpcz_store.cc:276] 0810 13:54:11.157287 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.157389 (+ 102us) service_pool.cc:224] Handling call
0810 13:54:20.712587 (+9555198us) ts_tablet_manager.cc:1151] Deleting tablet 0f422b17b9a24f609b06625837947e64
0810 13:54:20.794360 (+ 81773us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:20.794663 (+ 303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190063,"tablet-delete.queue_time_us":9554729}
I20260810 13:54:20.796334 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 563) took 9638 ms. Trace:
I20260810 13:54:20.797626 13640 tablet_bootstrap.cc:492] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:20.682133 12471 leader_election.cc:336] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.830s (SENT)
W20260810 13:54:20.798357 12471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 116282us
W20260810 13:54:20.798976 12471 leader_election.cc:336] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.925s (SENT)
I20260810 13:54:20.796622 15348 rpcz_store.cc:276] 0810 13:54:11.352650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.353307 (+ 657us) service_pool.cc:224] Handling call
0810 13:54:20.795940 (+9442633us) ts_tablet_manager.cc:1151] Deleting tablet 3641ae594b104131bb55005bc1f61027
0810 13:54:20.795998 (+ 58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:20.796286 (+ 288us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9353868}
I20260810 13:54:20.800946 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 [id=8129beecaba3450c9041bb715af80988]
I20260810 13:54:20.801689 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 565) took 9445 ms. Trace:
I20260810 13:54:20.801993 15348 rpcz_store.cc:276] 0810 13:54:11.356486 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.356633 (+ 147us) service_pool.cc:224] Handling call
0810 13:54:20.801344 (+9444711us) ts_tablet_manager.cc:1151] Deleting tablet ffcb4016b1984ab9a00699bda1488664
0810 13:54:20.801396 (+ 52us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:20.801642 (+ 246us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9356408}
I20260810 13:54:20.802956 15348 tablet_replica.cc:333] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:20.803773 15348 raft_consensus.cc:2243] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:20.806697 13638 ts_tablet_manager.cc:1434] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.049s user 0.009s sys 0.000s
I20260810 13:54:20.810973 15348 raft_consensus.cc:2272] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:20.811969 13638 tablet_bootstrap.cc:492] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:20.812947 15348 ts_tablet_manager.cc:1916] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:20.821995 13640 tablet_bootstrap.cc:654] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:20.826202 13382 leader_election.cc:343] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:20.827239 13382 leader_election.cc:343] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:20.827719 13382 leader_election.cc:304] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:20.828485 16410 raft_consensus.cc:2749] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:20.830369 16360 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:20.803539 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_921fde42e0214ef58181c03785687004 [id=828ce62882b949d6887e75923229655e]
I20260810 13:54:20.873468 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_383bd937c51942a1b124430d2b5086af [id=82f67714ca3b4e6aab8557bd0f53d264]
I20260810 13:54:20.874605 13638 tablet_bootstrap.cc:654] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:20.875950 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_54ea5af3ae44427eb0031a29dd62e663 [id=834d810fa56c49de9d97b91dabab82f1]
I20260810 13:54:20.878785 16275 raft_consensus.cc:493] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:20.879238 16275 raft_consensus.cc:515] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.881330 16275 leader_election.cc:290] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:20.887373 15214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 820 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d"
I20260810 13:54:20.887984 15214 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 4 FOLLOWER]: Advancing to term 5
W20260810 13:54:20.894906 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:20.896471 15214 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1298bde14cec4cd3a9d6338c7d47f0b7 in term 5.
I20260810 13:54:20.899900 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7, 2928f7d4503145b182d99007d240334d; no voters:
I20260810 13:54:20.900887 16409 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 5 FOLLOWER]: Leader election won for term 5
I20260810 13:54:20.913384 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6964fe82ae0c4d96a86d800f82062b3e [id=83fc760e794d422d8614bf728e3e47df]
I20260810 13:54:20.915441 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:20.916023 13260 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:20.919304 13640 tablet_bootstrap.cc:492] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:20.919778 13640 ts_tablet_manager.cc:1403] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.123s user 0.004s sys 0.006s
I20260810 13:54:20.922384 13640 raft_consensus.cc:359] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.923030 13640 raft_consensus.cc:385] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:20.923497 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:20.924851 16409 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 5 LEADER]: Becoming Leader. State: Replica: 1298bde14cec4cd3a9d6338c7d47f0b7, State: Running, Role: LEADER
I20260810 13:54:20.925874 16409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 818, Committed index: 818, Last appended: 3.820, Last appended by leader: 820, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:20.926723 13638 tablet_bootstrap.cc:492] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:20.927217 13638 ts_tablet_manager.cc:1403] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.115s user 0.012s sys 0.000s
I20260810 13:54:20.929953 16360 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 5 election: Requested vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:20.930033 13638 raft_consensus.cc:359] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.930727 13638 raft_consensus.cc:385] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:20.931720 13638 raft_consensus.cc:740] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:20.932413 13638 consensus_queue.cc:260] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.934710 13638 ts_tablet_manager.cc:1434] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 13:54:20.939389 16232 raft_consensus.cc:493] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:20.939863 16232 raft_consensus.cc:515] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.941964 16232 leader_election.cc:290] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:20.956966 13638 tablet_bootstrap.cc:492] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:20.978248 16342 raft_consensus.cc:493] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:20.979177 16342 raft_consensus.cc:515] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.983490 15213 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 5 FOLLOWER]: Rejecting Update request from peer d9666026fb7e4c85b46c6aab952932fb for earlier term 4. Current term is 5. Ops: [1.557-4.820]
I20260810 13:54:20.989485 13638 tablet_bootstrap.cc:654] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:20.989610 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:20.991540 12952 leader_election.cc:343] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:20.993009 16342 leader_election.cc:290] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:20.993605 16342 raft_consensus.cc:493] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:20.994185 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_612d612a32794a8998dd3a19129b79c3 [id=840614d5bd744a82bf94fd2f23a31d69]
I20260810 13:54:20.994118 16342 raft_consensus.cc:515] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:20.996492 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4b93246ea61e418db4efb3c2732711af [id=847e7c0039964b3f94192d5032791e4a]
I20260810 13:54:20.997412 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:20.999481 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 1.446s (SENT)
I20260810 13:54:21.020440 16349 raft_consensus.cc:493] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.023468 16349 raft_consensus.cc:515] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.030889 16356 consensus_queue.cc:1048] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:21.031687 16349 leader_election.cc:290] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:21.032289 13043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s user 0.003s sys 0.010s
W20260810 13:54:21.033377 13043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s user 0.004s sys 0.010s
I20260810 13:54:21.035245 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:21.036988 13638 tablet_bootstrap.cc:492] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
W20260810 13:54:21.037353 12952 leader_election.cc:343] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:21.037596 13638 ts_tablet_manager.cc:1403] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.102s user 0.007s sys 0.005s
W20260810 13:54:21.044106 15135 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317): Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 1.446s (SENT)
I20260810 13:54:21.044519 15135 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:21.051282 16357 consensus_queue.cc:1048] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:21.054315 13638 raft_consensus.cc:359] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.055032 13638 raft_consensus.cc:385] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:21.055316 13638 raft_consensus.cc:740] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:21.073386 13638 consensus_queue.cc:260] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.081233 13638 ts_tablet_manager.cc:1434] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.043s user 0.005s sys 0.003s
I20260810 13:54:21.087275 16360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1298bde14cec4cd3a9d6338c7d47f0b7. Latest consensus state: current_term: 5 leader_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:21.088097 16360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [sys.catalog]: This master's current role is: LEADER
I20260810 13:54:21.091431 15348 ts_tablet_manager.cc:1929] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:21.048164 16296 consensus_queue.cc:1059] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 }, Status: INVALID_TERM, Last received: 1.556, Next index: 557, Last known committed idx: 556, Time since last communication: 0.000s
I20260810 13:54:21.109500 16444 raft_consensus.cc:3055] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 4 LEADER]: Stepping down as leader of term 4
I20260810 13:54:21.127696 16185 raft_consensus.cc:493] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.128525 16185 raft_consensus.cc:515] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.129496 16444 raft_consensus.cc:740] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: d9666026fb7e4c85b46c6aab952932fb, State: Running, Role: LEADER
I20260810 13:54:21.131750 16185 leader_election.cc:290] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:21.133984 16444 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 819, Committed index: 819, Last appended: 4.820, Last appended by leader: 820, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:21.133399 16342 leader_election.cc:290] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:21.110697 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f835565354f042368700f4252335e8eb [id=84ca48404db8439697f8035aa3bc34d3]
I20260810 13:54:21.139022 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]
I20260810 13:54:21.142009 13639 tablet_bootstrap.cc:492] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:21.142970 13639 ts_tablet_manager.cc:1403] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.603s user 0.034s sys 0.027s
I20260810 13:54:21.152607 13639 raft_consensus.cc:359] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.153499 13639 raft_consensus.cc:385] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:21.153849 13639 raft_consensus.cc:740] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:21.154759 13639 consensus_queue.cc:260] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:21.159334 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 64418.1us
I20260810 13:54:21.169113 16430 raft_consensus.cc:493] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.169833 16430 raft_consensus.cc:515] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.156672 13639 ts_tablet_manager.cc:1434] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260810 13:54:21.187865 16444 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 4 FOLLOWER]: Advancing to term 5
I20260810 13:54:21.193764 16439 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260810 13:54:21.194993 15135 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 150925us
I20260810 13:54:20.923290 13640 raft_consensus.cc:740] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:21.165599 16275 raft_consensus.cc:493] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:21.195953 16275 raft_consensus.cc:515] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:21.196305 13640 consensus_queue.cc:260] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.197961 16275 leader_election.cc:290] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:21.198612 15348 log.cc:1199] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/a17d73c65f544b7c8566fd874ee87a25
I20260810 13:54:21.211391 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]
W20260810 13:54:21.223704 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f764e91bb2c94bc3be425b65323764cb consensus state has no leader
I20260810 13:54:21.223713 16430 leader_election.cc:290] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:21.198660 13640 ts_tablet_manager.cc:1434] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.279s user 0.005s sys 0.002s
I20260810 13:54:21.233242 12951 leader_election.cc:304] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:21.234702 16427 raft_consensus.cc:2749] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:21.240398 15348 ts_tablet_manager.cc:1950] T a17d73c65f544b7c8566fd874ee87a25 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:21.243376 12951 leader_election.cc:304] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:21.214633 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d5c509cabbb84883a9a911c2f4e04c88 [id=865c0ec036ca45caaec23fe2cf899d1d]
I20260810 13:54:21.254705 13638 tablet_bootstrap.cc:492] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:21.257536 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:21.250845 16430 raft_consensus.cc:3060] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.258072 13475 raft_consensus.cc:2468] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:21.263352 16275 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.264593 16275 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.265317 13640 tablet_bootstrap.cc:492] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:21.266614 16275 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:21.268065 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:21.271785 16427 consensus_queue.cc:1048] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:21.273782 13639 tablet_bootstrap.cc:492] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:21.281005 13639 tablet_bootstrap.cc:654] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:21.282207 16405 raft_consensus.cc:493] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.282692 16405 raft_consensus.cc:515] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.285867 16405 leader_election.cc:290] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:21.286391 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e8940f9b8b5647b29566e6383b5c8fd7 [id=866777afb37d48b7bc025eba1377a8d0]
I20260810 13:54:21.264014 12951 leader_election.cc:304] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:21.304872 13638 tablet_bootstrap.cc:654] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:21.305037 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7cf74351dd314634a7a8ca1b1a24302b [id=884f2bca73394b0b97902104a5b68976]
I20260810 13:54:21.314499 13640 tablet_bootstrap.cc:654] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:21.317483 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7cbcdca887724284a33c681c9574ea82 [id=8a8a45a7ac264648b3810d9c69a36751]
I20260810 13:54:21.327350 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:21.328810 16275 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.329270 16275 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.331265 16275 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:21.328533 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a49a2f11e36d4162bc5847bacee456e7 [id=8aad892ad49f4c0aa7681d88843d3561]
I20260810 13:54:21.334978 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 570) took 9917 ms. Trace:
I20260810 13:54:21.335275 15348 rpcz_store.cc:276] 0810 13:54:11.417563 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.423522 (+ 5959us) service_pool.cc:224] Handling call
0810 13:54:20.802807 (+9379285us) ts_tablet_manager.cc:1151] Deleting tablet a17d73c65f544b7c8566fd874ee87a25
0810 13:54:20.802858 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:20.901919 (+ 99061us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:21.091308 (+189389us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:21.334919 (+243611us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6712,"tablet-delete.queue_time_us":9341913}
I20260810 13:54:21.336571 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 572) took 9910 ms. Trace:
I20260810 13:54:21.337354 15348 rpcz_store.cc:276] 0810 13:54:11.425912 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.427500 (+ 1588us) service_pool.cc:224] Handling call
0810 13:54:21.336215 (+9908715us) ts_tablet_manager.cc:1151] Deleting tablet b0b44a300d4b4f41854371735ecbab1a
0810 13:54:21.336269 (+ 54us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:21.336525 (+ 256us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9874797}
I20260810 13:54:21.338563 15348 tablet_replica.cc:333] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:21.339460 15348 raft_consensus.cc:2243] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:21.340487 15348 raft_consensus.cc:2272] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:21.347563 15348 ts_tablet_manager.cc:1916] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:21.363811 13638 tablet_bootstrap.cc:492] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:21.364802 13638 ts_tablet_manager.cc:1403] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.111s user 0.007s sys 0.006s
I20260810 13:54:21.367755 13638 raft_consensus.cc:359] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.368345 13638 raft_consensus.cc:385] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:13.131873 15216 rpcz_store.cc:276] 0810 13:53:59.812354 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:59.812488 (+ 134us) service_pool.cc:224] Handling call
0810 13:54:00.809996 (+997508us) raft_consensus.cc:1471] Updating replica for 548 ops
0810 13:54:01.505905 (+695909us) raft_consensus.cc:1534] Early marking committed up to index 8
0810 13:54:02.021960 (+516055us) write_op.cc:489] Releasing partition, row and schema locks
0810 13:54:02.022242 (+ 282us) write_op.cc:454] Released schema lock
0810 13:54:02.046234 (+ 23992us) raft_consensus.cc:1539] Triggering prepare for 548 ops
0810 13:54:02.113053 (+ 66819us) write_op.cc:270] Start()
0810 13:54:02.113523 (+ 470us) write_op.cc:276] Timestamp: P: 1786370005759087 usec, L: 0
0810 13:54:02.195907 (+ 82384us) write_op.cc:270] Start()
0810 13:54:02.196430 (+ 523us) write_op.cc:276] Timestamp: P: 1786370005782241 usec, L: 0
0810 13:54:02.197722 (+ 1292us) write_op.cc:270] Start()
0810 13:54:02.197901 (+ 179us) write_op.cc:276] Timestamp: P: 1786370005793758 usec, L: 0
0810 13:54:02.199175 (+ 1274us) write_op.cc:270] Start()
0810 13:54:02.199329 (+ 154us) write_op.cc:276] Timestamp: P: 1786370005801753 usec, L: 0
0810 13:54:02.200416 (+ 1087us) write_op.cc:270] Start()
0810 13:54:02.200594 (+ 178us) write_op.cc:276] Timestamp: P: 1786370005808739 usec, L: 0
0810 13:54:02.214990 (+ 14396us) write_op.cc:270] Start()
0810 13:54:02.215214 (+ 224us) write_op.cc:276] Timestamp: P: 1786370005877192 usec, L: 0
0810 13:54:02.216970 (+ 1756us) write_op.cc:270] Start()
0810 13:54:02.217118 (+ 148us) write_op.cc:276] Timestamp: P: 1786370005955543 usec, L: 0
0810 13:54:02.227788 (+ 10670us) write_op.cc:270] Start()
0810 13:54:02.227992 (+ 204us) write_op.cc:276] Timestamp: P: 1786370005987516 usec, L: 0
0810 13:54:02.237190 (+ 9198us) write_op.cc:270] Start()
0810 13:54:02.237285 (+ 95us) write_op.cc:276] Timestamp: P: 1786370005995098 usec, L: 0
0810 13:54:02.238224 (+ 939us) write_op.cc:270] Start()
0810 13:54:02.238396 (+ 172us) write_op.cc:276] Timestamp: P: 1786370005997502 usec, L: 0
0810 13:54:02.241239 (+ 2843us) write_op.cc:270] Start()
0810 13:54:02.241396 (+ 157us) write_op.cc:276] Timestamp: P: 1786370006030469 usec, L: 0
0810 13:54:02.242306 (+ 910us) write_op.cc:270] Start()
0810 13:54:02.242521 (+ 215us) write_op.cc:276] Timestamp: P: 1786370006082980 usec, L: 0
0810 13:54:02.256533 (+ 14012us) write_op.cc:270] Start()
0810 13:54:02.256713 (+ 180us) write_op.cc:276] Timestamp: P: 1786370006149522 usec, L: 0
0810 13:54:02.266261 (+ 9548us) write_op.cc:270] Start()
0810 13:54:02.266360 (+ 99us) write_op.cc:276] Timestamp: P: 1786370006170032 usec, L: 0
0810 13:54:02.267070 (+ 710us) write_op.cc:270] Start()
0810 13:54:02.267223 (+ 153us) write_op.cc:276] Timestamp: P: 1786370006205086 usec, L: 0
0810 13:54:02.389445 (+122222us) write_op.cc:270] Start()
0810 13:54:02.389551 (+ 106us) write_op.cc:276] Timestamp: P: 1786370006209493 usec, L: 0
0810 13:54:02.390127 (+ 576us) write_op.cc:270] Start()
0810 13:54:02.390211 (+ 84us) write_op.cc:276] Timestamp: P: 1786370006261447 usec, L: 0
0810 13:54:02.390700 (+ 489us) write_op.cc:270] Start()
0810 13:54:02.390797 (+ 97us) write_op.cc:276] Timestamp: P: 1786370006293831 usec, L: 0
0810 13:54:02.391271 (+ 474us) write_op.cc:270] Start()
0810 13:54:02.391352 (+ 81us) write_op.cc:276] Timestamp: P: 1786370006299305 usec, L: 0
0810 13:54:02.391823 (+ 471us) write_op.cc:270] Start()
0810 13:54:02.391896 (+ 73us) write_op.cc:276] Timestamp: P: 1786370006305807 usec, L: 0
0810 13:54:02.392339 (+ 443us) write_op.cc:270] Start()
0810 13:54:02.392435 (+ 96us) write_op.cc:276] Timestamp: P: 1786370006346135 usec, L: 0
0810 13:54:02.419990 (+ 27555us) write_op.cc:270] Start()
0810 13:54:02.420127 (+ 137us) write_op.cc:276] Timestamp: P: 1786370006391523 usec, L: 0
0810 13:54:02.420736 (+ 609us) write_op.cc:270] Start()
0810 13:54:02.420921 (+ 185us) write_op.cc:276] Timestamp: P: 1786370006478713 usec, L: 0
0810 13:54:02.421401 (+ 480us) write_op.cc:270] Start()
0810 13:54:02.421515 (+ 114us) write_op.cc:276] Timestamp: P: 1786370006490034 usec, L: 0
0810 13:54:02.422159 (+ 644us) write_op.cc:270] Start()
0810 13:54:02.422265 (+ 106us) write_op.cc:276] Timestamp: P: 1786370006572426 usec, L: 0
0810 13:54:02.423564 (+ 1299us) write_op.cc:270] Start()
0810 13:54:02.423664 (+ 100us) write_op.cc:276] Timestamp: P: 1786370006600884 usec, L: 0
0810 13:54:02.424391 (+ 727us) write_op.cc:270] Start()
0810 13:54:02.424474 (+ 83us) write_op.cc:276] Timestamp: P: 1786370006651445 usec, L: 0
0810 13:54:02.424980 (+ 506us) write_op.cc:270] Start()
0810 13:54:02.425052 (+ 72us) write_op.cc:276] Timestamp: P: 1786370006656864 usec, L: 0
0810 13:54:02.425487 (+ 435us) write_op.cc:270] Start()
0810 13:54:02.425596 (+ 109us) write_op.cc:276] Timestamp: P: 1786370006683079 usec, L: 0
0810 13:54:02.426245 (+ 649us) write_op.cc:270] Start()
0810 13:54:02.426355 (+ 110us) write_op.cc:276] Timestamp: P: 1786370006704059 usec, L: 0
0810 13:54:02.426946 (+ 591us) write_op.cc:270] Start()
0810 13:54:02.427044 (+ 98us) write_op.cc:276] Timestamp: P: 1786370006781679 usec, L: 0
0810 13:54:02.437303 (+ 10259us) write_op.cc:270] Start()
0810 13:54:02.437396 (+ 93us) write_op.cc:276] Timestamp: P: 1786370006852488 usec, L: 0
0810 13:54:02.438032 (+ 636us) write_op.cc:270] Start()
0810 13:54:02.438118 (+ 86us) write_op.cc:276] Timestamp: P: 1786370006913676 usec, L: 0
0810 13:54:02.438750 (+ 632us) write_op.cc:270] Start()
0810 13:54:02.438839 (+ 89us) write_op.cc:276] Timestamp: P: 1786370006919171 usec, L: 0
0810 13:54:02.439365 (+ 526us) write_op.cc:270] Start()
0810 13:54:02.439453 (+ 88us) write_op.cc:276] Timestamp: P: 1786370006922466 usec, L: 0
0810 13:54:02.441202 (+ 1749us) write_op.cc:270] Start()
0810 13:54:02.441278 (+ 76us) write_op.cc:276] Timestamp: P: 1786370006925312 usec, L: 0
0810 13:54:02.441722 (+ 444us) write_op.cc:270] Start()
0810 13:54:02.441819 (+ 97us) write_op.cc:276] Timestamp: P: 1786370006928789 usec, L: 0
0810 13:54:02.442421 (+ 602us) write_op.cc:270] Start()
0810 13:54:02.442528 (+ 107us) write_op.cc:276] Timestamp: P: 1786370006931842 usec, L: 0
0810 13:54:02.443090 (+ 562us) write_op.cc:270] Start()
0810 13:54:02.443164 (+ 74us) write_op.cc:276] Timestamp: P: 1786370006934880 usec, L: 0
0810 13:54:02.443572 (+ 408us) write_op.cc:270] Start()
0810 13:54:02.443639 (+ 67us) write_op.cc:276] Timestamp: P: 1786370007099295 usec, L: 0
0810 13:54:02.444082 (+ 443us) write_op.cc:270] Start()
0810 13:54:02.444190 (+ 108us) write_op.cc:276] Timestamp: P: 1786370007126351 usec, L: 0
0810 13:54:02.444808 (+ 618us) write_op.cc:270] Start()
0810 13:54:02.444912 (+ 104us) write_op.cc:276] Timestamp: P: 1786370007201321 usec, L: 0
0810 13:54:02.445353 (+ 441us) write_op.cc:270] Start()
0810 13:54:02.445425 (+ 72us) write_op.cc:276] Timestamp: P: 1786370007261051 usec, L: 0
0810 13:54:02.449197 (+ 3772us) write_op.cc:270] Start()
0810 13:54:02.449347 (+ 150us) write_op.cc:276] Timestamp: P: 1786370007300817 usec, L: 0
0810 13:54:02.449822 (+ 475us) write_op.cc:270] Start()
0810 13:54:02.449896 (+ 74us) write_op.cc:276] Timestamp: P: 1786370007306985 usec, L: 0
0810 13:54:02.450349 (+ 453us) write_op.cc:270] Start()
0810 13:54:02.450430 (+ 81us) write_op.cc:276] Timestamp: P: 1786370007340498 usec, L: 0
0810 13:54:02.450928 (+ 498us) write_op.cc:270] Start()
0810 13:54:02.451002 (+ 74us) write_op.cc:276] Timestamp: P: 1786370007398752 usec, L: 0
0810 13:54:02.451548 (+ 546us) write_op.cc:270] Start()
0810 13:54:02.451700 (+ 152us) write_op.cc:276] Timestamp: P: 1786370007487047 usec, L: 0
0810 13:54:02.452196 (+ 496us) write_op.cc:270] Start()
0810 13:54:02.452273 (+ 77us) write_op.cc:276] Timestamp: P: 1786370007560022 usec, L: 0
0810 13:54:02.452737 (+ 464us) write_op.cc:270] Start()
0810 13:54:02.452814 (+ 77us) write_op.cc:276] Timestamp: P: 1786370007583930 usec, L: 0
0810 13:54:02.453257 (+ 443us) write_op.cc:270] Start()
0810 13:54:02.453330 (+ 73us) write_op.cc:276] Timestamp: P: 1786370007586263 usec, L: 0
0810 13:54:02.453763 (+ 433us) write_op.cc:270] Start()
0810 13:54:02.453831 (+ 68us) write_op.cc:276] Timestamp: P: 1786370007592286 usec, L: 0
0810 13:54:02.454258 (+ 427us) write_op.cc:270] Start()
0810 13:54:02.454331 (+ 73us) write_op.cc:276] Timestamp: P: 1786370007611680 usec, L: 0
0810 13:54:02.454779 (+ 448us) write_op.cc:270] Start()
0810 13:54:02.454865 (+ 86us) write_op.cc:276] Timestamp: P: 1786370007672478 usec, L: 0
0810 13:54:02.455302 (+ 437us) write_op.cc:270] Start()
0810 13:54:02.455380 (+ 78us) write_op.cc:276] Timestamp: P: 1786370007696102 usec, L: 0
0810 13:54:02.455835 (+ 455us) write_op.cc:270] Start()
0810 13:54:02.455913 (+ 78us) write_op.cc:276] Timestamp: P: 1786370007748538 usec, L: 0
0810 13:54:02.465195 (+ 9282us) write_op.cc:270] Start()
0810 13:54:02.465280 (+ 85us) write_op.cc:276] Timestamp: P: 1786370007966321 usec, L: 0
0810 13:54:02.465785 (+ 505us) write_op.cc:270] Start()
0810 13:54:02.465854 (+ 69us) write_op.cc:276] Timestamp: P: 1786370007972304 usec, L: 0
0810 13:54:02.466356 (+ 502us) write_op.cc:270] Start()
0810 13:54:02.466425 (+ 69us) write_op.cc:276] Timestamp: P: 1786370007999822 usec, L: 0
0810 13:54:02.466850 (+ 425us) write_op.cc:270] Start()
0810 13:54:02.466924 (+ 74us) write_op.cc:276] Timestamp: P: 1786370008038183 usec, L: 0
0810 13:54:02.473889 (+ 6965us) write_op.cc:270] Start()
0810 13:54:02.473968 (+ 79us) write_op.cc:276] Timestamp: P: 1786370008051532 usec, L: 0
0810 13:54:02.474518 (+ 550us) write_op.cc:270] Start()
0810 13:54:02.474585 (+ 67us) write_op.cc:276] Timestamp: P: 1786370008146826 usec, L: 0
0810 13:54:02.475004 (+ 419us) write_op.cc:270] Start()
0810 13:54:02.475072 (+ 68us) write_op.cc:276] Timestamp: P: 1786370008180210 usec, L: 0
0810 13:54:02.475446 (+ 374us) write_op.cc:270] Start()
0810 13:54:02.475510 (+ 64us) write_op.cc:276] Timestamp: P: 1786370008184475 usec, L: 0
0810 13:54:02.476012 (+ 502us) write_op.cc:270] Start()
0810 13:54:02.476077 (+ 65us) write_op.cc:276] Timestamp: P: 1786370008266536 usec, L: 0
0810 13:54:02.476466 (+ 389us) write_op.cc:270] Start()
0810 13:54:02.476534 (+ 68us) write_op.cc:276] Timestamp: P: 1786370008276109 usec, L: 0
0810 13:54:02.483189 (+ 6655us) write_op.cc:270] Start()
0810 13:54:02.483269 (+ 80us) write_op.cc:276] Timestamp: P: 1786370008304476 usec, L: 0
0810 13:54:02.483770 (+ 501us) write_op.cc:270] Start()
0810 13:54:02.483843 (+ 73us) write_op.cc:276] Timestamp: P: 1786370008309573 usec, L: 0
0810 13:54:02.484292 (+ 449us) write_op.cc:270] Start()
0810 13:54:02.484367 (+ 75us) write_op.cc:276] Timestamp: P: 1786370008376049 usec, L: 0
0810 13:54:02.484854 (+ 487us) write_op.cc:270] Start()
0810 13:54:02.484923 (+ 69us) write_op.cc:276] Timestamp: P: 1786370008382088 usec, L: 0
0810 13:54:02.485365 (+ 442us) write_op.cc:270] Start()
0810 13:54:02.485444 (+ 79us) write_op.cc:276] Timestamp: P: 1786370008483506 usec, L: 0
0810 13:54:02.494545 (+ 9101us) write_op.cc:270] Start()
0810 13:54:02.494628 (+ 83us) write_op.cc:276] Timestamp: P: 1786370008499997 usec, L: 0
0810 13:54:02.495103 (+ 475us) write_op.cc:270] Start()
0810 13:54:02.495173 (+ 70us) write_op.cc:276] Timestamp: P: 1786370008524027 usec, L: 0
0810 13:54:02.524784 (+ 29611us) write_op.cc:270] Start()
0810 13:54:02.524881 (+ 97us) write_op.cc:276] Timestamp: P: 1786370008528492 usec, L: 0
0810 13:54:02.525373 (+ 492us) write_op.cc:270] Start()
0810 13:54:02.525452 (+ 79us) write_op.cc:276] Timestamp: P: 1786370008573989 usec, L: 0
0810 13:54:02.525905 (+ 453us) write_op.cc:270] Start()
0810 13:54:02.525979 (+ 74us) write_op.cc:276] Timestamp: P: 1786370008610329 usec, L: 0
0810 13:54:02.526402 (+ 423us) write_op.cc:270] Start()
0810 13:54:02.526472 (+ 70us) write_op.cc:276] Timestamp: P: 1786370008647763 usec, L: 0
0810 13:54:02.526924 (+ 452us) write_op.cc:270] Start()
0810 13:54:02.526995 (+ 71us) write_op.cc:276] Timestamp: P: 1786370008730423 usec, L: 0
0810 13:54:02.527447 (+ 452us) write_op.cc:270] Start()
0810 13:54:02.527515 (+ 68us) write_op.cc:276] Timestamp: P: 1786370008753041 usec, L: 0
0810 13:54:02.527941 (+ 426us) write_op.cc:270] Start()
0810 13:54:02.528016 (+ 75us) write_op.cc:276] Timestamp: P: 1786370008872270 usec, L: 0
0810 13:54:02.544436 (+ 16420us) write_op.cc:270] Start()
0810 13:54:02.544512 (+ 76us) write_op.cc:276] Timestamp: P: 1786370008908731 usec, L: 0
0810 13:54:02.545016 (+ 504us) write_op.cc:270] Start()
0810 13:54:02.545082 (+ 66us) write_op.cc:276] Timestamp: P: 1786370008929874 usec, L: 0
0810 13:54:02.545528 (+ 446us) write_op.cc:270] Start()
0810 13:54:02.545597 (+ 69us) write_op.cc:276] Timestamp: P: 1786370008952972 usec, L: 0
0810 13:54:02.546054 (+ 457us) write_op.cc:270] Start()
0810 13:54:02.546130 (+ 76us) write_op.cc:276] Timestamp: P: 1786370008955315 usec, L: 0
0810 13:54:02.546557 (+ 427us) write_op.cc:270] Start()
0810 13:54:02.546625 (+ 68us) write_op.cc:276] Timestamp: P: 1786370009054743 usec, L: 0
0810 13:54:02.547067 (+ 442us) write_op.cc:270] Start()
0810 13:54:02.547134 (+ 67us) write_op.cc:276] Timestamp: P: 1786370009108360 usec, L: 0
0810 13:54:02.547565 (+ 431us) write_op.cc:270] Start()
0810 13:54:02.547646 (+ 81us) write_op.cc:276] Timestamp: P: 1786370009196518 usec, L: 0
0810 13:54:02.548080 (+ 434us) write_op.cc:270] Start()
0810 13:54:02.548150 (+ 70us) write_op.cc:276] Timestamp: P: 1786370009246559 usec, L: 0
0810 13:54:02.548561 (+ 411us) write_op.cc:270] Start()
0810 13:54:02.548631 (+ 70us) write_op.cc:276] Timestamp: P: 1786370009281495 usec, L: 0
0810 13:54:02.579429 (+ 30798us) write_op.cc:270] Start()
0810 13:54:02.579513 (+ 84us) write_op.cc:276] Timestamp: P: 1786370009291985 usec, L: 0
0810 13:54:02.579991 (+ 478us) write_op.cc:270] Start()
0810 13:54:02.580061 (+ 70us) write_op.cc:276] Timestamp: P: 1786370009358313 usec, L: 0
0810 13:54:02.580494 (+ 433us) write_op.cc:270] Start()
0810 13:54:02.580559 (+ 65us) write_op.cc:276] Timestamp: P: 1786370009362895 usec, L: 0
0810 13:54:02.581019 (+ 460us) write_op.cc:270] Start()
0810 13:54:02.585954 (+ 4935us) write_op.cc:276] Timestamp: P: 1786370009387091 usec, L: 0
0810 13:54:02.586501 (+ 547us) write_op.cc:270] Start()
0810 13:54:02.586667 (+ 166us) write_op.cc:276] Timestamp: P: 1786370009405700 usec, L: 0
0810 13:54:02.587078 (+ 411us) write_op.cc:270] Start()
0810 13:54:02.587141 (+ 63us) write_op.cc:276] Timestamp: P: 1786370009445487 usec, L: 0
0810 13:54:02.587541 (+ 400us) write_op.cc:270] Start()
0810 13:54:02.587603 (+ 62us) write_op.cc:276] Timestamp: P: 1786370009464583 usec, L: 0
0810 13:54:02.587988 (+ 385us) write_op.cc:270] Start()
0810 13:54:02.588058 (+ 70us) write_op.cc:276] Timestamp: P: 1786370009514000 usec, L: 0
0810 13:54:02.588471 (+ 413us) write_op.cc:270] Start()
0810 13:54:02.588631 (+ 160us) write_op.cc:276] Timestamp: P: 1786370009617522 usec, L: 0
0810 13:54:02.589212 (+ 581us) write_op.cc:270] Start()
0810 13:54:02.589279 (+ 67us) write_op.cc:276] Timestamp: P: 1786370009649585 usec, L: 0
0810 13:54:02.589713 (+ 434us) write_op.cc:270] Start()
0810 13:54:02.589796 (+ 83us) write_op.cc:276] Timestamp: P: 1786370009700498 usec, L: 0
0810 13:54:02.590215 (+ 419us) write_op.cc:270] Start()
0810 13:54:02.590284 (+ 69us) write_op.cc:276] Timestamp: P: 1786370009762567 usec, L: 0
0810 13:54:02.590694 (+ 410us) write_op.cc:270] Start()
0810 13:54:02.590775 (+ 81us) write_op.cc:276] Timestamp: P: 1786370009812401 usec, L: 0
0810 13:54:02.630073 (+ 39298us) write_op.cc:270] Start()
0810 13:54:02.630160 (+ 87us) write_op.cc:276] Timestamp: P: 1786370009867941 usec, L: 0
0810 13:54:02.630639 (+ 479us) write_op.cc:270] Start()
0810 13:54:02.630707 (+ 68us) write_op.cc:276] Timestamp: P: 1786370010006894 usec, L: 0
0810 13:54:02.631153 (+ 446us) write_op.cc:270] Start()
0810 13:54:02.631228 (+ 75us) write_op.cc:276] Timestamp: P: 1786370010098541 usec, L: 0
0810 13:54:02.631627 (+ 399us) write_op.cc:270] Start()
0810 13:54:02.631686 (+ 59us) write_op.cc:276] Timestamp: P: 1786370010101470 usec, L: 0
0810 13:54:02.632094 (+ 408us) write_op.cc:270] Start()
0810 13:54:02.632186 (+ 92us) write_op.cc:276] Timestamp: P: 1786370010147608 usec, L: 0
0810 13:54:02.650050 (+ 17864us) write_op.cc:270] Start()
0810 13:54:02.650163 (+ 113us) write_op.cc:276] Timestamp: P: 1786370010171355 usec, L: 0
0810 13:54:02.665261 (+ 15098us) write_op.cc:270] Start()
0810 13:54:02.665350 (+ 89us) write_op.cc:276] Timestamp: P: 1786370010202069 usec, L: 0
0810 13:54:02.665831 (+ 481us) write_op.cc:270] Start()
0810 13:54:02.665903 (+ 72us) write_op.cc:276] Timestamp: P: 1786370010269412 usec, L: 0
0810 13:54:02.666325 (+ 422us) write_op.cc:270] Start()
0810 13:54:02.666390 (+ 65us) write_op.cc:276] Timestamp: P: 1786370010296004 usec, L: 0
0810 13:54:02.666796 (+ 406us) write_op.cc:270] Start()
0810 13:54:02.666876 (+ 80us) write_op.cc:276] Timestamp: P: 1786370010308882 usec, L: 0
0810 13:54:02.667290 (+ 414us) write_op.cc:270] Start()
0810 13:54:02.667356 (+ 66us) write_op.cc:276] Timestamp: P: 1786370010310569 usec, L: 0
0810 13:54:02.667758 (+ 402us) write_op.cc:270] Start()
0810 13:54:02.667823 (+ 65us) write_op.cc:276] Timestamp: P: 1786370010347527 usec, L: 0
0810 13:54:02.668227 (+ 404us) write_op.cc:270] Start()
0810 13:54:02.668293 (+ 66us) write_op.cc:276] Timestamp: P: 1786370010385537 usec, L: 0
0810 13:54:02.668761 (+ 468us) write_op.cc:270] Start()
0810 13:54:02.668829 (+ 68us) write_op.cc:276] Timestamp: P: 1786370010406775 usec, L: 0
0810 13:54:02.669237 (+ 408us) write_op.cc:270] Start()
0810 13:54:02.669307 (+ 70us) write_op.cc:276] Timestamp: P: 1786370010454484 usec, L: 0
0810 13:54:02.669707 (+ 400us) write_op.cc:270] Start()
0810 13:54:02.669770 (+ 63us) write_op.cc:276] Timestamp: P: 1786370010518794 usec, L: 0
0810 13:54:02.670169 (+ 399us) write_op.cc:270] Start()
0810 13:54:02.670261 (+ 92us) write_op.cc:276] Timestamp: P: 1786370010554039 usec, L: 0
0810 13:54:02.670655 (+ 394us) write_op.cc:270] Start()
0810 13:54:02.670717 (+ 62us) write_op.cc:276] Timestamp: P: 1786370010568342 usec, L: 0
0810 13:54:02.671098 (+ 381us) write_op.cc:270] Start()
0810 13:54:02.671162 (+ 64us) write_op.cc:276] Timestamp: P: 1786370010617078 usec, L: 0
0810 13:54:02.671568 (+ 406us) write_op.cc:270] Start()
0810 13:54:02.671631 (+ 63us) write_op.cc:276] Timestamp: P: 1786370010619239 usec, L: 0
0810 13:54:02.672020 (+ 389us) write_op.cc:270] Start()
0810 13:54:02.672079 (+ 59us) write_op.cc:276] Timestamp: P: 1786370010874606 usec, L: 0
0810 13:54:02.672507 (+ 428us) write_op.cc:270] Start()
0810 13:54:02.672572 (+ 65us) write_op.cc:276] Timestamp: P: 1786370010893878 usec, L: 0
0810 13:54:02.695962 (+ 23390us) write_op.cc:270] Start()
0810 13:54:02.696053 (+ 91us) write_op.cc:276] Timestamp: P: 1786370010942304 usec, L: 0
0810 13:54:02.696624 (+ 571us) write_op.cc:270] Start()
0810 13:54:02.696720 (+ 96us) write_op.cc:276] Timestamp: P: 1786370010953874 usec, L: 0
0810 13:54:02.697353 (+ 633us) write_op.cc:270] Start()
0810 13:54:02.697427 (+ 74us) write_op.cc:276] Timestamp: P: 1786370011053826 usec, L: 0
0810 13:54:02.697870 (+ 443us) write_op.cc:270] Start()
0810 13:54:02.697940 (+ 70us) write_op.cc:276] Timestamp: P: 1786370011071824 usec, L: 0
0810 13:54:02.698553 (+ 613us) write_op.cc:270] Start()
0810 13:54:02.698626 (+ 73us) write_op.cc:276] Timestamp: P: 1786370011074235 usec, L: 0
0810 13:54:02.699163 (+ 537us) write_op.cc:270] Start()
0810 13:54:02.699246 (+ 83us) write_op.cc:276] Timestamp: P: 1786370011098685 usec, L: 0
0810 13:54:02.699666 (+ 420us) write_op.cc:270] Start()
0810 13:54:02.699747 (+ 81us) write_op.cc:276] Timestamp: P: 1786370011161636 usec, L: 0
0810 13:54:02.700166 (+ 419us) write_op.cc:270] Start()
0810 13:54:02.700254 (+ 88us) write_op.cc:276] Timestamp: P: 1786370011167553 usec, L: 0
0810 13:54:02.700658 (+ 404us) write_op.cc:270] Start()
0810 13:54:02.723764 (+ 23106us) write_op.cc:276] Timestamp: P: 1786370011172859 usec, L: 0
0810 13:54:02.781078 (+ 57314us) write_op.cc:270] Start()
0810 13:54:02.781183 (+ 105us) write_op.cc:276] Timestamp: P: 1786370011232070 usec, L: 0
0810 13:54:02.806654 (+ 25471us) write_op.cc:270] Start()
0810 13:54:02.806751 (+ 97us) write_op.cc:276] Timestamp: P: 1786370011265418 usec, L: 0
0810 13:54:02.807290 (+ 539us) write_op.cc:270] Start()
0810 13:54:02.807379 (+ 89us) write_op.cc:276] Timestamp: P: 1786370011366502 usec, L: 0
0810 13:54:02.807840 (+ 461us) write_op.cc:270] Start()
0810 13:54:02.807921 (+ 81us) write_op.cc:276] Timestamp: P: 1786370011486931 usec, L: 0
0810 13:54:02.808364 (+ 443us) write_op.cc:270] Start()
0810 13:54:02.808434 (+ 70us) write_op.cc:276] Timestamp: P: 1786370011511614 usec, L: 0
0810 13:54:02.813387 (+ 4953us) write_op.cc:270] Start()
0810 13:54:02.813465 (+ 78us) write_op.cc:276] Timestamp: P: 1786370011516970 usec, L: 0
0810 13:54:02.813910 (+ 445us) write_op.cc:270] Start()
0810 13:54:02.813978 (+ 68us) write_op.cc:276] Timestamp: P: 1786370011521065 usec, L: 0
0810 13:54:02.814402 (+ 424us) write_op.cc:270] Start()
0810 13:54:02.814474 (+ 72us) write_op.cc:276] Timestamp: P: 1786370011584182 usec, L: 0
0810 13:54:02.814923 (+ 449us) write_op.cc:270] Start()
0810 13:54:02.814993 (+ 70us) write_op.cc:276] Timestamp: P: 1786370011587121 usec, L: 0
0810 13:54:02.815394 (+ 401us) write_op.cc:270] Start()
0810 13:54:02.815465 (+ 71us) write_op.cc:276] Timestamp: P: 1786370011847545 usec, L: 0
0810 13:54:02.815898 (+ 433us) write_op.cc:270] Start()
0810 13:54:02.815970 (+ 72us) write_op.cc:276] Timestamp: P: 1786370011888292 usec, L: 0
0810 13:54:02.816406 (+ 436us) write_op.cc:270] Start()
0810 13:54:02.816477 (+ 71us) write_op.cc:276] Timestamp: P: 1786370011902000 usec, L: 0
0810 13:54:02.834118 (+ 17641us) write_op.cc:270] Start()
0810 13:54:02.834195 (+ 77us) write_op.cc:276] Timestamp: P: 1786370012045001 usec, L: 0
0810 13:54:02.834635 (+ 440us) write_op.cc:270] Start()
0810 13:54:02.834715 (+ 80us) write_op.cc:276] Timestamp: P: 1786370012052820 usec, L: 0
0810 13:54:02.835124 (+ 409us) write_op.cc:270] Start()
0810 13:54:02.835188 (+ 64us) write_op.cc:276] Timestamp: P: 1786370012072612 usec, L: 0
0810 13:54:02.835592 (+ 404us) write_op.cc:270] Start()
0810 13:54:02.835669 (+ 77us) write_op.cc:276] Timestamp: P: 1786370012076572 usec, L: 0
0810 13:54:02.861269 (+ 25600us) write_op.cc:270] Start()
0810 13:54:02.861369 (+ 100us) write_op.cc:276] Timestamp: P: 1786370012116081 usec, L: 0
0810 13:54:02.861853 (+ 484us) write_op.cc:270] Start()
0810 13:54:02.861943 (+ 90us) write_op.cc:276] Timestamp: P: 1786370012194779 usec, L: 0
0810 13:54:02.862369 (+ 426us) write_op.cc:270] Start()
0810 13:54:02.862439 (+ 70us) write_op.cc:276] Timestamp: P: 1786370012344114 usec, L: 0
0810 13:54:02.862855 (+ 416us) write_op.cc:270] Start()
0810 13:54:02.862923 (+ 68us) write_op.cc:276] Timestamp: P: 1786370012381418 usec, L: 0
0810 13:54:02.863361 (+ 438us) write_op.cc:270] Start()
0810 13:54:02.863423 (+ 62us) write_op.cc:276] Timestamp: P: 1786370012385838 usec, L: 0
0810 13:54:02.879203 (+ 15780us) write_op.cc:270] Start()
0810 13:54:02.879287 (+ 84us) write_op.cc:276] Timestamp: P: 1786370012392154 usec, L: 0
0810 13:54:02.883207 (+ 3920us) write_op.cc:270] Start()
0810 13:54:02.884100 (+ 893us) write_op.cc:276] Timestamp: P: 1786370012408854 usec, L: 0
0810 13:54:02.884561 (+ 461us) write_op.cc:270] Start()
0810 13:54:02.884629 (+ 68us) write_op.cc:276] Timestamp: P: 1786370012646209 usec, L: 0
0810 13:54:02.885111 (+ 482us) write_op.cc:270] Start()
0810 13:54:02.885183 (+ 72us) write_op.cc:276] Timestamp: P: 1786370012651386 usec, L: 0
0810 13:54:02.885600 (+ 417us) write_op.cc:270] Start()
0810 13:54:02.885671 (+ 71us) write_op.cc:276] Timestamp: P: 1786370012689763 usec, L: 0
0810 13:54:02.886095 (+ 424us) write_op.cc:270] Start()
0810 13:54:02.886158 (+ 63us) write_op.cc:276] Timestamp: P: 1786370012691850 usec, L: 0
0810 13:54:02.886584 (+ 426us) write_op.cc:270] Start()
0810 13:54:02.886653 (+ 69us) write_op.cc:276] Timestamp: P: 1786370012845752 usec, L: 0
0810 13:54:02.887061 (+ 408us) write_op.cc:270] Start()
0810 13:54:02.887133 (+ 72us) write_op.cc:276] Timestamp: P: 1786370012918088 usec, L: 0
0810 13:54:02.887540 (+ 407us) write_op.cc:270] Start()
0810 13:54:02.887614 (+ 74us) write_op.cc:276] Timestamp: P: 1786370012922027 usec, L: 0
0810 13:54:02.888020 (+ 406us) write_op.cc:270] Start()
0810 13:54:02.888090 (+ 70us) write_op.cc:276] Timestamp: P: 1786370012925300 usec, L: 0
0810 13:54:02.888494 (+ 404us) write_op.cc:270] Start()
0810 13:54:02.888629 (+ 135us) write_op.cc:276] Timestamp: P: 1786370013003337 usec, L: 0
0810 13:54:03.201533 (+312904us) write_op.cc:270] Start()
0810 13:54:03.201648 (+ 115us) write_op.cc:276] Timestamp: P: 1786370013046351 usec, L: 0
0810 13:54:03.202350 (+ 702us) write_op.cc:270] Start()
0810 13:54:03.202549 (+ 199us) write_op.cc:276] Timestamp: P: 1786370013090612 usec, L: 0
0810 13:54:03.338645 (+136096us) write_op.cc:270] Start()
0810 13:54:03.338745 (+ 100us) write_op.cc:276] Timestamp: P: 1786370013139443 usec, L: 0
0810 13:54:03.339313 (+ 568us) write_op.cc:270] Start()
0810 13:54:03.339400 (+ 87us) write_op.cc:276] Timestamp: P: 1786370013142107 usec, L: 0
0810 13:54:03.339851 (+ 451us) write_op.cc:270] Start()
0810 13:54:03.339927 (+ 76us) write_op.cc:276] Timestamp: P: 1786370013184944 usec, L: 0
0810 13:54:03.340326 (+ 399us) write_op.cc:270] Start()
0810 13:54:03.340396 (+ 70us) write_op.cc:276] Timestamp: P: 1786370013189289 usec, L: 0
0810 13:54:03.475575 (+135179us) write_op.cc:270] Start()
0810 13:54:03.475679 (+ 104us) write_op.cc:276] Timestamp: P: 1786370013252763 usec, L: 0
0810 13:54:03.476315 (+ 636us) write_op.cc:270] Start()
0810 13:54:03.476395 (+ 80us) write_op.cc:276] Timestamp: P: 1786370013290750 usec, L: 0
0810 13:54:03.477000 (+ 605us) write_op.cc:270] Start()
0810 13:54:03.477068 (+ 68us) write_op.cc:276] Timestamp: P: 1786370013300180 usec, L: 0
0810 13:54:03.477554 (+ 486us) write_op.cc:270] Start()
0810 13:54:03.477619 (+ 65us) write_op.cc:276] Timestamp: P: 1786370013304426 usec, L: 0
0810 13:54:03.478079 (+ 460us) write_op.cc:270] Start()
0810 13:54:03.478149 (+ 70us) write_op.cc:276] Timestamp: P: 1786370013310623 usec, L: 0
0810 13:54:03.478607 (+ 458us) write_op.cc:270] Start()
0810 13:54:03.478686 (+ 79us) write_op.cc:276] Timestamp: P: 1786370013461247 usec, L: 0
0810 13:54:03.479348 (+ 662us) write_op.cc:270] Start()
0810 13:54:03.479416 (+ 68us) write_op.cc:276] Timestamp: P: 1786370013540531 usec, L: 0
0810 13:54:03.479974 (+ 558us) write_op.cc:270] Start()
0810 13:54:03.480043 (+ 69us) write_op.cc:276] Timestamp: P: 1786370013586332 usec, L: 0
0810 13:54:03.480530 (+ 487us) write_op.cc:270] Start()
0810 13:54:03.480596 (+ 66us) write_op.cc:276] Timestamp: P: 1786370013620179 usec, L: 0
0810 13:54:03.507522 (+ 26926us) write_op.cc:270] Start()
0810 13:54:03.507621 (+ 99us) write_op.cc:276] Timestamp: P: 1786370013628442 usec, L: 0
0810 13:54:03.508256 (+ 635us) write_op.cc:270] Start()
0810 13:54:03.508334 (+ 78us) write_op.cc:276] Timestamp: P: 1786370013639428 usec, L: 0
0810 13:54:03.508916 (+ 582us) write_op.cc:270] Start()
0810 13:54:03.509036 (+ 120us) write_op.cc:276] Timestamp: P: 1786370013716411 usec, L: 0
0810 13:54:03.509635 (+ 599us) write_op.cc:270] Start()
0810 13:54:03.509711 (+ 76us) write_op.cc:276] Timestamp: P: 1786370013728093 usec, L: 0
0810 13:54:03.510240 (+ 529us) write_op.cc:270] Start()
0810 13:54:03.510342 (+ 102us) write_op.cc:276] Timestamp: P: 1786370013731113 usec, L: 0
0810 13:54:03.510866 (+ 524us) write_op.cc:270] Start()
0810 13:54:03.510933 (+ 67us) write_op.cc:276] Timestamp: P: 1786370013736555 usec, L: 0
0810 13:54:03.511409 (+ 476us) write_op.cc:270] Start()
0810 13:54:03.511478 (+ 69us) write_op.cc:276] Timestamp: P: 1786370013782865 usec, L: 0
0810 13:54:03.511939 (+ 461us) write_op.cc:270] Start()
0810 13:54:03.512013 (+ 74us) write_op.cc:276] Timestamp: P: 1786370013866423 usec, L: 0
0810 13:54:03.512528 (+ 515us) write_op.cc:270] Start()
0810 13:54:03.512601 (+ 73us) write_op.cc:276] Timestamp: P: 1786370013938596 usec, L: 0
0810 13:54:03.623910 (+111309us) write_op.cc:270] Start()
0810 13:54:03.624043 (+ 133us) write_op.cc:276] Timestamp: P: 1786370013987570 usec, L: 0
0810 13:54:03.624606 (+ 563us) write_op.cc:270] Start()
0810 13:54:03.624676 (+ 70us) write_op.cc:276] Timestamp: P: 1786370013989454 usec, L: 0
0810 13:54:03.625186 (+ 510us) write_op.cc:270] Start()
0810 13:54:03.625256 (+ 70us) write_op.cc:276] Timestamp: P: 1786370013991069 usec, L: 0
0810 13:54:03.625698 (+ 442us) write_op.cc:270] Start()
0810 13:54:03.625771 (+ 73us) write_op.cc:276] Timestamp: P: 1786370013998291 usec, L: 0
0810 13:54:03.626370 (+ 599us) write_op.cc:270] Start()
0810 13:54:03.626443 (+ 73us) write_op.cc:276] Timestamp: P: 1786370014148616 usec, L: 0
0810 13:54:03.626912 (+ 469us) write_op.cc:270] Start()
0810 13:54:03.626986 (+ 74us) write_op.cc:276] Timestamp: P: 1786370014223434 usec, L: 0
0810 13:54:03.629545 (+ 2559us) write_op.cc:270] Start()
0810 13:54:03.629613 (+ 68us) write_op.cc:276] Timestamp
I20260810 13:54:21.379745 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:21.380420 13468 raft_consensus.cc:2468] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:21.391649 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]
I20260810 13:54:21.407922 16232 consensus_queue.cc:1048] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:21.425349 13640 tablet_bootstrap.cc:492] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:21.425804 13640 ts_tablet_manager.cc:1403] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.161s user 0.013s sys 0.004s
W20260810 13:54:21.430172 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 44037.4us
I20260810 13:54:21.437599 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:21.438268 13468 raft_consensus.cc:2468] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:54:21.441244 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:21.444244 13382 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:21.445062 16275 raft_consensus.cc:2804] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:21.445389 16275 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:21.445669 16275 raft_consensus.cc:3060] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.454035 16342 raft_consensus.cc:493] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.454735 16428 raft_consensus.cc:2804] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:21.454947 16342 raft_consensus.cc:515] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:21.455837 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 191923us
I20260810 13:54:21.456570 12951 leader_election.cc:304] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:21.457036 13639 tablet_bootstrap.cc:492] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:21.457628 13639 ts_tablet_manager.cc:1403] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.184s user 0.029s sys 0.029s
I20260810 13:54:21.457628 16427 raft_consensus.cc:2804] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:21.458989 16427 raft_consensus.cc:697] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:21.455255 16428 raft_consensus.cc:697] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
W20260810 13:54:21.460541 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:21.459962 16427 consensus_queue.cc:237] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.461118 16428 consensus_queue.cc:237] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.462445 13639 raft_consensus.cc:359] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.463281 13639 raft_consensus.cc:385] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:21.463610 13639 raft_consensus.cc:740] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:21.464481 13639 consensus_queue.cc:260] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.465080 16342 leader_election.cc:290] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:21.466581 13639 ts_tablet_manager.cc:1434] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260810 13:54:21.469235 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:21.469893 13050 raft_consensus.cc:2468] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:21.474874 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:21.478214 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350b68f6c1cf48ff8e5f8521e5a4dad6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:21.478853 13037 raft_consensus.cc:2468] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:21.368583 13638 raft_consensus.cc:740] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:21.428236 13640 raft_consensus.cc:359] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.480826 13640 raft_consensus.cc:385] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:21.481119 13640 raft_consensus.cc:740] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:21.468643 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:21.485116 13041 raft_consensus.cc:3060] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.488193 13050 raft_consensus.cc:3060] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.488804 13638 consensus_queue.cc:260] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.491003 13638 ts_tablet_manager.cc:1434] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.126s user 0.005s sys 0.000s
I20260810 13:54:21.491974 13638 tablet_bootstrap.cc:492] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:21.492586 15216 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 5 FOLLOWER]: Refusing update from remote peer 1298bde14cec4cd3a9d6338c7d47f0b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 556. Preceding OpId from leader: term: 5 index: 821. (index mismatch)
I20260810 13:54:21.494170 16409 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 821, Last known committed idx: 556, Time since last communication: 0.000s
I20260810 13:54:21.513646 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_09a6fde1eefc4ce0a591129d6ab65e3a [id=8b4fe3206c2344728b61ed31b33580a6]
I20260810 13:54:21.515221 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_213c40da56b549d3bb97fccaa8f872cd [id=8bb576bce14b4fc3b1848496c6081841]
I20260810 13:54:21.492278 13640 consensus_queue.cc:260] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.526046 13640 ts_tablet_manager.cc:1434] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.100s user 0.007s sys 0.000s
W20260810 13:54:21.531334 12729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 0.698s (SENT) [suppressed 2 similar messages]
W20260810 13:54:21.535398 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 127660us
I20260810 13:54:21.542567 16275 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.544745 16275 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:21.548069 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:21.548746 13046 raft_consensus.cc:2468] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:21.555790 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:21.556411 13046 raft_consensus.cc:2468] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:21.571444 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_72fd7834d8574cb1a74c1d08699d1f7e [id=8cdd566d9af748b6a8d998ecf7221fb6]
I20260810 13:54:21.574045 13639 tablet_bootstrap.cc:492] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:21.583276 13164 leader_election.cc:343] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 350b68f6c1cf48ff8e5f8521e5a4dad6
I20260810 13:54:21.584901 16450 consensus_queue.cc:1048] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:21.587107 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 142925us
I20260810 13:54:21.594381 16232 raft_consensus.cc:493] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.594980 16232 raft_consensus.cc:515] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.572878 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ee42df273bce4386bbf8edb282c2059a [id=8d115ba01bfd4ed7b90f6531e9ef66c2]
I20260810 13:54:21.598210 16232 leader_election.cc:290] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:21.607348 13382 leader_election.cc:343] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:21.610005 13382 leader_election.cc:343] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: a43def9358894b2aa001a7db56706589
I20260810 13:54:21.608304 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_819cbf37633d4c75ba529b0d037cb8db [id=8d2ee7c5b732405c804aec9f79e98038]
I20260810 13:54:21.638540 13167 leader_election.cc:304] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:21.655200 16430 raft_consensus.cc:2749] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:21.657004 15348 ts_tablet_manager.cc:1929] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 13:54:21.657457 15348 log.cc:1199] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/a43def9358894b2aa001a7db56706589
I20260810 13:54:21.658618 13638 tablet_bootstrap.cc:654] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:21.645527 16232 raft_consensus.cc:2804] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:21.663837 16232 raft_consensus.cc:493] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:21.624344 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]
I20260810 13:54:21.665693 16232 raft_consensus.cc:3060] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.655709 13639 tablet_bootstrap.cc:654] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:21.674288 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fe0baa9629ad42fbb05cfbc004e62688 [id=907a4591204d4db697b44488fef76406]
I20260810 13:54:21.675051 15348 ts_tablet_manager.cc:1950] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
W20260810 13:54:21.685469 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 45875.2us
I20260810 13:54:21.693085 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:21.693133 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:21.680521 16444 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.699086 16444 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:21.701313 16444 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:21.702950 15216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 820 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:21.703562 15216 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9666026fb7e4c85b46c6aab952932fb in term 5.
I20260810 13:54:21.704824 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb; no voters:
I20260810 13:54:21.705612 16444 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260810 13:54:21.705912 16444 raft_consensus.cc:493] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:21.706195 16444 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 5 FOLLOWER]: Advancing to term 6
I20260810 13:54:21.713389 16444 raft_consensus.cc:515] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:21.716521 15216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d9666026fb7e4c85b46c6aab952932fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 820 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d"
I20260810 13:54:21.717105 15216 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 5 FOLLOWER]: Advancing to term 6
I20260810 13:54:21.724387 13167 leader_election.cc:304] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:21.725291 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 102841us
I20260810 13:54:21.728493 13167 leader_election.cc:304] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:21.727049 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2c6e1c408acb44358898a1a4ff356bdd [id=909cf43e9f9e4d439f8f246cef081d56]
I20260810 13:54:21.730028 16450 raft_consensus.cc:2804] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:21.730443 16450 raft_consensus.cc:493] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:21.730652 15216 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9666026fb7e4c85b46c6aab952932fb in term 6.
I20260810 13:54:21.732020 12473 leader_election.cc:304] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb; no voters:
I20260810 13:54:21.733743 16450 raft_consensus.cc:3060] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:21.737193 12729 leader_election.cc:336] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317): Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 0.558s (SENT)
I20260810 13:54:21.747006 16405 raft_consensus.cc:2804] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:21.747514 16405 raft_consensus.cc:493] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:21.747977 16405 raft_consensus.cc:3060] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.766208 16444 leader_election.cc:290] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 6 election: Requested vote from peers 2928f7d4503145b182d99007d240334d (127.12.36.61:35861), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:21.766914 16444 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 6 FOLLOWER]: Leader election won for term 6
I20260810 13:54:21.767405 16444 raft_consensus.cc:697] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 6 LEADER]: Becoming Leader. State: Replica: d9666026fb7e4c85b46c6aab952932fb, State: Running, Role: LEADER
I20260810 13:54:21.774590 13640 tablet_bootstrap.cc:492] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:21.780006 13640 tablet_bootstrap.cc:654] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:21.780385 12951 leader_election.cc:304] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:21.781692 16430 raft_consensus.cc:2804] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:21.781911 12951 leader_election.cc:304] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:21.782142 16430 raft_consensus.cc:493] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:21.782727 16342 consensus_queue.cc:1048] T 1d78892783474b329e31bf2df7d2952c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:21.783273 16349 raft_consensus.cc:2804] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:21.783751 16428 consensus_queue.cc:1048] T 121d7abf368a4cf99fd045b8c8ba4b69 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:21.784260 16342 raft_consensus.cc:493] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:21.783598 16349 raft_consensus.cc:493] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:21.784732 16342 raft_consensus.cc:515] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.785213 16349 raft_consensus.cc:3060] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.786691 16342 leader_election.cc:290] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:21.787701 16430 raft_consensus.cc:3060] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.793473 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 584) took 9937 ms. Trace:
I20260810 13:54:21.793819 15348 rpcz_store.cc:276] 0810 13:54:11.855982 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.856087 (+ 105us) service_pool.cc:224] Handling call
0810 13:54:21.338403 (+9482316us) ts_tablet_manager.cc:1151] Deleting tablet a43def9358894b2aa001a7db56706589
0810 13:54:21.338469 (+ 66us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:21.542470 (+204001us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:21.656864 (+114394us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:21.793410 (+136546us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9481617}
I20260810 13:54:21.796144 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 585) took 9939 ms. Trace:
I20260810 13:54:21.796437 15348 rpcz_store.cc:276] 0810 13:54:11.857050 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.857141 (+ 91us) service_pool.cc:224] Handling call
0810 13:54:21.795745 (+9938604us) ts_tablet_manager.cc:1151] Deleting tablet 995d901d22484799bd79fcad8103b8a5
0810 13:54:21.795800 (+ 55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:21.796098 (+ 298us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9938152}
I20260810 13:54:21.797626 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 594) took 9936 ms. Trace:
I20260810 13:54:21.797926 15348 rpcz_store.cc:276] 0810 13:54:11.861524 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:11.916522 (+ 54998us) service_pool.cc:224] Handling call
0810 13:54:21.797261 (+9880739us) ts_tablet_manager.cc:1151] Deleting tablet de012d382b194bf193fef76779abcf17
0810 13:54:21.797312 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:21.797579 (+ 267us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":9690765}
I20260810 13:54:21.799012 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 595) took 8480 ms. Trace:
I20260810 13:54:21.799296 15348 rpcz_store.cc:276] 0810 13:54:13.318269 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.318381 (+ 112us) service_pool.cc:224] Handling call
0810 13:54:21.798680 (+8480299us) ts_tablet_manager.cc:1151] Deleting tablet 3610bc4f8a0742fdb69347b40a04f078
0810 13:54:21.798729 (+ 49us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:21.798969 (+ 240us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8479734}
I20260810 13:54:21.800382 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 599) took 8343 ms. Trace:
I20260810 13:54:21.802706 16349 raft_consensus.cc:515] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:21.805716 12473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 73789.5us
I20260810 13:54:21.808310 13639 tablet_bootstrap.cc:492] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:21.808811 13639 ts_tablet_manager.cc:1403] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.235s user 0.016s sys 0.007s
I20260810 13:54:21.812016 13639 raft_consensus.cc:359] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.812748 13639 raft_consensus.cc:385] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:21.813035 13639 raft_consensus.cc:740] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:21.813335 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 84900.7us
I20260810 13:54:21.813752 13639 consensus_queue.cc:260] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.814428 16185 consensus_queue.cc:1048] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:21.817863 13041 raft_consensus.cc:3060] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.818157 13639 ts_tablet_manager.cc:1434] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260810 13:54:21.832798 16349 leader_election.cc:290] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:21.837093 13638 tablet_bootstrap.cc:492] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:21.837518 13638 ts_tablet_manager.cc:1403] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.346s user 0.010s sys 0.001s
I20260810 13:54:21.838492 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]
I20260810 13:54:21.768824 16444 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 819, Committed index: 819, Last appended: 4.820, Last appended by leader: 820, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:21.840951 13638 raft_consensus.cc:359] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.841573 13638 raft_consensus.cc:385] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:21.841835 13638 raft_consensus.cc:740] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:21.842464 13638 consensus_queue.cc:260] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.844400 13638 ts_tablet_manager.cc:1434] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260810 13:54:21.860324 13639 tablet_bootstrap.cc:492] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:21.867465 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_bc50dbac8249499e90b8d763fd7041f2 [id=92622bf6828843419776bf2bbe0c6aee]
I20260810 13:54:21.850922 16232 raft_consensus.cc:515] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.871803 16232 leader_election.cc:290] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:21.878535 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:21.879105 13049 raft_consensus.cc:3060] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.884182 13639 tablet_bootstrap.cc:654] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:21.885792 13049 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:21.800658 15348 rpcz_store.cc:276] 0810 13:54:13.457310 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:13.457460 (+ 150us) service_pool.cc:224] Handling call
0810 13:54:21.800034 (+8342574us) ts_tablet_manager.cc:1151] Deleting tablet 613d7ddce24b45c886139bf68c3c9a4d
0810 13:54:21.800085 (+ 51us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:21.800336 (+ 251us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8342017}
I20260810 13:54:21.848565 13640 tablet_bootstrap.cc:492] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:21.899628 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:21.902868 13468 raft_consensus.cc:2468] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:21.903800 13640 ts_tablet_manager.cc:1403] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.129s user 0.012s sys 0.000s
I20260810 13:54:21.906531 13640 raft_consensus.cc:359] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.907208 13640 raft_consensus.cc:385] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:21.911325 13640 raft_consensus.cc:740] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:21.926029 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:21.932174 16482 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9666026fb7e4c85b46c6aab952932fb. Latest consensus state: current_term: 6 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:21.941218 16482 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: This master's current role is: LEADER
I20260810 13:54:21.949528 13640 consensus_queue.cc:260] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:21.963932 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350b68f6c1cf48ff8e5f8521e5a4dad6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:21.964454 13049 raft_consensus.cc:3060] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.908210 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 600) took 7812 ms. Trace:
I20260810 13:54:21.969349 15348 rpcz_store.cc:276] 0810 13:54:14.095551 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:14.095660 (+ 109us) service_pool.cc:224] Handling call
0810 13:54:21.907773 (+7812113us) ts_tablet_manager.cc:1151] Deleting tablet e828861d499a400c834b848acdb2afc5
0810 13:54:21.907837 (+ 64us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:21.908160 (+ 323us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7811606}
I20260810 13:54:21.913910 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:21.970356 13638 tablet_bootstrap.cc:492] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:21.914881 16479 consensus_queue.cc:1048] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:21.917440 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:21.952291 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:21.971648 13265 raft_consensus.cc:3060] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.974701 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]
I20260810 13:54:21.955447 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:21.957587 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:21.958577 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:21.976022 13264 raft_consensus.cc:3060] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:21.977738 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 601) took 6331 ms. Trace:
I20260810 13:54:21.987495 13265 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:21.978034 15348 rpcz_store.cc:276] 0810 13:54:15.646426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.646560 (+ 134us) service_pool.cc:224] Handling call
0810 13:54:21.977426 (+6330866us) ts_tablet_manager.cc:1151] Deleting tablet 73ad47d29d61456891478a9544594a94
0810 13:54:21.977484 (+ 58us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:21.977682 (+ 198us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6330173}
I20260810 13:54:22.011574 15348 tablet_replica.cc:333] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: stopping tablet replica
I20260810 13:54:22.012392 13640 ts_tablet_manager.cc:1434] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.108s user 0.005s sys 0.001s
I20260810 13:54:22.020133 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:22.030112 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3c8a09c1dfda4797918bd6715bdfebce [id=9656e3a9a8f6431cb7b42ea64ae16159]
I20260810 13:54:22.031677 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ea7f41d802964936a967be553d7418fe [id=96574627e23442ebb0323b065423efae]
I20260810 13:54:22.043756 16430 raft_consensus.cc:515] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.051247 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_eebc498aa5734ab8b23c00b74d896ba9 [id=9756f3d17c15460e84863e49504d8349]
W20260810 13:54:22.066661 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:22.052595 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4f9508194c21480d9b603b139bdaf902 [id=98e554f12bf944c98887ed2293df2e26]
I20260810 13:54:21.989918 13264 raft_consensus.cc:2468] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:22.078480 13639 tablet_bootstrap.cc:492] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:22.078979 13639 ts_tablet_manager.cc:1403] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.219s user 0.031s sys 0.023s
I20260810 13:54:22.081691 13639 raft_consensus.cc:359] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.072652 16450 raft_consensus.cc:515] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.082391 13639 raft_consensus.cc:385] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:22.082696 13639 raft_consensus.cc:740] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:22.083031 13260 raft_consensus.cc:2393] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:22.086750 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:22.087271 13040 raft_consensus.cc:3060] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:22.091288 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_209ee5a105144c7e871214eaafcd0cbe [id=9a05ad06179141dfabe2d12858c1746c]
I20260810 13:54:22.083365 13639 consensus_queue.cc:260] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.093755 13639 ts_tablet_manager.cc:1434] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260810 13:54:22.094744 13639 tablet_bootstrap.cc:492] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:22.094871 13040 raft_consensus.cc:2468] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:22.096324 13167 leader_election.cc:304] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:22.097173 16185 raft_consensus.cc:2804] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:22.097671 16185 raft_consensus.cc:697] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:22.098031 13640 tablet_bootstrap.cc:492] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:22.020895 13464 raft_consensus.cc:2393] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:22.098553 16185 consensus_queue.cc:237] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.113014 16405 raft_consensus.cc:515] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.115024 16405 leader_election.cc:290] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:22.118050 13639 tablet_bootstrap.cc:654] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:22.125413 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:22.125906 13041 raft_consensus.cc:3060] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:22.131389 16450 leader_election.cc:290] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:22.143708 13382 leader_election.cc:304] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:22.148206 13640 tablet_bootstrap.cc:654] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:22.148216 16410 raft_consensus.cc:2804] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:22.148665 16410 raft_consensus.cc:493] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:22.154808 16410 raft_consensus.cc:3060] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:22.158644 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_215968e7ab2540ab8a35960795941543 [id=9bac646089c94e54b68ff14ce2a50793]
I20260810 13:54:22.160568 13638 tablet_bootstrap.cc:654] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:22.177831 13639 tablet_bootstrap.cc:492] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
W20260810 13:54:22.178032 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 44578.7us
I20260810 13:54:22.180845 16410 raft_consensus.cc:515] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.184608 13639 ts_tablet_manager.cc:1403] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.090s user 0.010s sys 0.002s
I20260810 13:54:22.187390 13639 raft_consensus.cc:359] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.188076 13639 raft_consensus.cc:385] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:22.188359 13639 raft_consensus.cc:740] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:22.206039 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6c443ac64289437d8c7dcf5ea44469dd [id=9c99ad2364cc45fba0746cbae06deeeb]
I20260810 13:54:22.206763 15348 raft_consensus.cc:2243] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:22.206957 13638 tablet_bootstrap.cc:492] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:22.207333 15348 raft_consensus.cc:2272] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:22.207419 13638 ts_tablet_manager.cc:1403] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.237s user 0.011s sys 0.000s
I20260810 13:54:22.209508 15348 ts_tablet_manager.cc:1916] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:22.210062 13639 consensus_queue.cc:260] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.211809 13639 ts_tablet_manager.cc:1434] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.027s user 0.004s sys 0.000s
I20260810 13:54:22.214058 16428 raft_consensus.cc:493] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:22.214552 16428 raft_consensus.cc:515] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.215564 16410 leader_election.cc:290] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:22.217733 16428 leader_election.cc:290] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:22.221271 16430 leader_election.cc:290] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:22.224444 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 45666.8us
W20260810 13:54:22.230660 13382 leader_election.cc:343] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: a43def9358894b2aa001a7db56706589
I20260810 13:54:22.231178 13382 leader_election.cc:304] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:22.231891 13382 raft_consensus.cc:2686] T a43def9358894b2aa001a7db56706589 P 6f30dc72e9364eed80645b57ac7f0cb6: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260810 13:54:22.232581 12729 leader_election.cc:336] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317): Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 0.698s (SENT)
W20260810 13:54:22.233855 13382 leader_election.cc:343] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:22.237674 13639 tablet_bootstrap.cc:492] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:22.248313 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]
I20260810 13:54:22.250029 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5388dd61e30949a5a2b9c07a35637080 [id=9fe82107b8344dfdae308a0d7091488d]
I20260810 13:54:22.252104 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]
I20260810 13:54:22.254115 13639 tablet_bootstrap.cc:654] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:22.205441 13049 raft_consensus.cc:2468] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:22.273461 13638 raft_consensus.cc:359] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.274250 13638 raft_consensus.cc:385] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:22.274547 13638 raft_consensus.cc:740] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:22.275265 13638 consensus_queue.cc:260] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.276998 13638 ts_tablet_manager.cc:1434] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.069s user 0.008s sys 0.000s
W20260810 13:54:22.280861 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 47041.9us
I20260810 13:54:22.279840 13640 tablet_bootstrap.cc:492] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:22.283360 13640 ts_tablet_manager.cc:1403] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.186s user 0.008s sys 0.009s
W20260810 13:54:22.283370 13382 leader_election.cc:343] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:22.285239 13382 leader_election.cc:343] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:22.286312 13640 raft_consensus.cc:359] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.286983 13640 raft_consensus.cc:385] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:22.287226 13640 raft_consensus.cc:740] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:22.287837 13640 consensus_queue.cc:260] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.292891 13167 leader_election.cc:304] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:22.293999 16232 raft_consensus.cc:2804] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:22.294534 16232 raft_consensus.cc:697] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:22.295410 16232 consensus_queue.cc:237] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.297166 12952 leader_election.cc:304] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:22.299309 16430 raft_consensus.cc:2804] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:22.299820 16430 raft_consensus.cc:697] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
W20260810 13:54:22.300587 12471 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.597s (SENT) [suppressed 2 similar messages]
I20260810 13:54:22.300716 16430 consensus_queue.cc:237] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.330577 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]
I20260810 13:54:22.286656 13382 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:22.365075 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 78475.8us
I20260810 13:54:22.365202 16512 raft_consensus.cc:2804] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:22.365780 16512 raft_consensus.cc:697] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:22.366643 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:22.367154 16512 consensus_queue.cc:237] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.370523 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:22.374256 13640 ts_tablet_manager.cc:1434] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.091s user 0.005s sys 0.000s
I20260810 13:54:22.374264 13639 tablet_bootstrap.cc:492] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:22.374699 13639 ts_tablet_manager.cc:1403] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.137s user 0.011s sys 0.004s
I20260810 13:54:22.376550 13640 tablet_bootstrap.cc:492] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:22.377751 13639 raft_consensus.cc:359] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.378599 13639 raft_consensus.cc:385] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:22.378944 13639 raft_consensus.cc:740] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:22.379663 13639 consensus_queue.cc:260] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:22.380648 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet e3f4b863f701471ab173b68049b1a602 consensus state has no leader
W20260810 13:54:22.354609 12471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 53507.2us
I20260810 13:54:22.385564 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_63e74b1d9a4e48c3b9343a12f0b926e6 [id=a17784f2e3a940e59b5603273436c417]
I20260810 13:54:22.386999 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]
I20260810 13:54:22.391419 13638 tablet_bootstrap.cc:492] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:22.392326 13041 raft_consensus.cc:2468] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:22.395784 15348 ts_tablet_manager.cc:1929] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:22.397294 13167 leader_election.cc:304] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:22.398231 16232 raft_consensus.cc:2804] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:22.398810 13638 tablet_bootstrap.cc:654] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:22.398720 16232 raft_consensus.cc:697] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:22.399804 16232 consensus_queue.cc:237] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.418629 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:22.419261 13476 raft_consensus.cc:2468] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:22.419720 15216 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Refusing update from remote peer d9666026fb7e4c85b46c6aab952932fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 556. Preceding OpId from leader: term: 6 index: 821. (index mismatch)
I20260810 13:54:22.421324 16444 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 821, Last known committed idx: 556, Time since last communication: 0.001s
W20260810 13:54:22.424942 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:22.432337 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5022f9898a2b4343b457ad28e07a933f [id=a31aa9b4d20f46b4bd283aca2d2b446c]
I20260810 13:54:22.396955 15348 log.cc:1199] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-2/wal/wals/9453eab70fa04df8b0c89e6caf54c894
I20260810 13:54:22.436431 15348 ts_tablet_manager.cc:1950] T 9453eab70fa04df8b0c89e6caf54c894 P 6f30dc72e9364eed80645b57ac7f0cb6: Deleting consensus metadata
I20260810 13:54:22.444765 13639 ts_tablet_manager.cc:1434] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.070s user 0.008s sys 0.000s
I20260810 13:54:22.446666 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_23cb4b4f896b48b1adc91079a7382c5c [id=a32ace7c7992464c8a5ef3f8169906b6]
I20260810 13:54:22.462126 13638 tablet_bootstrap.cc:492] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:22.462595 13638 ts_tablet_manager.cc:1403] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.071s user 0.011s sys 0.000s
I20260810 13:54:22.467022 13638 raft_consensus.cc:359] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.467751 13638 raft_consensus.cc:385] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:22.468026 13638 raft_consensus.cc:740] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:22.481587 13639 tablet_bootstrap.cc:492] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:22.495983 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:22.503212 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:22.504809 13638 consensus_queue.cc:260] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.505347 13468 raft_consensus.cc:2393] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:22.507145 13638 ts_tablet_manager.cc:1434] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.043s user 0.004s sys 0.001s
I20260810 13:54:22.531886 16479 raft_consensus.cc:493] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:22.532485 16479 raft_consensus.cc:515] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.534937 16479 leader_election.cc:290] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:22.543560 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:22.544319 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 602) took 6783 ms. Trace:
W20260810 13:54:22.545017 13167 leader_election.cc:343] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:22.544656 15348 rpcz_store.cc:276] 0810 13:54:15.657794 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.657900 (+ 106us) service_pool.cc:224] Handling call
0810 13:54:22.011394 (+6353494us) ts_tablet_manager.cc:1151] Deleting tablet 9453eab70fa04df8b0c89e6caf54c894
0810 13:54:22.011457 (+ 63us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:22.261401 (+249944us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:22.395664 (+134263us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:22.440921 (+ 45257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194185,"tablet-delete.queue_time_us":6352965}
I20260810 13:54:22.545895 15348 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43224 (request call id 603) took 6887 ms. Trace:
I20260810 13:54:22.546182 15348 rpcz_store.cc:276] 0810 13:54:15.658108 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.658246 (+ 138us) service_pool.cc:224] Handling call
0810 13:54:22.545624 (+6887378us) ts_tablet_manager.cc:1151] Deleting tablet 8fa729726a7f4603b0f5085a56cf89f6
0810 13:54:22.545674 (+ 50us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:22.545846 (+ 172us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6886836}
I20260810 13:54:22.547922 13638 tablet_bootstrap.cc:492] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:22.549763 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]
I20260810 13:54:22.554474 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:22.555037 13265 raft_consensus.cc:3060] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:22.567376 13640 tablet_bootstrap.cc:654] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:22.573756 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:22.574344 13468 raft_consensus.cc:3060] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:22.582655 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:22.582280 13265 raft_consensus.cc:2468] T c4ecf9abd60848f993234e98284974e8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:22.583304 13476 raft_consensus.cc:2468] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:22.594671 13639 tablet_bootstrap.cc:654] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:22.600065 13468 raft_consensus.cc:2468] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:22.609051 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:22.610054 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e9bf94db05cb46279abaeba00681ab82 [id=a547ccb6c9c24877b0b8d81d52e1630a]
I20260810 13:54:22.610594 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:22.612169 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2901b91576984ac4a165471a90e86a8b [id=a67f03853a964c2fbf175165ee422881]
I20260810 13:54:22.626871 13638 tablet_bootstrap.cc:654] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:22.634439 16349 consensus_queue.cc:1048] T dfbb2036c800469f90ad4d5d211ac462 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:22.634627 12951 leader_election.cc:304] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:22.635717 16430 raft_consensus.cc:2749] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:22.658631 12951 leader_election.cc:304] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:22.659543 16349 raft_consensus.cc:2749] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:22.660401 12951 leader_election.cc:304] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:22.665169 16430 raft_consensus.cc:2764] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260810 13:54:22.666777 12951 consensus_peers.cc:597] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:22.667799 12951 leader_election.cc:304] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:22.668592 16430 raft_consensus.cc:2749] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:22.686553 13640 tablet_bootstrap.cc:492] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:22.687016 13640 ts_tablet_manager.cc:1403] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.311s user 0.011s sys 0.000s
I20260810 13:54:22.693697 12952 leader_election.cc:304] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:22.694007 13164 leader_election.cc:304] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:22.694475 12952 leader_election.cc:343] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:22.694770 16185 raft_consensus.cc:3060] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:22.695487 16430 raft_consensus.cc:2804] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:22.695974 16430 raft_consensus.cc:697] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:22.697568 16430 consensus_queue.cc:237] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.703851 16185 raft_consensus.cc:2749] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:22.709911 13639 tablet_bootstrap.cc:492] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:22.710395 13639 ts_tablet_manager.cc:1403] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.229s user 0.012s sys 0.000s
I20260810 13:54:22.719215 16510 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:22.719949 16510 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.723026 16510 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:22.724512 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:22.731482 13382 leader_election.cc:343] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:22.731868 13382 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:22.732538 16510 raft_consensus.cc:2749] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:22.737788 13640 raft_consensus.cc:359] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.738622 13640 raft_consensus.cc:385] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:22.738909 13640 raft_consensus.cc:740] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:22.739756 13640 consensus_queue.cc:260] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.745572 13639 raft_consensus.cc:359] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.746369 13639 raft_consensus.cc:385] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:22.746694 13639 raft_consensus.cc:740] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:22.747426 13639 consensus_queue.cc:260] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:22.749689 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 46622.5us
I20260810 13:54:22.770731 13638 tablet_bootstrap.cc:492] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:22.771215 13638 ts_tablet_manager.cc:1403] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.224s user 0.013s sys 0.000s
W20260810 13:54:22.776602 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 69266.6us
I20260810 13:54:22.777959 12951 leader_election.cc:304] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:22.778734 16427 raft_consensus.cc:2804] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:22.779068 16427 raft_consensus.cc:493] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:22.779376 16427 raft_consensus.cc:3060] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:22.779565 16543 consensus_queue.cc:1048] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:22.784605 13639 ts_tablet_manager.cc:1434] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.074s user 0.009s sys 0.000s
I20260810 13:54:22.793753 13638 raft_consensus.cc:359] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.794490 13638 raft_consensus.cc:385] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:22.794764 13638 raft_consensus.cc:740] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:22.814297 13638 consensus_queue.cc:260] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.818197 13638 ts_tablet_manager.cc:1434] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.047s user 0.008s sys 0.000s
I20260810 13:54:22.819222 13638 tablet_bootstrap.cc:492] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:22.850381 16427 raft_consensus.cc:515] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.853135 16349 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:22.853629 16349 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.855827 16349 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:22.851900 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]
W20260810 13:54:22.758381 13382 leader_election.cc:343] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:22.859825 13382 leader_election.cc:304] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:22.860916 13640 ts_tablet_manager.cc:1434] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.174s user 0.006s sys 0.002s
I20260810 13:54:22.861136 16510 raft_consensus.cc:2749] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:22.861874 13640 tablet_bootstrap.cc:492] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:22.864789 13164 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 103138us
W20260810 13:54:22.860630 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 102395us
I20260810 13:54:22.866166 13265 raft_consensus.cc:3060] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:22.874625 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_40ebe892a09b471581cb322124cf7630 [id=a79fc8e8c8ec420fb2c6e6cc0fdbc17e]
I20260810 13:54:22.877310 16410 raft_consensus.cc:493] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:22.877760 16410 raft_consensus.cc:515] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.879619 16410 leader_election.cc:290] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:22.909917 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:22.910283 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_210fb0797673402e8e79fcf4e3c293b6 [id=aa1bdb6bb7c04faabb47c1552cc4aaff]
I20260810 13:54:22.922158 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3abcbf71e2004a07888fe131143e8e76 [id=ab67527f31ce42d7a92bb0cba8f69ff6]
I20260810 13:54:22.927601 13639 tablet_bootstrap.cc:492] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:22.932595 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:22.933404 13258 raft_consensus.cc:2393] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:22.934635 13639 tablet_bootstrap.cc:654] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:22.942796 16427 leader_election.cc:290] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:22.945523 16349 consensus_queue.cc:1048] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:22.946861 16349 consensus_queue.cc:1048] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:22.951460 12952 leader_election.cc:343] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:22.828141 15216 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Rejecting Update request from peer 1298bde14cec4cd3a9d6338c7d47f0b7 for earlier term 5. Current term is 6. Ops: [1.557-5.821]
W20260810 13:54:22.955899 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:22.972704 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:22.973286 16410 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:22.973734 16410 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:22.976317 16410 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:22.982856 12471 leader_election.cc:336] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.597s (SENT)
I20260810 13:54:22.987914 13638 tablet_bootstrap.cc:654] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:22.989993 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 123289us
I20260810 13:54:22.999063 16185 consensus_queue.cc:1048] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:23.012121 12952 leader_election.cc:343] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:23.016410 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]
I20260810 13:54:23.017977 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607]
I20260810 13:54:23.019379 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4]
I20260810 13:54:23.025982 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:23.026553 13468 raft_consensus.cc:3060] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:23.034013 13468 raft_consensus.cc:2468] T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:23.043502 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:23.044037 13475 raft_consensus.cc:3060] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:23.050499 13639 tablet_bootstrap.cc:492] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:23.050957 13639 ts_tablet_manager.cc:1403] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.124s user 0.012s sys 0.001s
I20260810 13:54:23.051036 13475 raft_consensus.cc:2468] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:23.053704 13639 raft_consensus.cc:359] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.062608 13639 raft_consensus.cc:385] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:23.062964 13639 raft_consensus.cc:740] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:23.063771 13639 consensus_queue.cc:260] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.086462 16574 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 }, Status: INVALID_TERM, Last received: 1.556, Next index: 557, Last known committed idx: 556, Time since last communication: 0.001s
I20260810 13:54:23.096379 13639 ts_tablet_manager.cc:1434] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.045s user 0.004s sys 0.004s
I20260810 13:54:23.102129 13640 tablet_bootstrap.cc:654] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:23.103999 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:23.107095 13639 tablet_bootstrap.cc:492] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:23.133189 12471 leader_election.cc:336] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.679s (SENT)
I20260810 13:54:23.132215 16575 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 5 LEADER]: Stepping down as leader of term 5
I20260810 13:54:23.133873 16575 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1298bde14cec4cd3a9d6338c7d47f0b7, State: Running, Role: LEADER
I20260810 13:54:23.143895 16567 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:23.147967 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_03b06d24159c4b079c0008aa041c517b [id=af367ad99e9a4fa9907c170b0a5dee49]
I20260810 13:54:23.153437 16349 consensus_queue.cc:1048] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:23.166108 13639 tablet_bootstrap.cc:654] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:23.144469 16567 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
W20260810 13:54:23.195637 13164 leader_election.cc:343] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 350b68f6c1cf48ff8e5f8521e5a4dad6
I20260810 13:54:23.216864 16427 raft_consensus.cc:493] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:23.217638 16427 raft_consensus.cc:515] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.230994 13638 tablet_bootstrap.cc:492] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:23.231478 13638 ts_tablet_manager.cc:1403] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.412s user 0.004s sys 0.008s
I20260810 13:54:23.236123 16427 leader_election.cc:290] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:23.241326 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]
I20260810 13:54:23.242184 13638 raft_consensus.cc:359] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.245388 16575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 818, Committed index: 818, Last appended: 5.821, Last appended by leader: 821, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:23.247687 16567 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:23.254437 13639 tablet_bootstrap.cc:492] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:23.262883 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:23.265007 13639 ts_tablet_manager.cc:1403] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.158s user 0.013s sys 0.009s
I20260810 13:54:23.262984 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:23.271204 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:23.272087 13041 raft_consensus.cc:2468] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:23.275053 16575 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 5 FOLLOWER]: Advancing to term 6
I20260810 13:54:23.282334 13639 raft_consensus.cc:359] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.283136 13639 raft_consensus.cc:385] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:23.283432 13639 raft_consensus.cc:740] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:23.286923 16427 raft_consensus.cc:493] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:23.287688 16427 raft_consensus.cc:515] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.284099 13639 consensus_queue.cc:260] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.296304 16427 leader_election.cc:290] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:23.299606 13639 ts_tablet_manager.cc:1434] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260810 13:54:23.299571 16185 consensus_queue.cc:1048] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:23.300752 13639 tablet_bootstrap.cc:492] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:23.242854 13638 raft_consensus.cc:385] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:23.317126 13638 raft_consensus.cc:740] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:23.317750 13638 consensus_queue.cc:260] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:23.316596 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 45754.1us
W20260810 13:54:23.343724 16582 log.cc:927] Time spent T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.095s user 0.000s sys 0.001s
W20260810 13:54:23.284971 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:23.364248 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 46444.2us
I20260810 13:54:23.370643 13640 tablet_bootstrap.cc:492] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:23.371098 13640 ts_tablet_manager.cc:1403] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.509s user 0.009s sys 0.005s
I20260810 13:54:23.373282 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a3085b5448ff4df8a25c4802ca130085 [id=b3648e88a1fc44808dcf824092d5de35]
I20260810 13:54:23.375516 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]
W20260810 13:54:23.375545 13164 leader_election.cc:343] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:23.375938 13164 leader_election.cc:304] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:23.377982 16475 raft_consensus.cc:2749] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:23.382512 13164 consensus_peers.cc:597] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a17d73c65f544b7c8566fd874ee87a25. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:23.394942 13638 ts_tablet_manager.cc:1434] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.163s user 0.008s sys 0.000s
I20260810 13:54:23.396113 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:23.396780 13475 raft_consensus.cc:2468] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:23.400902 13639 tablet_bootstrap.cc:654] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:23.404799 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:23.405412 13476 raft_consensus.cc:3060] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:23.408030 13640 raft_consensus.cc:359] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.421883 13476 raft_consensus.cc:2468] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:23.430814 13638 tablet_bootstrap.cc:492] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:23.401005 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_029a3ba2ee734a729e84a4482938ed5b [id=b437e76811d440ca817fca27a8dcbd45]
I20260810 13:54:23.474340 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:23.475059 13265 raft_consensus.cc:2468] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:23.476267 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:23.479121 13638 tablet_bootstrap.cc:654] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:23.479557 16590 raft_consensus.cc:493] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:23.482187 13640 raft_consensus.cc:385] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:23.482538 13640 raft_consensus.cc:740] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:23.486467 13640 consensus_queue.cc:260] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.489272 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dfe60ded8ca240529710962e7f530298 [id=b4ce0aca49834e698812644caf8b8a94]
I20260810 13:54:23.480216 16590 raft_consensus.cc:515] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.493502 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9ec2734c1c43472ca16731c99911a350 [id=b5072df8be3e4cc58980380d089942e2]
I20260810 13:54:23.494278 16590 leader_election.cc:290] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:23.515250 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:23.518884 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:23.521535 13639 tablet_bootstrap.cc:492] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:23.512669 16427 raft_consensus.cc:493] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:23.522172 13639 ts_tablet_manager.cc:1403] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.222s user 0.018s sys 0.021s
I20260810 13:54:23.526871 13640 ts_tablet_manager.cc:1434] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.155s user 0.007s sys 0.002s
I20260810 13:54:23.522394 16427 raft_consensus.cc:515] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:23.557380 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:23.559000 16427 leader_election.cc:290] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:23.560971 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]
I20260810 13:54:23.562387 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_131ccf6f50394a4facf6e622d5449b17 [id=b559d903254d433989a2deb00eb27361]
W20260810 13:54:23.568836 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 51859.4us
W20260810 13:54:23.570269 13382 leader_election.cc:343] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:23.570907 13382 leader_election.cc:343] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:23.557646 13639 raft_consensus.cc:359] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.584769 13639 raft_consensus.cc:385] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:23.585114 13639 raft_consensus.cc:740] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:23.587409 13639 consensus_queue.cc:260] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.589597 13639 ts_tablet_manager.cc:1434] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.067s user 0.002s sys 0.004s
I20260810 13:54:23.590636 13639 tablet_bootstrap.cc:492] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:23.621367 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 49898.4us
I20260810 13:54:23.622215 13382 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:23.634222 16547 raft_consensus.cc:2804] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:23.634567 16547 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:23.634878 16547 raft_consensus.cc:3060] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:23.635409 13382 leader_election.cc:304] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:23.564388 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5b39c1bb4b614f97ab6eb4d521628013 [id=b69ad2b0c70949b98192ae056eb2cab0]
I20260810 13:54:23.638593 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d8ab37a103a5426b81dcf295239ec9af [id=b7130fcdfcf54b76861fd9c87559beeb]
I20260810 13:54:23.640112 16427 consensus_queue.cc:1048] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:23.652858 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:23.654676 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a80ad2cc0680447898f832a3da957607 [id=b7e44fb60b9b401db5517c2fd7e8c70b]
I20260810 13:54:23.656224 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4f02931df6b0437a9cb7869b14b73084 [id=b8289db1d29241f3815ff2da32fcfc1a]
I20260810 13:54:23.671069 13640 tablet_bootstrap.cc:492] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:23.671128 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c4942145f1414e939000a9b7443c0d29 [id=b88902dec1e34475b3ae470c1c17f777]
I20260810 13:54:23.678661 16606 raft_consensus.cc:2749] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:23.648991 16547 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.681586 12951 leader_election.cc:304] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:23.682440 16427 raft_consensus.cc:2804] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:23.682837 16427 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:23.683173 16427 raft_consensus.cc:3060] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:23.691216 16427 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.706100 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:23.723773 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:23.727500 16575 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:23.727977 16575 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:23.731878 16575 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:23.732111 15213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:23.760314 13640 tablet_bootstrap.cc:654] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:23.766739 16427 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:23.681105 16547 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:23.783751 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_18833ebfc83a4c33a1a94a902b97ffaf [id=bb2789ba0fd043c2a44479f23111dcbb]
I20260810 13:54:23.777251 13382 leader_election.cc:304] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:23.735543 13639 tablet_bootstrap.cc:654] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:23.747979 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 54212.9us
I20260810 13:54:23.790356 12951 leader_election.cc:304] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:23.791742 16430 raft_consensus.cc:2804] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:23.792235 16430 raft_consensus.cc:697] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:23.793120 16430 consensus_queue.cc:237] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.797271 16606 raft_consensus.cc:2804] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 13:54:23.797622 12951 leader_election.cc:343] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:23.797729 16606 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:23.798091 16606 raft_consensus.cc:3060] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:23.798249 12951 leader_election.cc:343] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:23.799299 16543 consensus_queue.cc:1048] T 515727ae51d94c009b4446c8b6e2c8f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:23.801983 12951 leader_election.cc:343] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:23.810146 13382 leader_election.cc:343] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:23.811496 13382 leader_election.cc:304] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:23.816318 16547 raft_consensus.cc:2749] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:23.819512 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ec24cdc578624353b8936b6a7add0b7b [id=bf5a9955305343258f05d827cd3e8aec]
I20260810 13:54:23.830696 13638 tablet_bootstrap.cc:492] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:23.831499 13638 ts_tablet_manager.cc:1403] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.401s user 0.010s sys 0.016s
I20260810 13:54:23.836241 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:23.836875 13041 raft_consensus.cc:3060] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:23.868805 13639 tablet_bootstrap.cc:492] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:23.869345 13639 ts_tablet_manager.cc:1403] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.279s user 0.011s sys 0.000s
I20260810 13:54:23.894189 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:23.896015 16512 consensus_queue.cc:1048] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:23.894217 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:23.910193 13474 raft_consensus.cc:3060] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:23.914136 16606 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.916208 16606 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:23.917224 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f consensus state has no leader
I20260810 13:54:23.923455 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:23.925149 13640 tablet_bootstrap.cc:492] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:23.925559 13640 ts_tablet_manager.cc:1403] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.255s user 0.009s sys 0.013s
W20260810 13:54:23.926208 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:23.936614 13640 raft_consensus.cc:359] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.939770 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:23.940495 13268 raft_consensus.cc:2468] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:23.942734 13640 raft_consensus.cc:385] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:23.943010 13640 raft_consensus.cc:740] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:23.937543 13474 raft_consensus.cc:2468] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:23.945232 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:23.945802 13040 raft_consensus.cc:2468] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:23.947968 13041 raft_consensus.cc:2468] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:23.953294 13640 consensus_queue.cc:260] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.959578 13640 ts_tablet_manager.cc:1434] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.034s user 0.004s sys 0.002s
I20260810 13:54:23.963398 13640 tablet_bootstrap.cc:492] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:23.963883 16638 raft_consensus.cc:493] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:23.970033 16638 raft_consensus.cc:515] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:23.976387 16638 leader_election.cc:290] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:23.982383 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_86dcc5d091024407b7e167806ec593a3 [id=c07ecd00b44e49c9b0a32e8710373471]
I20260810 13:54:23.987752 13640 tablet_bootstrap.cc:654] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.005295 13639 raft_consensus.cc:359] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.006080 13639 raft_consensus.cc:385] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.006399 13639 raft_consensus.cc:740] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.007124 13639 consensus_queue.cc:260] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.009981 16638 raft_consensus.cc:493] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:24.010466 16638 raft_consensus.cc:515] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.012308 16638 leader_election.cc:290] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:24.015640 13382 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:24.016302 16638 raft_consensus.cc:2804] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:24.016764 16638 raft_consensus.cc:697] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:24.017781 16638 consensus_queue.cc:237] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.023811 13639 ts_tablet_manager.cc:1434] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.154s user 0.007s sys 0.000s
I20260810 13:54:24.027516 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]
I20260810 13:54:24.029222 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]
I20260810 13:54:24.030727 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]
I20260810 13:54:24.042953 13638 raft_consensus.cc:359] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.043927 13638 raft_consensus.cc:385] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.044269 13638 raft_consensus.cc:740] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.055112 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:24.055907 13268 raft_consensus.cc:2468] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:24.065081 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:24.073380 13167 leader_election.cc:304] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:24.075139 16185 raft_consensus.cc:2804] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:24.075542 16185 raft_consensus.cc:493] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:24.075945 16185 raft_consensus.cc:3060] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:24.085104 13640 tablet_bootstrap.cc:492] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:24.085574 13640 ts_tablet_manager.cc:1403] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.122s user 0.009s sys 0.004s
I20260810 13:54:24.088474 13640 raft_consensus.cc:359] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.089259 13640 raft_consensus.cc:385] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.089515 13640 raft_consensus.cc:740] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.088964 13638 consensus_queue.cc:260] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.090163 13640 consensus_queue.cc:260] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.092234 13640 ts_tablet_manager.cc:1434] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260810 13:54:24.092015 16632 consensus_queue.cc:1048] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:24.096975 16632 consensus_queue.cc:1048] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:24.111402 13640 tablet_bootstrap.cc:492] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:24.122632 13638 ts_tablet_manager.cc:1434] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.291s user 0.003s sys 0.007s
I20260810 13:54:24.125056 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:54:24.096472 13164 consensus_peers.cc:597] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 350b68f6c1cf48ff8e5f8521e5a4dad6. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:24.127241 13164 leader_election.cc:343] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:24.156924 13382 leader_election.cc:343] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.155694 13638 tablet_bootstrap.cc:492] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:24.167902 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:24.169191 13640 tablet_bootstrap.cc:654] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.176810 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:24.181100 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:24.183876 13639 tablet_bootstrap.cc:492] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:24.189512 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:24.192339 16430 consensus_queue.cc:1048] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:54:24.197459 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 45639.8us
I20260810 13:54:24.200588 16185 raft_consensus.cc:515] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.238783 12951 leader_election.cc:304] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:24.240020 16430 raft_consensus.cc:2804] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:24.240913 16430 raft_consensus.cc:697] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:24.241884 16430 consensus_queue.cc:237] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.247570 13640 tablet_bootstrap.cc:492] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:24.248059 13640 ts_tablet_manager.cc:1403] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.140s user 0.016s sys 0.002s
I20260810 13:54:24.032091 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d21ea3e2ede2490b963de16453e2ad9e [id=c34177c45eda4d9e892e77cc723efbf1]
I20260810 13:54:24.256769 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]
I20260810 13:54:24.262972 13640 raft_consensus.cc:359] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.265283 13640 raft_consensus.cc:385] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.266039 13640 raft_consensus.cc:740] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:24.269480 12952 leader_election.cc:343] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.269928 12952 leader_election.cc:304] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:24.270617 16543 raft_consensus.cc:2749] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:24.280845 13640 consensus_queue.cc:260] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.289239 12952 leader_election.cc:304] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:24.289983 16543 raft_consensus.cc:2804] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:24.290335 16543 raft_consensus.cc:493] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:24.290669 16543 raft_consensus.cc:3060] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:24.291926 16349 consensus_queue.cc:1048] T c4ecf9abd60848f993234e98284974e8 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:24.299338 16543 raft_consensus.cc:515] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.301892 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ecb9a9595610488796d066d45e53880a [id=c478e4b06e604e5d8277d76680a5e8f8]
I20260810 13:54:24.305018 16185 leader_election.cc:290] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:24.306951 13638 tablet_bootstrap.cc:654] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.314150 13640 ts_tablet_manager.cc:1434] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.066s user 0.009s sys 0.000s
I20260810 13:54:24.315279 16430 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:24.315775 16430 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.318537 13639 tablet_bootstrap.cc:654] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.325184 13640 tablet_bootstrap.cc:492] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:24.359310 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]
I20260810 13:54:24.361385 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d3680fc81fed4821bc9a2eccc77c35d8 [id=c9181e9bcc3546a5ac7aed13b663deaa]
I20260810 13:54:24.365466 16430 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:24.379359 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 88573.4us
I20260810 13:54:24.401460 16543 leader_election.cc:290] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:24.380559 12952 leader_election.cc:304] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:24.405618 13640 tablet_bootstrap.cc:654] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.406559 16349 raft_consensus.cc:2804] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:24.406944 16349 raft_consensus.cc:493] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:24.407235 16349 raft_consensus.cc:3060] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:24.408854 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:24.427260 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:24.427938 13050 raft_consensus.cc:2393] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:24.424584 13640 tablet_bootstrap.cc:492] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:24.431450 13640 ts_tablet_manager.cc:1403] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.109s user 0.011s sys 0.002s
I20260810 13:54:24.431470 16349 raft_consensus.cc:515] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.433539 16349 leader_election.cc:290] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:24.448781 13640 raft_consensus.cc:359] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.449425 13640 raft_consensus.cc:385] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.449684 13640 raft_consensus.cc:740] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.450548 13640 consensus_queue.cc:260] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.452430 13640 ts_tablet_manager.cc:1434] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
W20260810 13:54:24.455507 12952 leader_election.cc:343] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.465792 13638 tablet_bootstrap.cc:492] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:24.466246 13638 ts_tablet_manager.cc:1403] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.311s user 0.011s sys 0.002s
I20260810 13:54:24.468345 13640 tablet_bootstrap.cc:492] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:24.490376 13640 tablet_bootstrap.cc:654] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.502056 16589 raft_consensus.cc:493] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:24.502921 16589 raft_consensus.cc:515] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.505196 16589 leader_election.cc:290] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:24.510993 13640 tablet_bootstrap.cc:492] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:24.511497 13640 ts_tablet_manager.cc:1403] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.043s user 0.010s sys 0.000s
I20260810 13:54:24.514292 13640 raft_consensus.cc:359] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.514955 13640 raft_consensus.cc:385] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.515278 13640 raft_consensus.cc:740] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.515879 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:24.516024 13640 consensus_queue.cc:260] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.527583 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:24.529026 16652 log.cc:927] Time spent T ff1229ebe9304f19ab84d5a172aba937 P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.092s user 0.000s sys 0.000s
I20260810 13:54:24.533488 13639 tablet_bootstrap.cc:492] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:24.533982 13639 ts_tablet_manager.cc:1403] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.350s user 0.010s sys 0.002s
I20260810 13:54:24.538203 13639 raft_consensus.cc:359] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.538823 13639 raft_consensus.cc:385] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.539074 13639 raft_consensus.cc:740] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.539767 13639 consensus_queue.cc:260] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.542812 13639 ts_tablet_manager.cc:1434] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.009s user 0.003s sys 0.002s
I20260810 13:54:24.543444 13640 ts_tablet_manager.cc:1434] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.032s user 0.007s sys 0.000s
W20260810 13:54:24.543630 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 85243.7us
I20260810 13:54:24.543875 13639 tablet_bootstrap.cc:492] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:24.550239 13639 tablet_bootstrap.cc:654] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.553524 13640 tablet_bootstrap.cc:492] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:24.554646 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:24.555197 13269 raft_consensus.cc:3060] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:24.555238 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:24.556484 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:24.560319 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:24.565171 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_70a5ed6b181b4db1ae5c28b4b6ca4553 [id=c93d3c57643543cda0f021e1171b3365]
I20260810 13:54:24.567543 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e0bb4403efd84db5ac45ace77b9b1a90 [id=c9ebbfcd82964aa798abcf82aaf3e881]
I20260810 13:54:24.575423 13269 raft_consensus.cc:2468] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:24.572574 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]
I20260810 13:54:24.578153 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f [id=cb722d559fe647018b6c959f6a93a037]
I20260810 13:54:24.582010 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c]
I20260810 13:54:24.585552 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_890e94f5e2914f4e9e3994ab8bc4075c [id=d08463e955564de898a2af8457a26457]
I20260810 13:54:24.589182 13638 raft_consensus.cc:359] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.590088 13638 raft_consensus.cc:385] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.590420 13638 raft_consensus.cc:740] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.591359 13638 consensus_queue.cc:260] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.588784 16638 raft_consensus.cc:493] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:24.594178 16638 raft_consensus.cc:515] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.596022 16638 leader_election.cc:290] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:24.605962 13382 leader_election.cc:343] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.611841 13639 tablet_bootstrap.cc:492] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:24.612366 13639 ts_tablet_manager.cc:1403] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.069s user 0.014s sys 0.001s
I20260810 13:54:24.615513 13639 raft_consensus.cc:359] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.616268 13639 raft_consensus.cc:385] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.616595 13639 raft_consensus.cc:740] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.617385 13639 consensus_queue.cc:260] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.628337 13638 ts_tablet_manager.cc:1434] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.162s user 0.006s sys 0.001s
I20260810 13:54:24.630441 13638 tablet_bootstrap.cc:492] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:24.635315 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2da57f87f29a425dbef85d4f4db4bc26 [id=d3522604bed74abf8b357894ca97ddad]
I20260810 13:54:24.637066 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]
I20260810 13:54:24.638595 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_278ad8ed658b48d28fcc3aa3eec747b0 [id=d585e61cb61a4312ba2dbadbcae39899]
W20260810 13:54:24.679617 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 73083us
W20260810 13:54:24.680754 13382 leader_election.cc:343] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:24.681306 13382 leader_election.cc:343] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.683274 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]
I20260810 13:54:24.684619 13640 tablet_bootstrap.cc:654] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.686023 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:24.686229 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:24.686772 13261 raft_consensus.cc:3060] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:24.686866 13265 raft_consensus.cc:2393] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:24.696506 13261 raft_consensus.cc:2468] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
W20260810 13:54:24.704521 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:24.705739 13639 ts_tablet_manager.cc:1434] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.093s user 0.004s sys 0.003s
I20260810 13:54:24.706843 13639 tablet_bootstrap.cc:492] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:24.722097 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_78c6761fe1e748bf8bea32e7a13650f3 [id=d855b11b57bd447a9285b0945f28219d]
I20260810 13:54:24.723588 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 [id=d8943f60b8e3464087c954a42ff795ba]
W20260810 13:54:24.725952 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 44169.4us
I20260810 13:54:24.730022 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:24.730540 13477 raft_consensus.cc:3060] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:24.731130 13638 tablet_bootstrap.cc:654] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:24.734099 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:24.737836 13477 raft_consensus.cc:2468] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:24.744093 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:24.752821 13167 leader_election.cc:343] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.756292 16349 raft_consensus.cc:493] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:24.756958 16349 raft_consensus.cc:515] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.760502 16349 leader_election.cc:290] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:24.768131 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:24.769972 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:24.770613 13470 raft_consensus.cc:2393] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:24.771221 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8a8233c099eb45dba66c3d0f9bdbe18b [id=d9a327f6557d42bb998964e1d594cb1c]
I20260810 13:54:24.777187 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:24.798359 13638 tablet_bootstrap.cc:492] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:24.798766 13638 ts_tablet_manager.cc:1403] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.169s user 0.009s sys 0.000s
I20260810 13:54:24.801553 13640 tablet_bootstrap.cc:492] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:24.801983 13640 ts_tablet_manager.cc:1403] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.249s user 0.014s sys 0.003s
I20260810 13:54:24.802165 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2ca2243ef2fe4479bb1edec0046866b9 [id=d9cc836fbee549a08553ed113e483bf6]
I20260810 13:54:24.804497 13640 raft_consensus.cc:359] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.805183 13640 raft_consensus.cc:385] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.805467 13640 raft_consensus.cc:740] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.806135 13640 consensus_queue.cc:260] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.808879 13639 tablet_bootstrap.cc:654] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.816413 13640 ts_tablet_manager.cc:1434] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260810 13:54:24.829324 13638 raft_consensus.cc:359] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.831012 13638 raft_consensus.cc:385] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.831312 13638 raft_consensus.cc:740] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.831418 13640 tablet_bootstrap.cc:492] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:24.832116 13638 consensus_queue.cc:260] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.834089 13638 ts_tablet_manager.cc:1434] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.035s user 0.007s sys 0.000s
W20260810 13:54:24.838343 12952 leader_election.cc:343] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.840121 16632 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:24.840641 16632 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.842175 16185 consensus_queue.cc:1048] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:24.843235 16632 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:24.847105 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67]
I20260810 13:54:24.848644 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b6a730448efc42958de4f9513cbd365b [id=dbf489131f724a7b85f1bac4f9e3e614]
I20260810 13:54:24.850080 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_071663fc830e44ef9d25a38fc8301ba7 [id=dd579b0cb2684ce08640cf4f5edae65c]
W20260810 13:54:24.850927 12951 leader_election.cc:343] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.851303 12951 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:24.851470 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb [id=dea63931a83f494b8fa574685cd4ff24]
I20260810 13:54:24.858952 16543 raft_consensus.cc:2749] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:24.862314 13639 tablet_bootstrap.cc:492] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:24.862805 13639 ts_tablet_manager.cc:1403] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.156s user 0.010s sys 0.000s
W20260810 13:54:24.860296 13382 leader_election.cc:343] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:24.872304 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:24.885560 13639 raft_consensus.cc:359] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:24.885973 12951 leader_election.cc:343] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.886320 13639 raft_consensus.cc:385] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:24.893080 13639 raft_consensus.cc:740] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:24.893754 13639 consensus_queue.cc:260] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:24.894093 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:24.898232 13639 ts_tablet_manager.cc:1434] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.035s user 0.006s sys 0.001s
I20260810 13:54:24.896422 13640 tablet_bootstrap.cc:654] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:24.903299 13382 leader_election.cc:343] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:24.914603 13167 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:24.916745 16672 consensus_queue.cc:1048] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:24.929306 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]
W20260810 13:54:24.930389 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 85489.8us
I20260810 13:54:24.931600 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9d81870e910444848f2c714a1b9da18c [id=e506f8a07858485398058c93c553f904]
W20260810 13:54:24.938215 13382 leader_election.cc:343] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.938592 13382 leader_election.cc:304] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:24.939275 16672 raft_consensus.cc:2749] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:24.949474 13639 tablet_bootstrap.cc:492] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:24.953234 13638 tablet_bootstrap.cc:492] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:24.958889 13639 tablet_bootstrap.cc:654] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:24.964957 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]
W20260810 13:54:24.944633 13382 leader_election.cc:343] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:24.969008 13382 leader_election.cc:304] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:24.973613 13640 tablet_bootstrap.cc:492] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:24.974323 13640 ts_tablet_manager.cc:1403] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.144s user 0.010s sys 0.003s
I20260810 13:54:24.977711 16672 raft_consensus.cc:2749] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:24.979038 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47966.4us
I20260810 13:54:24.987407 13640 raft_consensus.cc:359] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.000538 13640 raft_consensus.cc:385] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.000838 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 [id=e992c0b15e564af7a0722b50e969adf4]
I20260810 13:54:25.000895 13640 raft_consensus.cc:740] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.005205 13382 leader_election.cc:304] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:25.006376 13639 tablet_bootstrap.cc:492] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:25.006795 13639 ts_tablet_manager.cc:1403] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.058s user 0.007s sys 0.002s
I20260810 13:54:25.007611 16672 raft_consensus.cc:2804] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:25.008219 16672 raft_consensus.cc:697] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:25.009018 16672 consensus_queue.cc:237] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.021152 13639 raft_consensus.cc:359] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.021864 13639 raft_consensus.cc:385] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.022148 13639 raft_consensus.cc:740] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.022828 13639 consensus_queue.cc:260] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.020452 13640 consensus_queue.cc:260] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.025701 16638 raft_consensus.cc:493] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.026086 16638 raft_consensus.cc:515] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.027899 16638 leader_election.cc:290] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:25.034889 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:25.037989 13164 leader_election.cc:304] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:25.038724 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]
I20260810 13:54:25.038919 16185 raft_consensus.cc:2804] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:25.039650 16185 raft_consensus.cc:697] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:25.040503 16185 consensus_queue.cc:237] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:25.040974 16640 lock_manager.cc:585] Waited 1 seconds to obtain row lock on key '<redacted>' (key hash 591322104782615093) tablet 00000000000000000000000000000000 cur holder 0x7b580009ba00
I20260810 13:54:25.041242 13639 ts_tablet_manager.cc:1434] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.034s user 0.007s sys 0.001s
I20260810 13:54:25.042117 13639 tablet_bootstrap.cc:492] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:25.054052 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]
W20260810 13:54:25.057861 12951 leader_election.cc:343] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.061127 13640 ts_tablet_manager.cc:1434] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.087s user 0.005s sys 0.003s
I20260810 13:54:25.074452 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:25.075100 13041 raft_consensus.cc:2468] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:25.081601 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dd910306a7864aeb9230c62730dc3ff4 [id=ee077cecabdd48809356d55acc5604a6]
I20260810 13:54:25.083178 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_df8743b260984398bf1a3a7c1ee5c4a2 [id=f01c22584d5f4cb696573d09deec464e]
I20260810 13:54:25.092245 13639 tablet_bootstrap.cc:654] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.102345 13640 tablet_bootstrap.cc:492] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:25.111735 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 73810.9us
I20260810 13:54:25.110256 13640 tablet_bootstrap.cc:654] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.084571 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4f7895e8b4164093b5fa194d7f828d2a [id=f492b2e2f4cf4205a7d147ddad56af40]
I20260810 13:54:25.117035 16430 raft_consensus.cc:493] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.117569 16430 raft_consensus.cc:515] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:25.131152 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:25.132200 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_699797a1320b40709d0bf25947241900 [id=f656a6598c1145d89230d014ba6873a6]
I20260810 13:54:25.133718 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 [id=f6ba2bd3294c4b49a617aee9388a1248]
W20260810 13:54:25.147857 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:25.146703 13382 leader_election.cc:304] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.152379 16672 raft_consensus.cc:2804] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:25.152765 16672 raft_consensus.cc:493] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:25.153120 16672 raft_consensus.cc:3060] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.157665 16543 consensus_queue.cc:1048] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:25.162573 16430 leader_election.cc:290] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:25.164745 13164 leader_election.cc:343] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.165136 13164 leader_election.cc:304] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:25.165963 16632 raft_consensus.cc:493] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.166625 16632 raft_consensus.cc:515] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.168743 16185 raft_consensus.cc:2749] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:25.168586 16632 leader_election.cc:290] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.169701 13640 tablet_bootstrap.cc:492] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:25.170135 13640 ts_tablet_manager.cc:1403] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.068s user 0.012s sys 0.001s
I20260810 13:54:25.068529 13638 tablet_bootstrap.cc:654] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.177088 16672 raft_consensus.cc:515] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.186292 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:25.181839 13640 raft_consensus.cc:359] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.187520 13640 raft_consensus.cc:385] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.191074 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_08e421ad9e1d4274b11c4cb314c36201 [id=f7546e5fae5641d0b1747c71934496ec]
I20260810 13:54:25.195107 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_229c64c5f5804f6c8a3047ec7858322b [id=f8aaac66943a4d9d8d2bf15d12a18009]
I20260810 13:54:25.195797 13639 tablet_bootstrap.cc:492] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:25.203491 13639 ts_tablet_manager.cc:1403] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.162s user 0.011s sys 0.000s
I20260810 13:54:25.206957 13639 raft_consensus.cc:359] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.207628 13639 raft_consensus.cc:385] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.207880 13639 raft_consensus.cc:740] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.209206 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.191691 13640 raft_consensus.cc:740] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.223955 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:25.224586 13468 raft_consensus.cc:2468] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:25.225310 16543 raft_consensus.cc:493] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.225972 16543 raft_consensus.cc:515] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.226938 16672 leader_election.cc:290] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:25.228704 16543 leader_election.cc:290] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.221377 13640 consensus_queue.cc:260] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.247969 13640 ts_tablet_manager.cc:1434] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.078s user 0.007s sys 0.004s
I20260810 13:54:25.255313 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.257444 13258 raft_consensus.cc:3060] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.258014 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:25.261199 12952 leader_election.cc:304] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:25.262331 12952 consensus_peers.cc:597] T 2b67e5a2b5334147b9d25f2ddc73de31 P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:25.263288 12952 leader_election.cc:304] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:25.263952 16651 raft_consensus.cc:2749] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:25.264979 16651 raft_consensus.cc:2804] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:25.265403 16651 raft_consensus.cc:697] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:25.266640 16651 consensus_queue.cc:237] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:25.270265 12729 leader_election.cc:336] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317): Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 0.725s (SENT)
I20260810 13:54:25.278960 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:25.279507 13476 raft_consensus.cc:2468] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:25.283564 13638 tablet_bootstrap.cc:492] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:25.284049 13638 ts_tablet_manager.cc:1403] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.331s user 0.008s sys 0.003s
I20260810 13:54:25.270723 12729 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:25.297840 16543 consensus_queue.cc:1048] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:25.296759 13640 tablet_bootstrap.cc:492] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:25.300876 12951 leader_election.cc:304] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.301882 16430 raft_consensus.cc:2804] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:25.302268 16430 raft_consensus.cc:493] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:25.302568 16430 raft_consensus.cc:3060] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.305686 16707 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:25.310978 16430 raft_consensus.cc:515] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:25.316057 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:25.208405 13639 consensus_queue.cc:260] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.322813 13639 ts_tablet_manager.cc:1434] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.119s user 0.006s sys 0.000s
I20260810 13:54:25.330632 12951 leader_election.cc:304] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.331907 16543 raft_consensus.cc:2804] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:25.332260 16543 raft_consensus.cc:493] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:25.332576 16543 raft_consensus.cc:3060] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.357308 16430 leader_election.cc:290] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.359611 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:25.360203 13041 raft_consensus.cc:3060] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.361254 16672 raft_consensus.cc:493] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.361758 16672 raft_consensus.cc:515] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.363801 16672 leader_election.cc:290] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:25.367391 16672 consensus_queue.cc:1048] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:25.368254 13041 raft_consensus.cc:2468] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:25.373889 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:25.375748 13382 leader_election.cc:304] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.379187 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_356ec0418a38420d8a4e18b2f69682c3 [id=f8b08e6c518647d194daba555502622a]
I20260810 13:54:25.381171 16638 raft_consensus.cc:493] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.381597 16638 raft_consensus.cc:515] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.383531 16638 leader_election.cc:290] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:25.383623 16430 raft_consensus.cc:493] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.384053 16430 raft_consensus.cc:515] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.385605 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e4f9174b7de74fd79642def9d4d0fffd [id=f8ba71724c3f4068a8377462165aee32]
I20260810 13:54:25.386776 16430 leader_election.cc:290] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.380185 13640 tablet_bootstrap.cc:654] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.394881 16672 raft_consensus.cc:2804] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:25.395533 16672 raft_consensus.cc:697] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:25.396370 16672 consensus_queue.cc:237] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.287426 13638 raft_consensus.cc:359] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.401298 13638 raft_consensus.cc:385] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.401572 13638 raft_consensus.cc:740] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.402295 13638 consensus_queue.cc:260] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.404345 13638 ts_tablet_manager.cc:1434] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.120s user 0.005s sys 0.003s
I20260810 13:54:25.406180 16543 raft_consensus.cc:515] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.412261 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:25.412787 13477 raft_consensus.cc:3060] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.419584 13477 raft_consensus.cc:2468] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:25.425249 16543 leader_election.cc:290] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.429050 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:25.429665 13477 raft_consensus.cc:2468] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:25.430877 12951 leader_election.cc:304] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.431941 16701 raft_consensus.cc:2804] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:25.432411 16701 raft_consensus.cc:697] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:25.433261 16701 consensus_queue.cc:237] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.437321 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:25.453269 13639 tablet_bootstrap.cc:492] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:25.460600 13639 tablet_bootstrap.cc:654] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.465607 13638 tablet_bootstrap.cc:492] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:25.468065 13640 tablet_bootstrap.cc:492] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:25.482576 13640 ts_tablet_manager.cc:1403] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.193s user 0.005s sys 0.009s
W20260810 13:54:25.472445 13382 leader_election.cc:343] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:25.491650 13382 leader_election.cc:343] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.503014 13639 tablet_bootstrap.cc:492] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:25.503999 13639 ts_tablet_manager.cc:1403] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.000s
I20260810 13:54:25.388587 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb]
I20260810 13:54:25.516714 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7c263dc08783483d941121c9c3cafdc6 [id=fc5a0ae7f9074bfc89acd9077b020821]
I20260810 13:54:25.518256 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]
I20260810 13:54:25.530416 12951 leader_election.cc:304] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:25.531826 13382 leader_election.cc:343] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.533001 16543 raft_consensus.cc:2804] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:25.533427 16543 raft_consensus.cc:493] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:25.533784 16543 raft_consensus.cc:3060] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.536939 13639 raft_consensus.cc:359] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.537727 13639 raft_consensus.cc:385] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.540234 13382 leader_election.cc:304] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:25.543830 13382 leader_election.cc:343] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.544870 16672 raft_consensus.cc:2749] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:25.534578 13640 raft_consensus.cc:359] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.550328 13640 raft_consensus.cc:385] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.550597 13640 raft_consensus.cc:740] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.551234 13640 consensus_queue.cc:260] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.565778 16543 raft_consensus.cc:515] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.538427 13639 raft_consensus.cc:740] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.569490 13639 consensus_queue.cc:260] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.571017 13639 ts_tablet_manager.cc:1434] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.066s user 0.005s sys 0.000s
I20260810 13:54:25.572069 13640 ts_tablet_manager.cc:1434] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.089s user 0.007s sys 0.000s
I20260810 13:54:25.573014 13640 tablet_bootstrap.cc:492] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:25.584322 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:25.584904 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 102244us
I20260810 13:54:25.588333 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:25.588922 13477 raft_consensus.cc:3060] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.590266 16722 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.590726 16722 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.591926 13638 tablet_bootstrap.cc:654] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.595866 13477 raft_consensus.cc:2468] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:25.597115 16722 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.601825 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:25.602434 13476 raft_consensus.cc:3060] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.610884 13476 raft_consensus.cc:2468] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:25.621095 16543 leader_election.cc:290] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.624854 13640 tablet_bootstrap.cc:654] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.646574 16672 raft_consensus.cc:493] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.647151 16672 raft_consensus.cc:515] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.650249 16672 leader_election.cc:290] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:25.653507 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.641799 12951 leader_election.cc:304] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.658594 16651 raft_consensus.cc:2804] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:25.659061 16651 raft_consensus.cc:697] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:25.659893 16651 consensus_queue.cc:237] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.654297 13639 tablet_bootstrap.cc:492] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:25.667398 12951 leader_election.cc:304] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.668113 16430 raft_consensus.cc:2804] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
W20260810 13:54:25.668402 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:25.668541 16430 raft_consensus.cc:697] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:25.669389 16430 consensus_queue.cc:237] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.680649 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:25.689106 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:25.621241 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5967f54814d04534b6a591a3bf9a4e8e [id=fd3f5c353a584a6b9d955543762bb8c6]
I20260810 13:54:25.690924 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a34a40f45be7413bb670738c4199fa50 [id=fd9cae2939d9440b92dc923383e5839c]
I20260810 13:54:25.692337 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_86221744224e4ac4aeebf77dbd274d49 [id=fe2f8409777b4c94b59159a106e77e7f]
I20260810 13:54:25.692203 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.700749 13639 tablet_bootstrap.cc:654] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.704351 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.705193 13640 tablet_bootstrap.cc:492] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:25.705703 13640 ts_tablet_manager.cc:1403] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.133s user 0.008s sys 0.002s
I20260810 13:54:25.718057 13638 tablet_bootstrap.cc:492] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:25.718490 13638 ts_tablet_manager.cc:1403] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.253s user 0.007s sys 0.004s
I20260810 13:54:25.722560 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:25.723984 13261 raft_consensus.cc:3060] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.732226 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.708076 13640 raft_consensus.cc:359] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.732831 13640 raft_consensus.cc:385] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.733165 13640 raft_consensus.cc:740] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.733836 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:25.736882 13261 raft_consensus.cc:3060] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.740952 13640 consensus_queue.cc:260] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.743666 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:25.749699 13640 ts_tablet_manager.cc:1434] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.044s user 0.005s sys 0.000s
I20260810 13:54:25.750584 13640 tablet_bootstrap.cc:492] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:25.753247 13382 leader_election.cc:343] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.755263 16430 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:25.756076 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:25.755810 16430 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.758193 16430 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.759575 16638 consensus_queue.cc:1048] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:25.763370 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:25.764844 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:25.767681 12952 leader_election.cc:343] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.768088 12952 leader_election.cc:304] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:25.769182 16651 raft_consensus.cc:2749] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:25.774236 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:25.778321 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]
I20260810 13:54:25.780325 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a232694e27574131946f967d95a292f4 [id=fec6784b9d334a72907abaf252914033]
W20260810 13:54:25.782887 12951 leader_election.cc:343] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.786616 13041 raft_consensus.cc:3060] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:25.797111 12952 leader_election.cc:343] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:25.800801 12952 leader_election.cc:343] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.802639 13640 tablet_bootstrap.cc:654] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:25.806413 12952 leader_election.cc:343] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.807978 16651 consensus_queue.cc:1048] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:25.808933 16638 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.809475 16638 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.811321 16638 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:25.811436 12952 leader_election.cc:343] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:25.812377 12952 leader_election.cc:343] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:25.813549 12952 leader_election.cc:343] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.822142 16638 consensus_queue.cc:1048] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:25.831669 16741 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.832412 16741 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:25.838894 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:25.839531 13041 raft_consensus.cc:2468] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:25.847589 16741 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:25.848026 15213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:25.853022 13639 tablet_bootstrap.cc:492] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:25.853585 13639 ts_tablet_manager.cc:1403] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.199s user 0.016s sys 0.003s
I20260810 13:54:25.857928 13640 tablet_bootstrap.cc:492] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:25.858896 13640 ts_tablet_manager.cc:1403] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.108s user 0.007s sys 0.004s
I20260810 13:54:25.864755 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.866453 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.867157 13264 raft_consensus.cc:2393] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:25.868568 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:25.870366 13164 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:25.870760 13164 leader_election.cc:304] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:25.875000 13638 raft_consensus.cc:359] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.875738 13638 raft_consensus.cc:385] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.876046 13638 raft_consensus.cc:740] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.870386 13639 raft_consensus.cc:359] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.877365 13640 raft_consensus.cc:359] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.877333 13639 raft_consensus.cc:385] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.877518 13382 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.879472 13639 raft_consensus.cc:740] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.882293 16638 raft_consensus.cc:2804] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:25.882696 16638 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:25.883034 16638 raft_consensus.cc:3060] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.888787 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.890424 16185 raft_consensus.cc:2749] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:25.891707 13638 consensus_queue.cc:260] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.897130 16638 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.899572 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]
I20260810 13:54:25.901650 13164 leader_election.cc:304] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:25.902573 16729 raft_consensus.cc:2749] T 2b67e5a2b5334147b9d25f2ddc73de31 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:25.903908 13639 consensus_queue.cc:260] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.910740 16638 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:25.913703 13164 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:25.915169 13639 ts_tablet_manager.cc:1434] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.061s user 0.002s sys 0.006s
I20260810 13:54:25.917994 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:25.918485 13041 raft_consensus.cc:3060] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.878034 13640 raft_consensus.cc:385] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:25.920624 13640 raft_consensus.cc:740] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:25.921473 13640 consensus_queue.cc:260] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.924854 16430 raft_consensus.cc:493] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:25.925102 13640 ts_tablet_manager.cc:1434] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.066s user 0.006s sys 0.000s
I20260810 13:54:25.925352 16430 raft_consensus.cc:515] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.925966 13640 tablet_bootstrap.cc:492] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:25.927405 13041 raft_consensus.cc:2468] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:25.929649 16728 raft_consensus.cc:2749] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:25.930341 13382 leader_election.cc:343] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.930716 13382 leader_election.cc:304] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:25.932747 16638 raft_consensus.cc:2749] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:25.927738 16430 leader_election.cc:290] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.941090 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.941840 13268 raft_consensus.cc:2468] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:25.938525 13382 leader_election.cc:304] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:25.945204 16638 raft_consensus.cc:3060] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.950670 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:25.951331 13640 tablet_bootstrap.cc:654] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.951347 13261 raft_consensus.cc:2468] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:25.955296 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:25.956674 12952 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:25.957782 16430 raft_consensus.cc:2804] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:25.958097 16430 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:25.958420 16430 raft_consensus.cc:3060] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:25.958046 13382 leader_election.cc:343] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.962069 13382 leader_election.cc:304] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:25.967548 16430 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:25.970119 16669 raft_consensus.cc:2749] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:25.970538 16430 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:25.975598 12952 leader_election.cc:304] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.976404 16430 raft_consensus.cc:2804] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:25.976824 16430 raft_consensus.cc:493] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:25.977423 16430 raft_consensus.cc:3060] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:25.977756 13639 tablet_bootstrap.cc:492] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:25.983835 13121 heartbeater.cc:646] Failed to heartbeat to 127.12.36.61:35861 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.36.61:35861 timed out after 1.000s (SENT)
I20260810 13:54:25.985750 13639 tablet_bootstrap.cc:654] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:25.987187 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:25.987784 13261 raft_consensus.cc:3060] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:25.979701 13382 leader_election.cc:343] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:25.994148 13261 raft_consensus.cc:2468] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:25.997596 12952 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:25.998155 13638 ts_tablet_manager.cc:1434] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.279s user 0.007s sys 0.000s
I20260810 13:54:25.998415 16651 raft_consensus.cc:2804] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:25.998840 16651 raft_consensus.cc:697] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:25.999181 13638 tablet_bootstrap.cc:492] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:25.999650 16651 consensus_queue.cc:237] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:26.003845 13382 leader_election.cc:343] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:26.013443 16728 consensus_queue.cc:1048] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:26.019827 16430 raft_consensus.cc:515] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.029438 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:26.030128 13268 raft_consensus.cc:3060] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:26.038951 13268 raft_consensus.cc:2468] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:26.041224 16430 leader_election.cc:290] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:26.041567 16640 lock_manager.cc:585] Waited 2 seconds to obtain row lock on key '<redacted>' (key hash 591322104782615093) tablet 00000000000000000000000000000000 cur holder 0x7b580009ba00
I20260810 13:54:26.048866 12952 leader_election.cc:304] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:26.049851 16430 raft_consensus.cc:2804] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:26.050608 16430 raft_consensus.cc:697] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:26.051488 16430 consensus_queue.cc:237] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.056655 16638 raft_consensus.cc:2749] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:26.089461 13640 tablet_bootstrap.cc:492] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:26.089897 13640 ts_tablet_manager.cc:1403] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.164s user 0.004s sys 0.005s
I20260810 13:54:26.092247 13639 tablet_bootstrap.cc:492] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:26.092676 13639 ts_tablet_manager.cc:1403] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.115s user 0.010s sys 0.002s
I20260810 13:54:26.095376 13639 raft_consensus.cc:359] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.096037 13639 raft_consensus.cc:385] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.096329 13639 raft_consensus.cc:740] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.096457 13640 raft_consensus.cc:359] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.097149 13640 raft_consensus.cc:385] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.097416 13640 raft_consensus.cc:740] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.100143 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:26.100713 13477 raft_consensus.cc:2468] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:26.126145 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:26.127804 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:26.128332 13477 raft_consensus.cc:3060] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:26.136751 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:26.098106 13640 consensus_queue.cc:260] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.153162 13477 raft_consensus.cc:2468] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:26.177170 13639 consensus_queue.cc:260] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.179543 13639 ts_tablet_manager.cc:1434] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.087s user 0.004s sys 0.000s
I20260810 13:54:26.173828 13640 ts_tablet_manager.cc:1434] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.084s user 0.009s sys 0.000s
I20260810 13:54:26.182927 13640 tablet_bootstrap.cc:492] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:26.182587 16632 consensus_queue.cc:1048] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:54:26.187958 12951 leader_election.cc:343] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:26.198793 16543 consensus_queue.cc:1048] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:26.205895 16638 raft_consensus.cc:493] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:26.205886 16672 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:26.206491 16672 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:26.209570 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:26.210769 16672 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:26.211635 13382 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:26.215768 16638 raft_consensus.cc:515] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.218181 16638 leader_election.cc:290] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:26.218704 16638 raft_consensus.cc:2804] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:26.219256 16638 raft_consensus.cc:697] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
W20260810 13:54:26.232064 15135 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 3.051s (SENT) [suppressed 1 similar messages]
I20260810 13:54:26.220285 16638 consensus_queue.cc:237] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.260093 13638 tablet_bootstrap.cc:700] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb: Time spent opening tablet: real 0.135s user 0.004s sys 0.000s
I20260810 13:54:26.271715 13639 tablet_bootstrap.cc:492] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:26.286397 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:26.287099 13041 raft_consensus.cc:2468] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:26.301288 13638 tablet_bootstrap.cc:654] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:26.285250 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:26.291952 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:26.313063 13640 tablet_bootstrap.cc:654] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:26.325755 16543 consensus_queue.cc:1048] T bd127b3e02b54ba2a802877233c18247 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:26.330700 16767 consensus_queue.cc:1048] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:26.334460 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:26.335263 13041 raft_consensus.cc:2468] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:26.364444 13639 tablet_bootstrap.cc:654] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:26.366604 13382 consensus_peers.cc:597] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:26.367422 13382 leader_election.cc:343] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:26.367959 13382 leader_election.cc:343] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:26.369031 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:26.387532 13640 tablet_bootstrap.cc:492] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:26.388018 13640 ts_tablet_manager.cc:1403] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.205s user 0.008s sys 0.005s
I20260810 13:54:26.413350 13382 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:26.411125 13640 raft_consensus.cc:359] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.419338 16767 raft_consensus.cc:2804] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:26.419698 16767 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:26.420025 16767 raft_consensus.cc:3060] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:26.418514 13640 raft_consensus.cc:385] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.429563 13640 raft_consensus.cc:740] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.434543 13382 leader_election.cc:304] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:26.437021 13639 tablet_bootstrap.cc:492] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:26.437461 13639 ts_tablet_manager.cc:1403] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.257s user 0.007s sys 0.005s
I20260810 13:54:26.438831 16638 raft_consensus.cc:2804] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:26.439164 16638 raft_consensus.cc:493] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:26.439482 16638 raft_consensus.cc:3060] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:26.441828 16430 raft_consensus.cc:493] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:26.442269 16430 raft_consensus.cc:515] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.444389 16430 leader_election.cc:290] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:26.445971 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:26.447152 12952 leader_election.cc:343] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:26.452441 13639 raft_consensus.cc:359] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.455397 16638 raft_consensus.cc:515] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.463923 13639 raft_consensus.cc:385] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.464260 13639 raft_consensus.cc:740] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.464841 13640 consensus_queue.cc:260] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.466835 13640 ts_tablet_manager.cc:1434] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.079s user 0.004s sys 0.004s
I20260810 13:54:26.466243 13639 consensus_queue.cc:260] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.475860 13639 ts_tablet_manager.cc:1434] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.038s user 0.006s sys 0.000s
I20260810 13:54:26.460355 16767 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.479122 13640 tablet_bootstrap.cc:492] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:26.490617 13638 tablet_bootstrap.cc:492] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:26.493091 13638 ts_tablet_manager.cc:1403] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.494s user 0.015s sys 0.001s
I20260810 13:54:26.510025 13638 raft_consensus.cc:359] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:26.515049 12952 consensus_peers.cc:597] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:26.514647 13638 raft_consensus.cc:385] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.516819 13638 raft_consensus.cc:740] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.521505 13638 consensus_queue.cc:260] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.532087 13639 tablet_bootstrap.cc:492] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:26.533666 13638 ts_tablet_manager.cc:1434] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.039s user 0.011s sys 0.000s
I20260810 13:54:26.539525 13639 tablet_bootstrap.cc:654] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:26.539193 13638 tablet_bootstrap.cc:492] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:26.582993 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:26.486272 16638 leader_election.cc:290] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:26.615062 13640 tablet_bootstrap.cc:654] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:26.621613 16767 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:26.636021 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 103988us
I20260810 13:54:26.640617 16767 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:26.641265 16767 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.641849 13639 tablet_bootstrap.cc:492] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:26.642266 13639 ts_tablet_manager.cc:1403] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.110s user 0.007s sys 0.006s
I20260810 13:54:26.643596 16767 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:26.646889 13638 tablet_bootstrap.cc:654] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:26.647555 13342 heartbeater.cc:646] Failed to heartbeat to 127.12.36.61:35861 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.36.61:35861 timed out after 1.000s (SENT)
I20260810 13:54:26.651084 16767 raft_consensus.cc:493] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:26.651795 16767 raft_consensus.cc:515] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.653899 16767 leader_election.cc:290] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:26.659564 13639 raft_consensus.cc:359] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.660205 13639 raft_consensus.cc:385] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.660468 13639 raft_consensus.cc:740] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.599411 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:26.662812 16761 consensus_queue.cc:1048] T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:26.671021 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:26.671941 13477 raft_consensus.cc:2468] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:26.686506 13638 tablet_bootstrap.cc:492] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:26.686964 13638 ts_tablet_manager.cc:1403] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.149s user 0.014s sys 0.003s
I20260810 13:54:26.661154 13639 consensus_queue.cc:260] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:26.696399 12952 consensus_peers.cc:597] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:26.717922 13640 tablet_bootstrap.cc:492] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:26.721128 13640 ts_tablet_manager.cc:1403] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.242s user 0.012s sys 0.007s
I20260810 13:54:26.722289 13639 ts_tablet_manager.cc:1434] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.080s user 0.006s sys 0.000s
I20260810 13:54:26.698149 13638 raft_consensus.cc:359] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.729128 13638 raft_consensus.cc:385] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.729480 13638 raft_consensus.cc:740] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.729575 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:26.730249 13265 raft_consensus.cc:2468] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:26.731150 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:26.732950 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:26.733256 13640 raft_consensus.cc:359] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.747216 13640 raft_consensus.cc:385] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.747555 13640 raft_consensus.cc:740] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.748206 13640 consensus_queue.cc:260] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.754670 13638 consensus_queue.cc:260] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.758888 13638 ts_tablet_manager.cc:1434] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.072s user 0.009s sys 0.000s
I20260810 13:54:26.761721 13640 ts_tablet_manager.cc:1434] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.040s user 0.007s sys 0.000s
I20260810 13:54:26.762434 16788 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:26.762940 16788 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.765534 16788 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:26.766276 13382 leader_election.cc:343] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:26.775821 13639 tablet_bootstrap.cc:492] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:26.783587 13640 tablet_bootstrap.cc:492] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:26.785686 13639 tablet_bootstrap.cc:654] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:26.785997 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:26.786597 13041 raft_consensus.cc:3060] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:26.795562 12951 leader_election.cc:304] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:26.796864 13382 leader_election.cc:304] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:26.797581 16788 raft_consensus.cc:2804] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:26.797891 16788 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:26.798206 16788 raft_consensus.cc:3060] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:26.799021 16767 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:26.799459 16767 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.801460 16767 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:26.809010 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:26.809015 13382 leader_election.cc:343] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:26.809648 13382 leader_election.cc:343] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:26.828230 16788 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.837517 13475 raft_consensus.cc:3060] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:26.842448 13640 tablet_bootstrap.cc:654] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:26.846500 16788 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:26.847910 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:26.849740 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:26.850557 13261 raft_consensus.cc:2393] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:26.851521 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:26.852059 13268 raft_consensus.cc:3060] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:26.849512 13382 leader_election.cc:343] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:26.862825 16793 raft_consensus.cc:2804] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260810 13:54:26.862928 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 67447.2us
I20260810 13:54:26.863241 16793 raft_consensus.cc:493] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:26.863597 16793 raft_consensus.cc:3060] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:26.863696 13268 raft_consensus.cc:2468] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:26.864037 16543 consensus_queue.cc:1048] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:26.809242 13041 raft_consensus.cc:2468] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:26.822918 13639 tablet_bootstrap.cc:492] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:26.843672 16794 consensus_queue.cc:1048] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:26.866250 13639 ts_tablet_manager.cc:1403] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.091s user 0.010s sys 0.001s
I20260810 13:54:26.880357 16793 raft_consensus.cc:515] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.882589 16793 leader_election.cc:290] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:26.885952 13640 tablet_bootstrap.cc:492] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:26.886422 13640 ts_tablet_manager.cc:1403] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.103s user 0.012s sys 0.000s
I20260810 13:54:26.888616 13382 leader_election.cc:304] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:26.891991 16788 raft_consensus.cc:2804] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:26.892729 16788 raft_consensus.cc:697] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:26.893754 16788 consensus_queue.cc:237] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.898527 13640 raft_consensus.cc:359] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.900247 13638 tablet_bootstrap.cc:492] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:26.907040 13638 tablet_bootstrap.cc:654] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:26.915015 16116 tablet_loader.cc:96] loaded metadata for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085])
I20260810 13:54:26.921566 13639 raft_consensus.cc:359] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.922230 13639 raft_consensus.cc:385] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.922484 13639 raft_consensus.cc:740] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.922887 13640 raft_consensus.cc:385] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.923259 13640 raft_consensus.cc:740] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.923221 13639 consensus_queue.cc:260] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.924510 13640 consensus_queue.cc:260] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.925510 13639 ts_tablet_manager.cc:1434] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.059s user 0.005s sys 0.001s
I20260810 13:54:26.926433 13639 tablet_bootstrap.cc:492] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:26.926455 13640 ts_tablet_manager.cc:1434] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.040s user 0.005s sys 0.000s
W20260810 13:54:26.931198 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 65296us
I20260810 13:54:26.935515 13638 tablet_bootstrap.cc:492] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:26.940989 13638 ts_tablet_manager.cc:1403] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.004s
I20260810 13:54:26.943703 13638 raft_consensus.cc:359] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.947109 13640 tablet_bootstrap.cc:492] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:26.953195 12729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 1.116s (SENT) [suppressed 1 similar messages]
I20260810 13:54:26.954212 16788 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:26.954768 16788 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.957598 16543 consensus_queue.cc:1048] T f922c9ca51044dcda08b245010ab06b0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:26.916535 16116 tablet_loader.cc:96] loaded metadata for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd])
I20260810 13:54:26.961112 16793 consensus_queue.cc:1048] T f668f6b35dc044a1a79f1d5852d39497 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:26.963012 13130 tablet.cc:2406] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 13:54:26.965219 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:26.966606 16788 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:26.954229 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:26.969565 13638 raft_consensus.cc:385] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:26.969727 13261 raft_consensus.cc:3060] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:26.969853 13638 raft_consensus.cc:740] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:26.970535 13638 consensus_queue.cc:260] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:26.971994 13638 ts_tablet_manager.cc:1434] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.031s user 0.002s sys 0.001s
I20260810 13:54:26.979328 13261 raft_consensus.cc:2468] T 61169145c539464fa9cf62eaaf8168e5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:26.981690 13640 tablet_bootstrap.cc:654] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:26.993723 12952 consensus_peers.cc:597] T 34b2314b771f41188bc8101c5ddffaf4 P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260810 13:54:27.000068 13551 heartbeater.cc:646] Failed to heartbeat to 127.12.36.61:35861 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.12.36.61:35861 timed out after 1.000s (SENT)
I20260810 13:54:27.004568 13640 tablet_bootstrap.cc:492] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:27.005107 13640 ts_tablet_manager.cc:1403] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.077s user 0.011s sys 0.001s
W20260810 13:54:27.009658 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:27.013520 13640 raft_consensus.cc:359] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.014218 13640 raft_consensus.cc:385] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.014453 13640 raft_consensus.cc:740] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.015026 13640 consensus_queue.cc:260] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.018103 13640 ts_tablet_manager.cc:1434] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.013s user 0.005s sys 0.001s
I20260810 13:54:27.011018 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:27.030665 13638 tablet_bootstrap.cc:492] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:27.035897 16651 consensus_queue.cc:1048] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:27.037953 16116 tablet_loader.cc:96] loaded metadata for tablet 01d42c8476514b71af3ce2fbc12270d0 (table default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad])
I20260810 13:54:27.039569 13638 tablet_bootstrap.cc:654] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:27.042064 16640 lock_manager.cc:585] Waited 3 seconds to obtain row lock on key '<redacted>' (key hash 591322104782615093) tablet 00000000000000000000000000000000 cur holder 0x7b580009ba00
I20260810 13:54:27.046720 13640 tablet_bootstrap.cc:492] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:27.053469 13640 tablet_bootstrap.cc:654] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.064268 13640 tablet_bootstrap.cc:492] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:27.064709 13640 ts_tablet_manager.cc:1403] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.003s
I20260810 13:54:27.066993 13640 raft_consensus.cc:359] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.067602 13640 raft_consensus.cc:385] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.067845 13640 raft_consensus.cc:740] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.074226 16761 raft_consensus.cc:493] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:27.074753 16761 raft_consensus.cc:515] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.077028 16761 leader_election.cc:290] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:27.081344 13638 tablet_bootstrap.cc:492] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:27.081437 13639 tablet_bootstrap.cc:654] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.081833 13638 ts_tablet_manager.cc:1403] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.051s user 0.007s sys 0.005s
I20260810 13:54:27.084990 13638 raft_consensus.cc:359] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.085618 13638 raft_consensus.cc:385] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.085871 13638 raft_consensus.cc:740] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.086462 13638 consensus_queue.cc:260] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.089983 13638 ts_tablet_manager.cc:1434] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260810 13:54:27.090905 13638 tablet_bootstrap.cc:492] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:27.091449 13382 leader_election.cc:343] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:27.091588 12952 leader_election.cc:304] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:27.092317 16793 raft_consensus.cc:2804] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:27.092780 16793 raft_consensus.cc:697] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:27.092765 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:27.093528 16793 consensus_queue.cc:237] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.097800 16116 tablet_loader.cc:96] loaded metadata for tablet 01f616bc07234fa2a454811e75a1aec2 (table default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 [id=7a8b712d0b1a4766ab00cd2c4739c311])
I20260810 13:54:27.068456 13640 consensus_queue.cc:260] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.105086 13640 ts_tablet_manager.cc:1434] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.040s user 0.006s sys 0.000s
I20260810 13:54:27.106153 13640 tablet_bootstrap.cc:492] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:27.114743 16116 tablet_loader.cc:96] loaded metadata for tablet 049416892e964159a06d5817932bbd7a (table default.Table_612d612a32794a8998dd3a19129b79c3 [id=840614d5bd744a82bf94fd2f23a31d69])
W20260810 13:54:27.120244 13382 leader_election.cc:343] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:27.127727 16116 tablet_loader.cc:96] loaded metadata for tablet 058562eef38d46a8a3a39e3ce5425dd6 (table default.Table_9d81870e910444848f2c714a1b9da18c [id=e506f8a07858485398058c93c553f904])
I20260810 13:54:27.129428 13640 tablet_bootstrap.cc:654] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.137532 13638 tablet_bootstrap.cc:654] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.148614 13640 tablet_bootstrap.cc:492] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:27.149073 13640 ts_tablet_manager.cc:1403] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.004s
I20260810 13:54:27.160447 13638 tablet_bootstrap.cc:492] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:27.160887 13638 ts_tablet_manager.cc:1403] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.070s user 0.009s sys 0.002s
I20260810 13:54:27.163476 13638 raft_consensus.cc:359] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.164094 13638 raft_consensus.cc:385] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.164350 13638 raft_consensus.cc:740] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.164862 13640 raft_consensus.cc:359] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.165515 13640 raft_consensus.cc:385] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.165768 13640 raft_consensus.cc:740] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.166355 13640 consensus_queue.cc:260] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.167393 13638 consensus_queue.cc:260] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.169567 13638 ts_tablet_manager.cc:1434] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260810 13:54:27.178510 16651 raft_consensus.cc:493] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:27.178968 16651 raft_consensus.cc:515] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.180929 16651 leader_election.cc:290] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:27.173714 16116 tablet_loader.cc:96] loaded metadata for tablet 07405ca45a9c4575bc653c2dd95fea6b (table default.Table_356ec0418a38420d8a4e18b2f69682c3 [id=f8b08e6c518647d194daba555502622a])
I20260810 13:54:27.178129 13640 ts_tablet_manager.cc:1434] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20260810 13:54:27.182631 13640 tablet_bootstrap.cc:492] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:27.191911 13558 tablet.cc:2406] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:54:27.208581 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:27.215274 12952 leader_election.cc:343] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:27.216930 13638 tablet_bootstrap.cc:492] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:27.226228 13640 tablet_bootstrap.cc:654] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.226649 16116 tablet_loader.cc:96] loaded metadata for tablet 094a3448b54c409281c31813e60dcb7f (table default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6])
I20260810 13:54:27.235967 13640 tablet_bootstrap.cc:492] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:27.236483 13640 ts_tablet_manager.cc:1403] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.054s user 0.007s sys 0.004s
I20260810 13:54:27.245970 13639 tablet_bootstrap.cc:492] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:27.246397 13639 ts_tablet_manager.cc:1403] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.320s user 0.009s sys 0.000s
I20260810 13:54:27.248220 13640 raft_consensus.cc:359] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.248852 13640 raft_consensus.cc:385] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.249096 13640 raft_consensus.cc:740] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.256718 13638 tablet_bootstrap.cc:654] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.254308 13640 consensus_queue.cc:260] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.259261 13640 ts_tablet_manager.cc:1434] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260810 13:54:27.260125 13640 tablet_bootstrap.cc:492] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:27.267556 13640 tablet_bootstrap.cc:654] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.281243 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:27.281894 13041 raft_consensus.cc:3060] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:27.300532 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:27.300835 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:27.301235 13049 raft_consensus.cc:2468] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:27.301308 13050 raft_consensus.cc:2468] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
W20260810 13:54:27.307075 13345 tablet.cc:2406] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:54:27.230232 16116 tablet_loader.cc:96] loaded metadata for tablet 09d572e2dc764d259df43026f49e0831 (table default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 [id=7b407001f6d54bd2929f1f0d141b065e])
I20260810 13:54:27.355325 13640 tablet_bootstrap.cc:492] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:27.355806 13640 ts_tablet_manager.cc:1403] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.096s user 0.009s sys 0.018s
I20260810 13:54:27.359455 13041 raft_consensus.cc:2468] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:27.361187 13268 raft_consensus.cc:3060] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:27.361835 13639 raft_consensus.cc:359] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.378341 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:27.401652 13639 raft_consensus.cc:385] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.402038 13639 raft_consensus.cc:740] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.402864 13639 consensus_queue.cc:260] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.383229 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:27.384281 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:27.385690 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:27.404629 13049 raft_consensus.cc:3060] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:27.415660 13638 tablet_bootstrap.cc:492] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:27.416102 13638 ts_tablet_manager.cc:1403] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.246s user 0.018s sys 0.032s
I20260810 13:54:27.419943 13638 raft_consensus.cc:359] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.420570 13638 raft_consensus.cc:385] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.420864 13638 raft_consensus.cc:740] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.421489 13638 consensus_queue.cc:260] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.422899 13638 ts_tablet_manager.cc:1434] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
W20260810 13:54:27.424285 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:27.440182 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:27.352613 16116 tablet_loader.cc:96] loaded metadata for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c])
I20260810 13:54:27.433653 13049 raft_consensus.cc:2468] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:27.461408 13638 tablet_bootstrap.cc:492] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:27.466859 16767 raft_consensus.cc:493] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:27.467599 16767 raft_consensus.cc:515] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.358793 13640 raft_consensus.cc:359] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.468943 13640 raft_consensus.cc:385] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.469228 13640 raft_consensus.cc:740] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.470026 13640 consensus_queue.cc:260] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.471482 16767 leader_election.cc:290] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:27.472393 13640 ts_tablet_manager.cc:1434] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.116s user 0.005s sys 0.000s
I20260810 13:54:27.475167 13638 tablet_bootstrap.cc:654] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.475708 13639 ts_tablet_manager.cc:1434] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.229s user 0.004s sys 0.003s
I20260810 13:54:27.479035 13639 tablet_bootstrap.cc:492] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:27.479451 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:27.489385 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:27.509950 13638 tablet_bootstrap.cc:492] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:27.510414 13638 ts_tablet_manager.cc:1403] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.005s
I20260810 13:54:27.513787 16116 tablet_loader.cc:96] loaded metadata for tablet 0d147e624d4243b9b330c874e0f27f6c (table default.Table_213c40da56b549d3bb97fccaa8f872cd [id=8bb576bce14b4fc3b1848496c6081841])
I20260810 13:54:27.514472 13638 raft_consensus.cc:359] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.515141 13638 raft_consensus.cc:385] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.515427 13638 raft_consensus.cc:740] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.516052 13638 consensus_queue.cc:260] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:27.543541 13382 consensus_peers.cc:597] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:27.544577 13638 ts_tablet_manager.cc:1434] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.034s user 0.005s sys 0.000s
I20260810 13:54:27.545481 13638 tablet_bootstrap.cc:492] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:27.551301 13638 tablet_bootstrap.cc:654] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.551064 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:27.553571 13382 leader_election.cc:304] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:27.554601 16767 raft_consensus.cc:2804] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:27.555163 16767 raft_consensus.cc:697] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:27.556231 16767 consensus_queue.cc:237] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.567159 16116 tablet_loader.cc:96] loaded metadata for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb])
I20260810 13:54:27.571981 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:27.572520 13474 raft_consensus.cc:3060] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:27.583564 13640 tablet_bootstrap.cc:492] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:27.593474 13474 raft_consensus.cc:2468] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:27.607764 16793 raft_consensus.cc:493] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:27.608397 16793 raft_consensus.cc:515] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.610967 16793 leader_election.cc:290] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:27.616528 16116 tablet_loader.cc:96] loaded metadata for tablet 121d7abf368a4cf99fd045b8c8ba4b69 (table default.Table_1efc108552b047538e81a19f9d985680 [id=b0c2c10c7abb49c0b0026662e9edba2a])
I20260810 13:54:27.636719 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:27.637492 13475 raft_consensus.cc:2468] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:27.662495 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:27.672020 13639 tablet_bootstrap.cc:654] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.673316 16116 tablet_loader.cc:96] loaded metadata for tablet 146ff83104d247cfa565cec8579ca00f (table default.Table_7cf74351dd314634a7a8ca1b1a24302b [id=884f2bca73394b0b97902104a5b68976])
I20260810 13:54:27.678040 13382 leader_election.cc:304] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:54:27.678805 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 43810.2us
I20260810 13:54:27.679210 16767 raft_consensus.cc:2804] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:27.679584 16767 raft_consensus.cc:493] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:27.679936 16767 raft_consensus.cc:3060] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:27.701858 13640 tablet_bootstrap.cc:654] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.710719 16767 raft_consensus.cc:515] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:27.725907 16854 log.cc:927] Time spent T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
W20260810 13:54:27.753811 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7c57ca566cfe47f6a331bbbe5c344a89 consensus state has no leader
I20260810 13:54:27.768384 16728 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:27.782855 13638 tablet_bootstrap.cc:492] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:27.783299 13638 ts_tablet_manager.cc:1403] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.238s user 0.065s sys 0.098s
I20260810 13:54:27.786273 13638 raft_consensus.cc:359] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.786886 13638 raft_consensus.cc:385] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.787492 13638 raft_consensus.cc:740] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.788530 13638 consensus_queue.cc:260] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.790972 13638 ts_tablet_manager.cc:1434] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260810 13:54:27.791801 13638 tablet_bootstrap.cc:492] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:27.801923 13382 leader_election.cc:343] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:27.813540 13638 tablet_bootstrap.cc:654] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.838569 13638 tablet_bootstrap.cc:492] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:27.838997 13638 ts_tablet_manager.cc:1403] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.047s user 0.009s sys 0.000s
I20260810 13:54:27.841552 13638 raft_consensus.cc:359] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.842149 13638 raft_consensus.cc:385] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.842389 13638 raft_consensus.cc:740] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.842968 13638 consensus_queue.cc:260] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.844969 13638 ts_tablet_manager.cc:1434] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260810 13:54:27.846006 13638 tablet_bootstrap.cc:492] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:27.769174 16728 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.858505 16728 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:27.882990 16116 tablet_loader.cc:96] loaded metadata for tablet 14a19e0d12cf4582b0b5ec5c2fa25f49 (table default.Table_23cb4b4f896b48b1adc91079a7382c5c [id=a32ace7c7992464c8a5ef3f8169906b6])
W20260810 13:54:27.883971 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:27.884505 16116 tablet_loader.cc:96] loaded metadata for tablet 14e68b57d7fb40cd8430144733749c21 (table default.Table_40e69780eeb744aa8a192c8623bc7d4b [id=2ef48298f4404224bb44136ff71befd8])
I20260810 13:54:27.885991 16116 tablet_loader.cc:96] loaded metadata for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_a49a2f11e36d4162bc5847bacee456e7 [id=8aad892ad49f4c0aa7681d88843d3561])
I20260810 13:54:27.887079 16116 tablet_loader.cc:96] loaded metadata for tablet 15857ead4a9a48c49b4acea92d4bba60 (table default.Table_2da57f87f29a425dbef85d4f4db4bc26 [id=d3522604bed74abf8b357894ca97ddad])
I20260810 13:54:27.862056 13638 tablet_bootstrap.cc:654] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.890473 13268 raft_consensus.cc:3060] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:27.893703 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:27.900341 13382 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:27.911847 13382 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:27.915294 16761 raft_consensus.cc:2749] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:27.918123 13382 leader_election.cc:343] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:27.923873 13638 tablet_bootstrap.cc:492] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:27.912588 16788 raft_consensus.cc:2804] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:27.924273 13638 ts_tablet_manager.cc:1403] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.079s user 0.009s sys 0.012s
I20260810 13:54:27.924865 16788 raft_consensus.cc:697] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:27.926110 16788 consensus_queue.cc:237] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.927354 13638 raft_consensus.cc:359] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.928467 13638 raft_consensus.cc:385] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.928854 13638 raft_consensus.cc:740] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.923831 13382 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:27.921399 16861 log.cc:927] Time spent T 61fd4d043c354ad79d79c32498a469b4 P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.161s user 0.001s sys 0.000s
I20260810 13:54:27.933032 13638 consensus_queue.cc:260] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.935793 13638 ts_tablet_manager.cc:1434] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.011s user 0.005s sys 0.003s
I20260810 13:54:27.936836 16761 raft_consensus.cc:2749] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:27.943665 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:27.946552 13638 tablet_bootstrap.cc:492] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:27.952381 13638 tablet_bootstrap.cc:654] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:27.953218 16865 raft_consensus.cc:493] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:27.953681 16865 raft_consensus.cc:515] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.956139 16865 leader_election.cc:290] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:27.912233 16767 leader_election.cc:290] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:27.958246 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:27.985937 13639 tablet_bootstrap.cc:492] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:27.986503 13639 ts_tablet_manager.cc:1403] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.508s user 0.013s sys 0.000s
I20260810 13:54:27.989511 13639 raft_consensus.cc:359] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.990378 13639 raft_consensus.cc:385] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:27.990526 13640 tablet_bootstrap.cc:492] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:27.990706 13639 raft_consensus.cc:740] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:27.991205 13640 ts_tablet_manager.cc:1403] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.408s user 0.010s sys 0.005s
I20260810 13:54:27.992342 13639 consensus_queue.cc:260] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:27.994387 13639 ts_tablet_manager.cc:1434] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260810 13:54:27.998983 13639 tablet_bootstrap.cc:492] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:28.004798 16865 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.005280 16865 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.007026 13639 tablet_bootstrap.cc:654] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.007217 16865 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:28.012902 16865 raft_consensus.cc:493] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.013325 16865 raft_consensus.cc:515] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.016038 16865 leader_election.cc:290] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:28.036535 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:28.037165 13261 raft_consensus.cc:3060] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:28.043682 13261 raft_consensus.cc:2468] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:28.045171 13639 tablet_bootstrap.cc:492] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:28.045069 16767 raft_consensus.cc:493] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.045588 13639 ts_tablet_manager.cc:1403] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.007s
I20260810 13:54:28.045663 16767 raft_consensus.cc:515] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.049888 13639 raft_consensus.cc:359] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.050714 13639 raft_consensus.cc:385] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.050992 13639 raft_consensus.cc:740] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:28.051697 13382 leader_election.cc:343] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:28.051736 13639 consensus_queue.cc:260] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.052150 13382 leader_election.cc:304] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:28.053632 13639 ts_tablet_manager.cc:1434] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260810 13:54:28.054546 16788 raft_consensus.cc:2749] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:28.054952 13639 tablet_bootstrap.cc:492] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:28.067739 13640 raft_consensus.cc:359] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.072508 13639 tablet_bootstrap.cc:654] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.074276 16116 tablet_loader.cc:96] loaded metadata for tablet 1946995eb9354e19916f31e1f8e46996 (table default.Table_b6a730448efc42958de4f9513cbd365b [id=dbf489131f724a7b85f1bac4f9e3e614])
I20260810 13:54:28.075666 16116 tablet_loader.cc:96] loaded metadata for tablet 1956edd131c14f93994b5d9f2a7420b1 (table default.Table_72e9522a295642b28aa17f724e010d9e [id=143a3ec1ee2d409fa9de19aa1c8c8ab3])
W20260810 13:54:28.077450 12952 leader_election.cc:343] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:28.080499 12952 consensus_peers.cc:597] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a1b35d369474ba9bee379089796bd3c. This is attempt 6: this message will repeat every 5th retry.
I20260810 13:54:28.090381 13640 raft_consensus.cc:385] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.090684 13640 raft_consensus.cc:740] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:28.091471 13640 consensus_queue.cc:260] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:28.096076 16799 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 1.252s user 0.036s sys 0.000s
I20260810 13:54:28.072083 16767 leader_election.cc:290] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:28.080138 13382 leader_election.cc:343] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:28.102422 13382 leader_election.cc:304] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:28.107138 16761 raft_consensus.cc:2749] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:28.109696 12729 leader_election.cc:336] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317): Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 1.116s (SENT)
I20260810 13:54:28.110351 12729 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:28.123713 13638 tablet_bootstrap.cc:492] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:28.124236 13638 ts_tablet_manager.cc:1403] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.178s user 0.032s sys 0.022s
I20260810 13:54:28.127242 13638 raft_consensus.cc:359] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.129906 13639 tablet_bootstrap.cc:492] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:28.130314 13639 ts_tablet_manager.cc:1403] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.076s user 0.015s sys 0.008s
I20260810 13:54:28.130616 13638 raft_consensus.cc:385] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.131597 13638 raft_consensus.cc:740] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:28.134320 13638 consensus_queue.cc:260] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.135784 13638 ts_tablet_manager.cc:1434] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.011s user 0.000s sys 0.004s
I20260810 13:54:28.140326 16761 consensus_queue.cc:1048] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:28.143292 16865 raft_consensus.cc:493] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.143754 16865 raft_consensus.cc:515] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.145861 16865 leader_election.cc:290] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:28.147203 13640 ts_tablet_manager.cc:1434] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.156s user 0.006s sys 0.001s
I20260810 13:54:28.148221 13640 tablet_bootstrap.cc:492] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:28.154974 16883 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260810 13:54:28.156463 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 46939.5us
I20260810 13:54:28.157229 16788 raft_consensus.cc:493] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.158497 16116 tablet_loader.cc:96] loaded metadata for tablet 19fe94b1d72b4bb29f0154f58c9fa43f (table default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9])
I20260810 13:54:28.160046 16116 tablet_loader.cc:96] loaded metadata for tablet 1a0f39d7fa7e4cac9dda6ec101229efd (table default.Table_131ccf6f50394a4facf6e622d5449b17 [id=b559d903254d433989a2deb00eb27361])
I20260810 13:54:28.166577 16630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9666026fb7e4c85b46c6aab952932fb. Latest consensus state: current_term: 6 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:28.166589 16881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:28.167586 16630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:54:28.167785 16881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:54:28.177512 13640 tablet_bootstrap.cc:654] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.178310 16116 tablet_loader.cc:96] loaded metadata for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e])
I20260810 13:54:28.181222 13638 tablet_bootstrap.cc:492] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:28.181275 16116 tablet_loader.cc:96] loaded metadata for tablet 1a7fb49228fa4a0c8d28a4ed0a4ae180 (table default.Table_2ca2243ef2fe4479bb1edec0046866b9 [id=d9cc836fbee549a08553ed113e483bf6])
I20260810 13:54:28.182657 16116 tablet_loader.cc:96] loaded metadata for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6])
I20260810 13:54:28.187803 13638 tablet_bootstrap.cc:654] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.187490 13639 raft_consensus.cc:359] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.188211 13639 raft_consensus.cc:385] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.188486 13639 raft_consensus.cc:740] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:28.193866 13639 consensus_queue.cc:260] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:28.194940 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 53883.7us
I20260810 13:54:28.196117 13639 ts_tablet_manager.cc:1434] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.066s user 0.007s sys 0.000s
I20260810 13:54:28.197103 13639 tablet_bootstrap.cc:492] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:28.211962 16873 raft_consensus.cc:493] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.212553 16873 raft_consensus.cc:515] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.216513 16873 leader_election.cc:290] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:28.234596 16116 tablet_loader.cc:96] loaded metadata for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc])
I20260810 13:54:28.241859 13639 tablet_bootstrap.cc:654] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.248338 16116 tablet_loader.cc:96] loaded metadata for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e])
I20260810 13:54:28.267799 16116 tablet_loader.cc:96] loaded metadata for tablet 1c68d8171bf847eab37c505640b831fc (table default.Table_df8743b260984398bf1a3a7c1ee5c4a2 [id=f01c22584d5f4cb696573d09deec464e])
W20260810 13:54:28.268183 15181 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:53373 (request call id 90) took 4400 ms (client timeout 1000 ms). Trace:
W20260810 13:54:28.274958 15182 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:55221 (request call id 81) took 3965 ms (client timeout 1000 ms). Trace:
I20260810 13:54:28.281713 16116 tablet_loader.cc:96] loaded metadata for tablet 1ee6e694366543328526313d7018b5db (table default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9])
I20260810 13:54:28.286764 16767 raft_consensus.cc:493] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.287390 16767 raft_consensus.cc:515] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.289819 16767 leader_election.cc:290] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:28.157815 16788 raft_consensus.cc:515] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.292002 16788 leader_election.cc:290] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:28.292156 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:28.295132 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 155170us
W20260810 13:54:28.295871 13382 leader_election.cc:343] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:28.296257 13382 leader_election.cc:304] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:28.296972 16761 raft_consensus.cc:2749] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:28.274780 15181 rpcz_store.cc:269] 0810 13:54:23.867489 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:23.867630 (+ 141us) service_pool.cc:224] Handling call
0810 13:54:28.223320 (+4355690us) spinlock_profiling.cc:243] Waited 4.3 s on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.267740 (+ 44420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9895189376}
W20260810 13:54:28.301445 15177 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:51727 (request call id 71) took 4490 ms (client timeout 1000 ms). Trace:
I20260810 13:54:28.303959 13639 tablet_bootstrap.cc:492] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
W20260810 13:54:28.275311 15182 rpcz_store.cc:269] 0810 13:54:24.262177 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:24.262343 (+ 166us) service_pool.cc:224] Handling call
0810 13:54:28.164715 (+3902372us) spinlock_profiling.cc:243] Waited 3.9 s on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.227855 (+ 63140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8963381632}
I20260810 13:54:28.304481 13639 ts_tablet_manager.cc:1403] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.108s user 0.009s sys 0.007s
I20260810 13:54:28.307495 13639 raft_consensus.cc:359] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.314736 13640 tablet_bootstrap.cc:492] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:28.315183 13640 ts_tablet_manager.cc:1403] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.167s user 0.011s sys 0.000s
W20260810 13:54:28.301853 15177 rpcz_store.cc:269] 0810 13:54:23.753116 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:23.753253 (+ 137us) service_pool.cc:224] Handling call
0810 13:54:28.161498 (+4408245us) spinlock_profiling.cc:243] Waited 4.39 s on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.243664 (+ 82166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10102578048}
I20260810 13:54:28.318856 13640 raft_consensus.cc:359] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:28.325176 15173 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:53373 (request call id 91) took 3334 ms (client timeout 1000 ms). Trace:
I20260810 13:54:28.325326 16116 tablet_loader.cc:96] loaded metadata for tablet 213e54b67ee94d299345a3d1eabc9ae6 (table default.Table_88dee97116de4d0dac8a7af552b06f14 [id=0b34e431b94a4d24ad26858d4630420f])
I20260810 13:54:28.326493 16116 tablet_loader.cc:96] loaded metadata for tablet 21e31826c3a94981b6a47bf9feee9f83 (table default.Table_d21ea3e2ede2490b963de16453e2ad9e [id=c34177c45eda4d9e892e77cc723efbf1])
I20260810 13:54:28.334677 16116 tablet_loader.cc:96] loaded metadata for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607])
I20260810 13:54:28.362231 13256 raft_consensus.cc:3060] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:28.366998 15169 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:53373 (request call id 92) took 2171 ms (client timeout 1000 ms). Trace:
I20260810 13:54:28.374680 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:28.319491 13640 raft_consensus.cc:385] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.376296 13640 raft_consensus.cc:740] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:28.377070 13640 consensus_queue.cc:260] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.380024 13640 ts_tablet_manager.cc:1434] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.065s user 0.005s sys 0.000s
I20260810 13:54:28.380409 13639 raft_consensus.cc:385] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.380872 13639 raft_consensus.cc:740] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:28.381570 13639 consensus_queue.cc:260] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:28.383796 15167 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:51727 (request call id 74) took 1310 ms (client timeout 1000 ms). Trace:
I20260810 13:54:28.386265 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:28.392988 16116 tablet_loader.cc:96] loaded metadata for tablet 26ca6ce1b13942f4af59ea1d38fd395c (table default.Table_734de53e103d480c93e2779ef687142e [id=23152d9b944747f89cd06ee3a569b5b3])
I20260810 13:54:28.397439 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:28.401292 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:28.401497 15171 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:55221 (request call id 82) took 2642 ms (client timeout 1000 ms). Trace:
W20260810 13:54:28.325652 15173 rpcz_store.cc:269] 0810 13:54:24.982292 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:24.982542 (+ 250us) service_pool.cc:224] Handling call
0810 13:54:28.173758 (+3191216us) spinlock_profiling.cc:243] Waited 3.19 s on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.316876 (+143118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7325703936}
W20260810 13:54:28.402138 15171 rpcz_store.cc:269] 0810 13:54:25.632397 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:25.636921 (+ 4524us) service_pool.cc:224] Handling call
0810 13:54:28.222008 (+2585087us) spinlock_profiling.cc:243] Waited 2.56 s on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.274444 (+ 52436us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5878162176}
I20260810 13:54:28.410426 13639 ts_tablet_manager.cc:1434] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.106s user 0.006s sys 0.001s
I20260810 13:54:28.413022 13638 tablet_bootstrap.cc:492] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:28.413514 13638 ts_tablet_manager.cc:1403] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.233s user 0.003s sys 0.011s
I20260810 13:54:28.414266 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:28.416594 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:28.384498 15167 rpcz_store.cc:269] 0810 13:54:27.071329 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:27.071527 (+ 198us) service_pool.cc:224] Handling call
0810 13:54:28.164298 (+1092771us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.381907 (+217609us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2489433984}
I20260810 13:54:28.417853 13042 raft_consensus.cc:2393] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:28.421592 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:28.368831 15169 rpcz_store.cc:269] 0810 13:54:26.184020 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:26.184598 (+ 578us) service_pool.cc:224] Handling call
0810 13:54:28.201477 (+2016879us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.355119 (+153642us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4525006592}
I20260810 13:54:28.433395 16116 tablet_loader.cc:96] loaded metadata for tablet 27036a9813b9404aa174f7af9d6e51e0 (table default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 [id=e992c0b15e564af7a0722b50e969adf4])
I20260810 13:54:28.444906 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:28.446792 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:28.446843 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:28.447520 13049 raft_consensus.cc:2393] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:28.448987 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:28.449702 13049 raft_consensus.cc:2393] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:28.443274 16793 consensus_queue.cc:1048] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260810 13:54:28.456627 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:28.457309 13639 tablet_bootstrap.cc:492] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:28.460791 15170 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:51727 (request call id 73) took 2403 ms (client timeout 1000 ms). Trace:
W20260810 13:54:28.461460 15170 rpcz_store.cc:269] 0810 13:54:25.996446 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:25.996667 (+ 221us) service_pool.cc:224] Handling call
0810 13:54:28.163058 (+2166391us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.399898 (+236840us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4958900480}
I20260810 13:54:28.465085 13638 raft_consensus.cc:359] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.465881 13638 raft_consensus.cc:385] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.466184 13638 raft_consensus.cc:740] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:28.466843 13638 consensus_queue.cc:260] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.471655 13639 tablet_bootstrap.cc:654] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.482656 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:28.485525 13265 raft_consensus.cc:3060] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:28.493096 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:28.483739 12952 leader_election.cc:343] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:28.494345 12952 consensus_peers.cc:597] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65c3b03d5f1543b28ea6c439c3cfb07e. This is attempt 6: this message will repeat every 5th retry.
W20260810 13:54:28.497916 15166 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.1:53373 (request call id 93) took 1130 ms (client timeout 1000 ms). Trace:
W20260810 13:54:28.498533 15166 rpcz_store.cc:269] 0810 13:54:27.290562 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:27.290790 (+ 228us) service_pool.cc:224] Handling call
0810 13:54:28.220052 (+929262us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.420401 (+200349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2009846016}
I20260810 13:54:28.500111 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:28.501085 13382 leader_election.cc:304] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:28.503234 16885 raft_consensus.cc:2804] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:28.503927 16885 raft_consensus.cc:697] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:28.505185 16885 consensus_queue.cc:237] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:28.501490 15176 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.3:51727 (request call id 72) took 3501 ms (client timeout 1000 ms). Trace:
W20260810 13:54:28.506287 15176 rpcz_store.cc:269] 0810 13:54:24.928235 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:24.928451 (+ 216us) service_pool.cc:224] Handling call
0810 13:54:28.169513 (+3241062us) spinlock_profiling.cc:243] Waited 3.24 s on lock 0x7b5400040454. stack: 00007efd89167cf3 00007efd89167bf0 00007efd88d15574 0000000000516de4 0000000000516d79 00007efd90269470 00007efd9030831a 00007efd9207205c 00007efd9216ec7e 00007efd8fd1cfb4 00007efd8fd1cf42 00007efd8fd1ce71 00007efd8fd1cdec 00007efd8fd1c0a2 00007efd8dfca07c 00007efd8dfc94b6
0810 13:54:28.429533 (+260020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7442378112}
I20260810 13:54:28.512183 16761 consensus_queue.cc:1048] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:54:28.515378 13382 leader_election.cc:343] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:28.521230 13640 tablet_bootstrap.cc:492] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:28.528872 16885 raft_consensus.cc:493] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.529737 16885 raft_consensus.cc:515] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.532500 13640 tablet_bootstrap.cc:654] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.534993 16885 leader_election.cc:290] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:28.553361 13639 tablet_bootstrap.cc:492] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:28.554484 13639 ts_tablet_manager.cc:1403] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.097s user 0.012s sys 0.006s
W20260810 13:54:28.555764 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:28.556015 16116 tablet_loader.cc:96] loaded metadata for tablet 27649cff0c5f4e6783e8a2f0a1f847ae (table default.Table_1668535b5107458a842c0def2c55461f [id=0cdd1449d5734d559f49933deef6bb19])
I20260810 13:54:28.569708 16116 tablet_loader.cc:96] loaded metadata for tablet 288debea4aa045d1898483cde1d4d3b1 (table default.Table_a8f5484f0ff14287be783696e6d8525d [id=06f3859cd5e748a3800b66ecf0a93c28])
I20260810 13:54:28.571101 16116 tablet_loader.cc:96] loaded metadata for tablet 29ace970eee349d6b669b5c531f91c8b (table default.Table_5b39c1bb4b614f97ab6eb4d521628013 [id=b69ad2b0c70949b98192ae056eb2cab0])
I20260810 13:54:28.573213 16116 tablet_loader.cc:96] loaded metadata for tablet 2b88b4fa155d4364b4fa1b2c724755bb (table default.Table_856a1bf64ef9498890c9b6d98edcc8ad [id=60b4f30b701344d79b0c64b4e8127dbd])
I20260810 13:54:28.575554 16116 tablet_loader.cc:96] loaded metadata for tablet 2be6cc62ea1e4299b8b243b70700d064 (table default.Table_def78e8fb6b74845bf2ef24bcef6691b [id=42af124147fe44c1875a9803af2e97a9])
I20260810 13:54:28.582499 16116 tablet_loader.cc:96] loaded metadata for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf])
I20260810 13:54:28.583895 16116 tablet_loader.cc:96] loaded metadata for tablet 2e5616cea29148a49ac6db261351f460 (table default.Table_5967f54814d04534b6a591a3bf9a4e8e [id=fd3f5c353a584a6b9d955543762bb8c6])
I20260810 13:54:28.586485 13639 raft_consensus.cc:359] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.587122 13639 raft_consensus.cc:385] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.587931 13639 raft_consensus.cc:740] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:28.588995 13639 consensus_queue.cc:260] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.590924 13639 ts_tablet_manager.cc:1434] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.036s user 0.004s sys 0.001s
I20260810 13:54:28.593500 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:28.594023 13475 raft_consensus.cc:2468] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:54:28.599061 15181 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.12.36.2:55221 (request call id 83) took 1263 ms (client timeout 1000 ms). Trace:
W20260810 13:54:28.599555 15181 rpcz_store.cc:269] 0810 13:54:27.335332 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:28.301722 (+966390us) service_pool.cc:224] Handling call
0810 13:54:28.598916 (+297194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:28.605214 16116 tablet_loader.cc:96] loaded metadata for tablet 2e5ad84fe2604dd2959768db31f66e7c (table default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0])
I20260810 13:54:28.606676 16116 tablet_loader.cc:96] loaded metadata for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03])
I20260810 13:54:28.607946 16116 tablet_loader.cc:96] loaded metadata for tablet 3066b475871c45fdbe585947fd6800c9 (table default.Table_6c443ac64289437d8c7dcf5ea44469dd [id=9c99ad2364cc45fba0746cbae06deeeb])
I20260810 13:54:28.609406 16116 tablet_loader.cc:96] loaded metadata for tablet 30676a11ab60455aa4ccd22347beb80e (table default.Table_d8ab37a103a5426b81dcf295239ec9af [id=b7130fcdfcf54b76861fd9c87559beeb])
I20260810 13:54:28.624065 13639 tablet_bootstrap.cc:492] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:28.624558 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:28.625181 13475 raft_consensus.cc:2468] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:28.632100 16116 tablet_loader.cc:96] loaded metadata for tablet 30a5adc9446543eb91f5a1c0f0859c31 (table default.Table_b33cb4c7a80141c49d306885213f30a9 [id=7dff57e81c064728a8160d5c02c11de5])
I20260810 13:54:28.632619 16793 consensus_queue.cc:1048] T 049416892e964159a06d5817932bbd7a P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:28.633363 16116 tablet_loader.cc:96] loaded metadata for tablet 30d9e5103fe644f38d969c64182f7cbb (table default.Table_215968e7ab2540ab8a35960795941543 [id=9bac646089c94e54b68ff14ce2a50793])
I20260810 13:54:28.640146 12951 leader_election.cc:304] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:28.641171 16651 raft_consensus.cc:2804] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:28.641664 16651 raft_consensus.cc:493] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:28.642158 16651 raft_consensus.cc:3060] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:28.649996 16116 tablet_loader.cc:96] loaded metadata for tablet 32905f89c1d3480abb007f8dd130e2de (table default.Table_7c263dc08783483d941121c9c3cafdc6 [id=fc5a0ae7f9074bfc89acd9077b020821])
I20260810 13:54:28.653357 16116 tablet_loader.cc:96] loaded metadata for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef])
I20260810 13:54:28.662129 12951 leader_election.cc:304] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:28.663025 13639 tablet_bootstrap.cc:654] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.663439 16873 raft_consensus.cc:2804] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:28.663919 16873 raft_consensus.cc:493] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:28.664328 16873 raft_consensus.cc:3060] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:28.665616 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 44113.2us
I20260810 13:54:28.677676 13638 ts_tablet_manager.cc:1434] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.264s user 0.001s sys 0.005s
I20260810 13:54:28.678668 13638 tablet_bootstrap.cc:492] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:28.678956 13640 tablet_bootstrap.cc:492] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:28.679345 13640 ts_tablet_manager.cc:1403] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.158s user 0.013s sys 0.006s
I20260810 13:54:28.682240 13640 raft_consensus.cc:359] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.682948 13640 raft_consensus.cc:385] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.683218 13640 raft_consensus.cc:740] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:28.683933 13640 consensus_queue.cc:260] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.686618 13640 ts_tablet_manager.cc:1434] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260810 13:54:28.692631 16116 tablet_loader.cc:96] loaded metadata for tablet 387ebbb8677c4fb082006585389c6582 (table default.Table_10638f441f654317829d436d2e7eb979 [id=4f21b5213a724ce5989d7684473d65e9])
I20260810 13:54:28.694140 16885 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.694645 16885 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.696365 13640 tablet_bootstrap.cc:492] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:28.697333 16885 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:28.711400 16116 tablet_loader.cc:96] loaded metadata for tablet 393e23a9c03049a280f3ef89bdca5011 (table default.Table_4f780597fcec4261acd040c8816826c4 [id=3e00d0fc074747809ebc1f6b3696649d])
W20260810 13:54:28.718319 12951 consensus_peers.cc:597] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65c3b03d5f1543b28ea6c439c3cfb07e. This is attempt 6: this message will repeat every 5th retry.
I20260810 13:54:28.693894 16651 raft_consensus.cc:515] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.727311 16116 tablet_loader.cc:96] loaded metadata for tablet 39514e069d6841df9fced9e62981eac5 (table default.Table_f6d23e8eec824ef08b26dec8c7c6d010 [id=4d373c8f174b46e99209a83ab947b204])
I20260810 13:54:28.731021 16116 tablet_loader.cc:96] loaded metadata for tablet 3b7b408a9ad34ea39c912b33e26b49b6 (table default.Table_029a3ba2ee734a729e84a4482938ed5b [id=b437e76811d440ca817fca27a8dcbd45])
W20260810 13:54:28.734310 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 68149.2us
I20260810 13:54:28.738097 16793 raft_consensus.cc:493] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.738826 16793 raft_consensus.cc:515] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.749300 13167 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:28.750702 16908 raft_consensus.cc:3060] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:28.758466 16116 tablet_loader.cc:96] loaded metadata for tablet 419f1f8bae1c458f83d6be2978cb6ecc (table default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d])
I20260810 13:54:28.759837 16116 tablet_loader.cc:96] loaded metadata for tablet 41b258122c6e4de982cd95ec04ffc3ae (table default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 [id=f6ba2bd3294c4b49a617aee9388a1248])
W20260810 13:54:28.773525 13382 leader_election.cc:343] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:28.776433 16793 leader_election.cc:290] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:28.777341 16116 tablet_loader.cc:96] loaded metadata for tablet 420ee600a4174916827aa7b64bbcd8d2 (table default.Table_86dcc5d091024407b7e167806ec593a3 [id=c07ecd00b44e49c9b0a32e8710373471])
I20260810 13:54:28.780267 13639 tablet_bootstrap.cc:492] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:28.780715 13639 ts_tablet_manager.cc:1403] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.157s user 0.011s sys 0.012s
I20260810 13:54:28.785140 13639 raft_consensus.cc:359] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.785758 13639 raft_consensus.cc:385] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:28.786012 13639 raft_consensus.cc:740] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:28.786603 13639 consensus_queue.cc:260] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.788143 16651 leader_election.cc:290] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:28.790901 16873 raft_consensus.cc:515] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.791885 16116 tablet_loader.cc:96] loaded metadata for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd])
I20260810 13:54:28.793401 16873 leader_election.cc:290] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:28.794085 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 44993.9us
I20260810 13:54:28.795635 13167 leader_election.cc:304] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:28.796411 16909 raft_consensus.cc:2749] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:28.801173 13167 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:28.802013 16909 raft_consensus.cc:3060] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:28.802584 16116 tablet_loader.cc:96] loaded metadata for tablet 45530faa785a4642b4efc18733d0d9b1 (table default.Table_8eeb870902124e9696cfa7e98dfa0e88 [id=614fbd4b5dd440cb8f5a6fa4d994266d])
I20260810 13:54:28.804913 16116 tablet_loader.cc:96] loaded metadata for tablet 4687f8fd44034ce28727c3b7e58e7fe9 (table default.Table_bd734d41b4c04e8fae8551c8d2f341dc [id=5b4eac88920044a7ba18bf40b8783a9d])
W20260810 13:54:28.809749 13382 leader_election.cc:343] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:28.818646 13167 leader_election.cc:304] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:28.824481 13640 tablet_bootstrap.cc:654] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.825937 16865 raft_consensus.cc:3060] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:28.829210 13639 ts_tablet_manager.cc:1434] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.048s user 0.005s sys 0.000s
W20260810 13:54:28.830430 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 65324us
I20260810 13:54:28.831104 12951 leader_election.cc:304] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:28.832032 16913 raft_consensus.cc:2804] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:28.832468 16913 raft_consensus.cc:493] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:28.832796 16913 raft_consensus.cc:3060] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:28.834751 16728 raft_consensus.cc:493] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:28.835335 16728 raft_consensus.cc:515] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:28.838083 16728 leader_election.cc:290] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:28.848944 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:28.842401 13167 leader_election.cc:304] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:28.850701 16886 raft_consensus.cc:2749] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:28.853575 13639 tablet_bootstrap.cc:492] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:28.857196 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:28.869871 16909 raft_consensus.cc:2749] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:28.876762 16873 consensus_queue.cc:1048] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:28.882297 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:28.882894 13049 raft_consensus.cc:2468] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:28.883556 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:28.884637 13042 raft_consensus.cc:2393] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
W20260810 13:54:28.887962 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:28.901448 16116 tablet_loader.cc:96] loaded metadata for tablet 4744dd484c3d4e0cb903840759ec532f (table default.Table_08e421ad9e1d4274b11c4cb314c36201 [id=f7546e5fae5641d0b1747c71934496ec])
I20260810 13:54:28.908722 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:28.914721 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:28.915398 13475 raft_consensus.cc:2468] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:54:28.918423 13382 leader_election.cc:343] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:28.918467 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:28.898552 16865 raft_consensus.cc:2749] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:28.876520 16908 raft_consensus.cc:2749] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:28.842470 16913 raft_consensus.cc:515] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:28.926586 13382 leader_election.cc:343] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:28.939466 13638 tablet_bootstrap.cc:654] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:28.940594 13640 tablet_bootstrap.cc:492] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:28.940580 16116 tablet_loader.cc:96] loaded metadata for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2])
I20260810 13:54:28.941063 13640 ts_tablet_manager.cc:1403] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.245s user 0.016s sys 0.001s
I20260810 13:54:28.944041 16116 tablet_loader.cc:96] loaded metadata for tablet 48ff07074f4a4392adc6c3aa0360454f (table default.Table_da87a4b83c12422e999c5b88c825d890 [id=3064108a10bd4f76b2be6614ebed22fc])
W20260810 13:54:28.952710 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:28.966964 13164 leader_election.cc:304] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:28.969928 16116 tablet_loader.cc:96] loaded metadata for tablet 49bf6a1f14bb4513b1addc4141b71373 (table default.Table_d4a38708152b4705af7eaf9af6ddc436 [id=5edfc8942f7145adae70b892942fbd64])
I20260810 13:54:28.975839 16886 raft_consensus.cc:2804] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:28.977219 16886 raft_consensus.cc:493] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:28.978022 16913 leader_election.cc:290] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:28.978755 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:28.980193 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:28.983489 13256 raft_consensus.cc:2393] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:28.983343 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:28.980826 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:28.983635 16886 raft_consensus.cc:3060] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:28.989238 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:28.989797 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:28.990383 13041 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:29.021428 16877 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.022330 16877 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.001708 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:29.021777 16885 consensus_queue.cc:1048] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260810 13:54:29.001262 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:29.028848 13476 raft_consensus.cc:3060] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:29.029246 13382 leader_election.cc:304] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:29.030045 16892 raft_consensus.cc:2804] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:29.030504 16892 raft_consensus.cc:493] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:29.031296 16892 raft_consensus.cc:3060] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:29.001556 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:29.036713 16865 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.037547 16865 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.041278 16865 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:29.040328 16913 raft_consensus.cc:493] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.042413 16913 raft_consensus.cc:515] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.033434 13475 raft_consensus.cc:2468] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:29.013852 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:29.048596 13467 raft_consensus.cc:3060] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:29.066833 13382 leader_election.cc:343] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.067471 13382 leader_election.cc:304] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:29.069641 13382 leader_election.cc:343] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.070785 13639 tablet_bootstrap.cc:654] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:29.071391 13382 leader_election.cc:304] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:29.082624 16877 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:29.091104 16929 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.092517 16929 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:29.095113 16913 leader_election.cc:290] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:29.096303 13638 tablet_bootstrap.cc:492] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:29.096817 13638 ts_tablet_manager.cc:1403] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.418s user 0.016s sys 0.001s
I20260810 13:54:29.101380 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:29.102039 13259 raft_consensus.cc:3060] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:29.110718 13259 raft_consensus.cc:2468] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:29.118968 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:29.131922 16116 tablet_loader.cc:96] loaded metadata for tablet 4bd68cdc1322448292c481925ad33c79 (table default.Table_278ad8ed658b48d28fcc3aa3eec747b0 [id=d585e61cb61a4312ba2dbadbcae39899])
I20260810 13:54:28.944531 13640 raft_consensus.cc:359] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.134403 13640 raft_consensus.cc:385] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:29.134693 13640 raft_consensus.cc:740] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:29.141170 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:29.142220 13041 raft_consensus.cc:2393] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:29.143356 16911 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.144116 16911 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.151842 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:29.156385 16929 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:29.158776 15213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:29.166770 16930 raft_consensus.cc:2749] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:29.177363 12952 leader_election.cc:343] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.178144 13638 raft_consensus.cc:359] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.178828 13638 raft_consensus.cc:385] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:29.188395 12952 leader_election.cc:304] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:29.193214 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:29.179077 13638 raft_consensus.cc:740] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:29.194614 16651 raft_consensus.cc:2804] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:29.195204 16651 raft_consensus.cc:697] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:29.196391 13638 consensus_queue.cc:260] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.206195 13638 ts_tablet_manager.cc:1434] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.109s user 0.008s sys 0.000s
I20260810 13:54:29.212020 16886 raft_consensus.cc:515] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.213735 13260 raft_consensus.cc:2393] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:29.213063 16651 consensus_queue.cc:237] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:29.219321 12952 leader_election.cc:343] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.219920 13638 tablet_bootstrap.cc:492] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:29.220335 12952 leader_election.cc:343] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.227756 16886 leader_election.cc:290] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:29.111708 16885 raft_consensus.cc:2749] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:29.230228 13640 consensus_queue.cc:260] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.234767 13639 tablet_bootstrap.cc:492] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:29.235198 13639 ts_tablet_manager.cc:1403] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.382s user 0.013s sys 0.004s
I20260810 13:54:29.240123 13639 raft_consensus.cc:359] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.250718 13639 raft_consensus.cc:385] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:29.251001 13639 raft_consensus.cc:740] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:29.162426 16116 tablet_loader.cc:96] loaded metadata for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279])
I20260810 13:54:29.252456 13639 consensus_queue.cc:260] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.263283 13639 ts_tablet_manager.cc:1434] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.028s user 0.008s sys 0.000s
I20260810 13:54:29.264295 13639 tablet_bootstrap.cc:492] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:29.266220 16116 tablet_loader.cc:96] loaded metadata for tablet 50d8651946d242feb9cf993aff99ba1b (table default.Table_2901b91576984ac4a165471a90e86a8b [id=a67f03853a964c2fbf175165ee422881])
I20260810 13:54:29.267040 13638 tablet_bootstrap.cc:654] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:29.267694 16116 tablet_loader.cc:96] loaded metadata for tablet 515727ae51d94c009b4446c8b6e2c8f6 (table default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68])
I20260810 13:54:29.271346 16911 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:29.282609 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:29.296878 13476 raft_consensus.cc:2468] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:29.309494 13640 ts_tablet_manager.cc:1434] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.368s user 0.008s sys 0.000s
I20260810 13:54:29.309764 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:29.310915 13042 raft_consensus.cc:2393] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:29.312206 13467 raft_consensus.cc:2468] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:29.315085 13639 tablet_bootstrap.cc:654] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:29.319447 16116 tablet_loader.cc:96] loaded metadata for tablet 51813605283e43f2b4efe6fb2fab652c (table default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d])
W20260810 13:54:29.324147 12952 leader_election.cc:343] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:29.330071 15135 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317): Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 3.051s (SENT)
W20260810 13:54:29.334816 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 3.051s (SENT)
I20260810 13:54:29.335613 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:29.340955 16116 tablet_loader.cc:96] loaded metadata for tablet 52900269b7f74b338d6f81480686a940 (table default.Table_ecb9a9595610488796d066d45e53880a [id=c478e4b06e604e5d8277d76680a5e8f8])
W20260810 13:54:29.348495 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 235610us
I20260810 13:54:29.255206 16892 raft_consensus.cc:515] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:29.364014 13382 leader_election.cc:343] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.364454 13382 leader_election.cc:304] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:29.364462 16930 consensus_queue.cc:1048] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:29.365585 16932 raft_consensus.cc:2749] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:29.379235 16963 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260810 13:54:29.380267 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 46065.2us
I20260810 13:54:29.400728 16116 tablet_loader.cc:96] loaded metadata for tablet 5577bf52bd794919986e2bfa3f708efb (table default.Table_a0e9339c31fa470380def2ad49326176 [id=3e51b3dca7144d7b8494e0a36e61706a])
I20260810 13:54:29.402771 16116 tablet_loader.cc:96] loaded metadata for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224])
W20260810 13:54:29.409121 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:29.429488 16892 leader_election.cc:290] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:29.441533 13638 tablet_bootstrap.cc:492] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:29.442055 13638 ts_tablet_manager.cc:1403] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.222s user 0.018s sys 0.022s
I20260810 13:54:29.446673 16949 consensus_queue.cc:1048] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:29.457412 16116 tablet_loader.cc:96] loaded metadata for tablet 5797a5de96ad4c3c80741e6673a8f194 (table default.Table_210fb0797673402e8e79fcf4e3c293b6 [id=aa1bdb6bb7c04faabb47c1552cc4aaff])
I20260810 13:54:29.472571 16116 tablet_loader.cc:96] loaded metadata for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d])
I20260810 13:54:29.474848 13638 raft_consensus.cc:359] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.475524 13638 raft_consensus.cc:385] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:29.475787 13638 raft_consensus.cc:740] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:54:29.477463 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:29.477854 13640 tablet_bootstrap.cc:492] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:29.478307 16885 consensus_queue.cc:1048] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:29.487504 13640 tablet_bootstrap.cc:654] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:29.495229 13638 consensus_queue.cc:260] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.497120 13638 ts_tablet_manager.cc:1434] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.055s user 0.003s sys 0.004s
I20260810 13:54:29.490579 16116 tablet_loader.cc:96] loaded metadata for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f])
I20260810 13:54:29.504212 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:29.507984 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:29.513949 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:29.515498 13468 raft_consensus.cc:2393] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:29.533236 16116 tablet_loader.cc:96] loaded metadata for tablet 5e99055cb9814d4d9b22e7a99a9ca61e (table default.Table_4b2d4fca101f4cbc9f296c50ca183066 [id=35087d7e2d0642a59670773333dda055])
I20260810 13:54:29.534391 16892 raft_consensus.cc:493] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.535032 16892 raft_consensus.cc:515] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.537941 16892 leader_election.cc:290] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:29.540285 13639 tablet_bootstrap.cc:492] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:29.541143 13639 ts_tablet_manager.cc:1403] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.277s user 0.019s sys 0.039s
I20260810 13:54:29.546427 13639 raft_consensus.cc:359] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.549002 13639 raft_consensus.cc:385] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:29.556016 13639 raft_consensus.cc:740] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:29.557164 13639 consensus_queue.cc:260] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.561373 13639 ts_tablet_manager.cc:1434] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20260810 13:54:29.586973 16116 tablet_loader.cc:96] loaded metadata for tablet 5f1df2c9593442afa84849da6874f0f4 (table default.Table_57828eb9ca764faf923e3e68fd0233a8 [id=3fff8bc92af84e59a10a592e85ad8503])
I20260810 13:54:29.596294 16116 tablet_loader.cc:96] loaded metadata for tablet 5f518df5c1414edba15ad72983c7f362 (table default.Table_fe0baa9629ad42fbb05cfbc004e62688 [id=907a4591204d4db697b44488fef76406])
W20260810 13:54:29.610157 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 63356.9us
I20260810 13:54:29.611068 16116 tablet_loader.cc:96] loaded metadata for tablet 5f5cf3efa54b4344b04a87a87509d1f6 (table default.Table_e9bf94db05cb46279abaeba00681ab82 [id=a547ccb6c9c24877b0b8d81d52e1630a])
I20260810 13:54:29.612658 16116 tablet_loader.cc:96] loaded metadata for tablet 5f7cac512bcd48cfb6aaba4dc7e5681e (table default.Table_d460b63b63de413ebdeeb708b4be6b10 [id=3d7325460d7842658631298c2538a71c])
I20260810 13:54:29.615561 16116 tablet_loader.cc:96] loaded metadata for tablet 6187783a473a42488fabf362f9a156cf (table default.Table_fd80397e5f4247339b3e3d483a671afa [id=3f7a51368fe34ca6b66f5c810e94ae60])
I20260810 13:54:29.618007 16116 tablet_loader.cc:96] loaded metadata for tablet 62aabe97aca9485fb2b40d67c989c210 (table default.Table_ee42df273bce4386bbf8edb282c2059a [id=8d115ba01bfd4ed7b90f6531e9ef66c2])
I20260810 13:54:29.625602 13638 tablet_bootstrap.cc:492] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:29.625942 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:29.633396 16116 tablet_loader.cc:96] loaded metadata for tablet 62e88a52755140019a6d9f7041db0837 (table default.Table_9f48e93a010b4fc5b43124a1f8248ddf [id=011f63bf5ea44f918070a9ead229fa95])
I20260810 13:54:29.636161 16116 tablet_loader.cc:96] loaded metadata for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5])
I20260810 13:54:29.640481 13638 tablet_bootstrap.cc:654] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:29.652880 16116 tablet_loader.cc:96] loaded metadata for tablet 67ec9aba240b49e6a78c268b20dc901b (table default.Table_32a20912aef145aabc1b19b2b796c682 [id=6180bc58d52049fa82f92dc5e5a6b891])
I20260810 13:54:29.654551 16116 tablet_loader.cc:96] loaded metadata for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f])
I20260810 13:54:29.656366 16913 raft_consensus.cc:493] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.657279 16913 raft_consensus.cc:515] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.657897 16116 tablet_loader.cc:96] loaded metadata for tablet 6ad53d1da7b34194b4b7a78c52870c6b (table default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 [id=766aaf50fb2f4fbca53416a8e853f9c1])
I20260810 13:54:29.660504 16116 tablet_loader.cc:96] loaded metadata for tablet 6d19fba564324475a790174b4033ab1b (table default.Table_eebc498aa5734ab8b23c00b74d896ba9 [id=9756f3d17c15460e84863e49504d8349])
I20260810 13:54:29.661612 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:29.662402 16116 tablet_loader.cc:96] loaded metadata for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64])
W20260810 13:54:29.663412 12952 leader_election.cc:343] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.663944 16116 tablet_loader.cc:96] loaded metadata for tablet 6ec1f506c6cd4222b4bd6176ccd54e56 (table default.Table_e16662a9b5514b04b2d2fad48ad3d82f [id=51cc3d6cb6d248fc94d93654adfc72c0])
I20260810 13:54:29.664036 16913 leader_election.cc:290] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:29.665290 16116 tablet_loader.cc:96] loaded metadata for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a])
I20260810 13:54:29.666848 16116 tablet_loader.cc:96] loaded metadata for tablet 73749dd3ba784553b316d2f70ae34073 (table default.Table_0cd1166b3e534639918d41544e409ec7 [id=631d4e81ac6b445183e988a0821e0e61])
I20260810 13:54:29.666908 13164 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:29.667912 16908 raft_consensus.cc:2749] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:29.668275 16116 tablet_loader.cc:96] loaded metadata for tablet 73a7e7c310e24d8caca5756fe67631ce (table default.Table_3c8a09c1dfda4797918bd6715bdfebce [id=9656e3a9a8f6431cb7b42ea64ae16159])
I20260810 13:54:29.670655 16116 tablet_loader.cc:96] loaded metadata for tablet 73bc868e3bba4d8c80ac234e4be6b3a4 (table default.Table_7e2df1474a324a139e9e31ca581a4f34 [id=5b1484c8fdc64ee6a07bd203fa140fcb])
I20260810 13:54:29.672021 16116 tablet_loader.cc:96] loaded metadata for tablet 73c03f98d7804d22acbba72da63c121b (table default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c])
I20260810 13:54:29.673887 16116 tablet_loader.cc:96] loaded metadata for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311])
I20260810 13:54:29.675047 16116 tablet_loader.cc:96] loaded metadata for tablet 7529b349395a42ec96c7816f9e566079 (table default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 [id=7a54639f4e1a4f1a82278d5d64b347b8])
I20260810 13:54:29.676951 16116 tablet_loader.cc:96] loaded metadata for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa])
I20260810 13:54:29.678421 16116 tablet_loader.cc:96] loaded metadata for tablet 760914a47cc744b7bdf3b40a85b3369c (table default.Table_7cbcdca887724284a33c681c9574ea82 [id=8a8a45a7ac264648b3810d9c69a36751])
I20260810 13:54:29.679530 16116 tablet_loader.cc:96] loaded metadata for tablet 7685f9b4b25541d98cfdaba36cd0276c (table default.Table_f0a8373b96114e0c896e54dcb940f74d [id=0c70c375ac604d158df38f374fc3c1d1])
I20260810 13:54:29.680853 16116 tablet_loader.cc:96] loaded metadata for tablet 7800f588f3d64230b759c8814d169dbe (table default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 [id=3fa9cd2a62034a4d81a0b740d5c31447])
I20260810 13:54:29.682353 16116 tablet_loader.cc:96] loaded metadata for tablet 788ac374894c437fa8644493b7678747 (table default.Table_c752da6252ce4541be9cef2bce47bfe3 [id=178f273145a74eb2a2de7da53f248126])
I20260810 13:54:29.683637 16116 tablet_loader.cc:96] loaded metadata for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343])
I20260810 13:54:29.684964 16116 tablet_loader.cc:96] loaded metadata for tablet 7967a22850ae48a58fbcb8cb17f189e9 (table default.Table_d5c509cabbb84883a9a911c2f4e04c88 [id=865c0ec036ca45caaec23fe2cf899d1d])
I20260810 13:54:29.688603 16116 tablet_loader.cc:96] loaded metadata for tablet 7a07cf0ebb0f4bc6816c119a4b2af17f (table default.Table_51b05316075a49bc898ede0e35031c70 [id=359af78e1c844299a56756c90613d641])
I20260810 13:54:29.691602 16116 tablet_loader.cc:96] loaded metadata for tablet 7a5114911fdf4b19afec0c71ded5ef9a (table default.Table_8a8233c099eb45dba66c3d0f9bdbe18b [id=d9a327f6557d42bb998964e1d594cb1c])
I20260810 13:54:29.693681 16116 tablet_loader.cc:96] loaded metadata for tablet 7a7bddc8e6374437a37aeb755389d91f (table default.Table_3ffb4babc30c4b76ae97168cb6dbdeee [id=66920d867573408d811d1fa6b877d355])
I20260810 13:54:29.695163 16116 tablet_loader.cc:96] loaded metadata for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480])
I20260810 13:54:29.696516 16116 tablet_loader.cc:96] loaded metadata for tablet 7ca9ab174bc8461a9fccdc7a7d11b486 (table default.Table_230d8010fef046048e532692ee7681c8 [id=01dba6a69dec44aeb2f402dddb3e0cae])
I20260810 13:54:29.699821 16116 tablet_loader.cc:96] loaded metadata for tablet 815f4333c441441ca8e857df66a0263e (table default.Table_8606de06b2994b3291a5ee1e28ad7100 [id=7162bee4392749a38057f272df172987])
I20260810 13:54:29.701032 16116 tablet_loader.cc:96] loaded metadata for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_96cdf642a68642ce9fe947569577b42a [id=667ccf7ba20c49b2be82e167aa212ecd])
I20260810 13:54:29.702553 13639 tablet_bootstrap.cc:492] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:29.707698 15216 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51926 (request call id 12) took 6156 ms. Trace:
I20260810 13:54:29.711206 13639 tablet_bootstrap.cc:654] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:29.714476 16116 tablet_loader.cc:96] loaded metadata for tablet 82848ef8dc904879854929de47db1e50 (table default.Table_229c64c5f5804f6c8a3047ec7858322b [id=f8aaac66943a4d9d8d2bf15d12a18009])
I20260810 13:54:29.715886 16116 tablet_loader.cc:96] loaded metadata for tablet 82fde417598648968b4013c54f0bc854 (table default.Table_8054f93e82de4c898987acb86f25e5d0 [id=0685b3b0945a493db836d29e5993e447])
I20260810 13:54:29.717106 16116 tablet_loader.cc:96] loaded metadata for tablet 82fe5ef58d9a49389a201ea7c51faad5 (table default.Table_77e30d5f98584b9e9711faa0b7a824df [id=6afc4e9a485640dda167bbaa0d6b347e])
I20260810 13:54:29.719338 16116 tablet_loader.cc:96] loaded metadata for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b])
I20260810 13:54:29.720960 16116 tablet_loader.cc:96] loaded metadata for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751])
I20260810 13:54:29.723906 13164 leader_election.cc:304] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:29.724737 16968 raft_consensus.cc:2749] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:29.725478 16116 tablet_loader.cc:96] loaded metadata for tablet 8473def35a97492a9172b483c2d670d9 (table default.Table_312808fed3bf45e8923e2b1be7f4d9fa [id=4de804595a6142819c0ea2f64fd1e34c])
I20260810 13:54:29.730543 13639 tablet_bootstrap.cc:492] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:29.731065 13639 ts_tablet_manager.cc:1403] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.029s user 0.012s sys 0.001s
I20260810 13:54:29.736253 13639 raft_consensus.cc:359] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.736897 13639 raft_consensus.cc:385] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:29.737140 13639 raft_consensus.cc:740] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:29.737773 13639 consensus_queue.cc:260] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.741851 16116 tablet_loader.cc:96] loaded metadata for tablet 8d860c257b794cce8f215ca7e871d6b0 (table default.Table_004ad2bd15214f94a0c183ec75f725ca [id=240ee1976c8f40c59438f7f22839e297])
I20260810 13:54:29.743252 16116 tablet_loader.cc:96] loaded metadata for tablet 8e11d3197c5146e19dcbc2ca5015d224 (table default.Table_dd910306a7864aeb9230c62730dc3ff4 [id=ee077cecabdd48809356d55acc5604a6])
I20260810 13:54:29.746632 13639 ts_tablet_manager.cc:1434] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.015s user 0.005s sys 0.001s
I20260810 13:54:29.747496 13639 tablet_bootstrap.cc:492] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:29.749946 13640 tablet_bootstrap.cc:492] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:29.750411 13640 ts_tablet_manager.cc:1403] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.273s user 0.004s sys 0.012s
I20260810 13:54:29.751294 16116 tablet_loader.cc:96] loaded metadata for tablet 8e82c1366b534a11b7d615c3602406af (table default.Table_9ec2734c1c43472ca16731c99911a350 [id=b5072df8be3e4cc58980380d089942e2])
I20260810 13:54:29.758419 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:29.771441 16969 log.cc:927] Time spent T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.053s user 0.003s sys 0.000s
I20260810 13:54:29.792403 16116 tablet_loader.cc:96] loaded metadata for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_383bd937c51942a1b124430d2b5086af [id=82f67714ca3b4e6aab8557bd0f53d264])
I20260810 13:54:29.794703 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:29.795354 13468 raft_consensus.cc:2468] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:29.796217 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:29.796738 13476 raft_consensus.cc:2468] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:29.797253 13639 tablet_bootstrap.cc:654] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:29.797181 16761 consensus_queue.cc:1048] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:29.798209 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:29.798686 13474 raft_consensus.cc:2468] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:29.793345 13640 raft_consensus.cc:359] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.801044 13640 raft_consensus.cc:385] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:29.812886 16799 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.068s user 0.003s sys 0.000s
I20260810 13:54:29.796535 13382 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:29.820930 16885 raft_consensus.cc:2804] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:29.821357 16885 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:29.821696 16885 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:29.804896 13640 raft_consensus.cc:740] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:29.824343 16955 raft_consensus.cc:493] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.824816 16955 raft_consensus.cc:515] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.828393 16955 leader_election.cc:290] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:29.829715 16885 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.831780 16885 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:29.833004 16116 tablet_loader.cc:96] loaded metadata for tablet 9334ba72cfd94fa4a7062a29445c69f9 (table default.Table_276835c42e5a48309351dd4e441cc62f [id=4d5771db00ae42b9957c6453d83f81ae])
I20260810 13:54:29.835780 16116 tablet_loader.cc:96] loaded metadata for tablet 9467e5c106b14619a7bf1f3e1f4f9c72 (table default.Table_6d071c01702c4d3cb0e693f02ef8a90f [id=20edfa4b7c00446bae121b000f8faf5f])
I20260810 13:54:29.837459 16116 tablet_loader.cc:96] loaded metadata for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582])
I20260810 13:54:29.840131 16116 tablet_loader.cc:96] loaded metadata for tablet 95ad70febdef4f59b252bc5f1bf6d25e (table default.Table_ea7f41d802964936a967be553d7418fe [id=96574627e23442ebb0323b065423efae])
I20260810 13:54:29.841290 16116 tablet_loader.cc:96] loaded metadata for tablet 96f66a5c6837404b96e1937a73aa1f19 (table default.Table_dfe0fd41b106448e8a729e593ac63e5a [id=342af46254364715a3eb6166299c7275])
I20260810 13:54:29.842391 16116 tablet_loader.cc:96] loaded metadata for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe])
I20260810 13:54:29.824817 13640 consensus_queue.cc:260] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.846951 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:29.847620 13256 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:29.851138 16955 consensus_queue.cc:1048] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:29.851481 13382 leader_election.cc:343] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:29.854089 13382 leader_election.cc:343] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.854707 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:29.858222 13382 leader_election.cc:343] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.853055 13639 tablet_bootstrap.cc:492] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:29.862461 13639 ts_tablet_manager.cc:1403] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.115s user 0.009s sys 0.002s
I20260810 13:54:29.864760 13638 tablet_bootstrap.cc:492] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:29.865185 13638 ts_tablet_manager.cc:1403] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.240s user 0.002s sys 0.016s
I20260810 13:54:29.883749 13640 ts_tablet_manager.cc:1434] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.133s user 0.008s sys 0.000s
I20260810 13:54:29.898828 13639 raft_consensus.cc:359] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.910862 13256 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:29.917521 13639 raft_consensus.cc:385] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:29.917996 13639 raft_consensus.cc:740] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:29.919034 13639 consensus_queue.cc:260] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.843605 16116 tablet_loader.cc:96] loaded metadata for tablet 97127b08237c4d2e81f9966db12d3fdb (table default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1])
I20260810 13:54:29.921973 16116 tablet_loader.cc:96] loaded metadata for tablet 9752c50dac794b3f9e6430e982d9cbe2 (table default.Table_f835565354f042368700f4252335e8eb [id=84ca48404db8439697f8035aa3bc34d3])
I20260810 13:54:29.924444 13639 ts_tablet_manager.cc:1434] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.059s user 0.005s sys 0.000s
I20260810 13:54:29.936772 16116 tablet_loader.cc:96] loaded metadata for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e])
I20260810 13:54:29.935175 16913 raft_consensus.cc:493] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.938174 16913 raft_consensus.cc:515] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.940259 16913 leader_election.cc:290] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:29.942310 13639 tablet_bootstrap.cc:492] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:29.944422 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:29.945389 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:29.945765 16116 tablet_loader.cc:96] loaded metadata for tablet 98ce3cccca464b938fd45afe292b4ad8 (table default.Table_4f7895e8b4164093b5fa194d7f828d2a [id=f492b2e2f4cf4205a7d147ddad56af40])
I20260810 13:54:29.948882 13639 tablet_bootstrap.cc:654] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:29.951385 16116 tablet_loader.cc:96] loaded metadata for tablet 9b1cfcc6b1834ebbb0d5cd4a7967e2cd (table default.Table_51d643dcb2a5451e9cff367f2b3649c5 [id=46372d6eedfe4d56b2f2ce9a85f7f1fc])
I20260810 13:54:29.957015 16116 tablet_loader.cc:96] loaded metadata for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1])
I20260810 13:54:29.931277 16968 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:29.968324 16116 tablet_loader.cc:96] loaded metadata for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3])
W20260810 13:54:29.970197 12721 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:29.970201 16116 tablet_loader.cc:96] loaded metadata for tablet 9f3485a1b77a4b80acbf48de92b5cf33 (table default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 [id=d8943f60b8e3464087c954a42ff795ba])
I20260810 13:54:29.941171 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:29.971418 16116 tablet_loader.cc:96] loaded metadata for tablet 9f3e50e523354dd7898ff1768ae824bb (table default.Table_54ea5af3ae44427eb0031a29dd62e663 [id=834d810fa56c49de9d97b91dabab82f1])
I20260810 13:54:29.972589 16116 tablet_loader.cc:96] loaded metadata for tablet a008d393fcdf441eb17dbe0c1fa2393f (table default.Table_78c6761fe1e748bf8bea32e7a13650f3 [id=d855b11b57bd447a9285b0945f28219d])
W20260810 13:54:29.972594 12952 leader_election.cc:343] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:29.973663 16116 tablet_loader.cc:96] loaded metadata for tablet a04498da4fce45bb9a906e75594a023f (table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f])
I20260810 13:54:29.974968 16116 tablet_loader.cc:96] loaded metadata for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_cc339254bace4b5e87544b721a6493a5 [id=685e6bce7ba5467693e2b0e1c739897b])
I20260810 13:54:29.976220 16116 tablet_loader.cc:96] loaded metadata for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee])
I20260810 13:54:29.982766 16116 tablet_loader.cc:96] loaded metadata for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055])
I20260810 13:54:29.986306 16116 tablet_loader.cc:96] loaded metadata for tablet a2a2e00edb244e54b04a511dd0e76c9f (table default.Table_5022f9898a2b4343b457ad28e07a933f [id=a31aa9b4d20f46b4bd283aca2d2b446c])
I20260810 13:54:29.987507 16116 tablet_loader.cc:96] loaded metadata for tablet a4159387c6364989bc5f8bfef7f8458c (table default.Table_e9c73c2f54b54ea485cdcadc15b0a420 [id=41772225716845f794c8c7d1ab21fd32])
I20260810 13:54:29.989090 16116 tablet_loader.cc:96] loaded metadata for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970])
I20260810 13:54:29.995312 16116 tablet_loader.cc:96] loaded metadata for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7])
I20260810 13:54:29.995187 16968 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:29.997403 16968 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:29.998837 16116 tablet_loader.cc:96] loaded metadata for tablet a46ee6471e914b63afddc7d6dc967b9a (table default.Table_921fde42e0214ef58181c03785687004 [id=828ce62882b949d6887e75923229655e])
I20260810 13:54:29.999243 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:29.999879 13467 raft_consensus.cc:2468] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:30.001003 13164 leader_election.cc:304] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:30.002816 16116 tablet_loader.cc:96] loaded metadata for tablet a4b1451bb8254fcb8c507a837d6b2fa4 (table default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4])
I20260810 13:54:30.003962 16116 tablet_loader.cc:96] loaded metadata for tablet a4cca967e70b4164ba13c139d9610c73 (table default.Table_5388dd61e30949a5a2b9c07a35637080 [id=9fe82107b8344dfdae308a0d7091488d])
I20260810 13:54:30.004242 16968 raft_consensus.cc:2804] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:30.004601 16968 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:30.004943 16968 raft_consensus.cc:3060] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.005117 16913 raft_consensus.cc:493] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:30.005568 16913 raft_consensus.cc:515] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.005952 16116 tablet_loader.cc:96] loaded metadata for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_ed026dd607ea4b2e8b1f22bee438879d [id=5b919872756647048ea2e4fecbe78537])
I20260810 13:54:30.007138 16116 tablet_loader.cc:96] loaded metadata for tablet a75054766c894d78bfa6d7f565700dce (table default.Table_83164f9e96c540f58a5af47229b70854 [id=3f7f1db8228e4efa9b34bc33cb13be40])
I20260810 13:54:30.007597 16913 leader_election.cc:290] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:30.009516 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:30.010046 16116 tablet_loader.cc:96] loaded metadata for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414])
W20260810 13:54:30.011180 12952 leader_election.cc:343] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:30.011274 16116 tablet_loader.cc:96] loaded metadata for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879])
I20260810 13:54:30.013422 16116 tablet_loader.cc:96] loaded metadata for tablet ab9d43e8868c420ea0801d395ff9c102 (table default.Table_e317f4e20e124c60bbed5450c6c3ca07 [id=01638b930a5e4b46925cdbfd23f204ea])
I20260810 13:54:30.013880 13382 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:30.014642 16892 raft_consensus.cc:2804] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:30.015175 16892 raft_consensus.cc:697] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:30.015949 16892 consensus_queue.cc:237] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.021128 16968 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.022578 16116 tablet_loader.cc:96] loaded metadata for tablet ac27a168faad4542967097f909ce3997 (table default.Table_b392780f45ab4b899ddb12eefbcdd556 [id=0a7b7ff4685e4a8884b4aab7a835890d])
I20260810 13:54:30.037240 16116 tablet_loader.cc:96] loaded metadata for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb])
I20260810 13:54:30.039880 16116 tablet_loader.cc:96] loaded metadata for tablet ae74d69055ee4aa395c0f628864242e3 (table default.Table_6964fe82ae0c4d96a86d800f82062b3e [id=83fc760e794d422d8614bf728e3e47df])
I20260810 13:54:30.042038 16116 tablet_loader.cc:96] loaded metadata for tablet af106f431764457bbeb43691f5b0a46a (table default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 [id=19cf8ac217b34ed1b6ceccb40508fd56])
I20260810 13:54:30.043503 16116 tablet_loader.cc:96] loaded metadata for tablet afe75b90aa5548d8a6c35cf6db42bb25 (table default.Table_3abcbf71e2004a07888fe131143e8e76 [id=ab67527f31ce42d7a92bb0cba8f69ff6])
I20260810 13:54:30.046339 16116 tablet_loader.cc:96] loaded metadata for tablet b09ec8ef75e94a83a155d901235e7ce0 (table default.Table_699797a1320b40709d0bf25947241900 [id=f656a6598c1145d89230d014ba6873a6])
I20260810 13:54:30.049126 16116 tablet_loader.cc:96] loaded metadata for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f])
I20260810 13:54:30.040069 13638 raft_consensus.cc:359] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.050375 13638 raft_consensus.cc:385] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:30.050678 13638 raft_consensus.cc:740] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:30.051048 16116 tablet_loader.cc:96] loaded metadata for tablet b0f98604d43049ac9b2befe5041a2bda (table default.Table_acc827f97bb244f59d2eed071cc9bd55 [id=7b4d23c35bc14f8598821f2838a18148])
I20260810 13:54:30.052542 16116 tablet_loader.cc:96] loaded metadata for tablet b2d9bca9a4e74f3aa7ea0a11c7906a09 (table default.Table_890e94f5e2914f4e9e3994ab8bc4075c [id=d08463e955564de898a2af8457a26457])
I20260810 13:54:30.053870 16116 tablet_loader.cc:96] loaded metadata for tablet b2f2b53b984441e4baee332183e4c5c3 (table default.Table_87c087a440044f9483716cce60bb4777 [id=4777400951884e84a747cbc635b6a087])
I20260810 13:54:30.055210 16116 tablet_loader.cc:96] loaded metadata for tablet b335455cc01947a3a4ca6c368fea7bad (table default.Table_a232694e27574131946f967d95a292f4 [id=fec6784b9d334a72907abaf252914033])
I20260810 13:54:30.056595 16116 tablet_loader.cc:96] loaded metadata for tablet b3bbe54b2ba947a4a8b2d908f44c0db5 (table default.Table_4f02931df6b0437a9cb7869b14b73084 [id=b8289db1d29241f3815ff2da32fcfc1a])
I20260810 13:54:30.058137 16116 tablet_loader.cc:96] loaded metadata for tablet b3cbbc9bee4843dea818b514d42d42df (table default.Table_2416e07beb8d42a6a48de9dab42936cf [id=39551fb5d1804467bb58d5b00de27be4])
I20260810 13:54:30.059689 16116 tablet_loader.cc:96] loaded metadata for tablet b427309e4db942bd920539274bffe7cd (table default.Table_819cbf37633d4c75ba529b0d037cb8db [id=8d2ee7c5b732405c804aec9f79e98038])
I20260810 13:54:30.061159 16116 tablet_loader.cc:96] loaded metadata for tablet b449377349514576874b6c295ead5e9a (table default.Table_2695264893564646a621e76ff6443e84 [id=147b038d3de54c8d85e666747153cb7d])
I20260810 13:54:30.063239 16116 tablet_loader.cc:96] loaded metadata for tablet b4be757a47e3434081eef61dfd746be1 (table default.Table_dfe60ded8ca240529710962e7f530298 [id=b4ce0aca49834e698812644caf8b8a94])
I20260810 13:54:30.064788 16116 tablet_loader.cc:96] loaded metadata for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7])
I20260810 13:54:30.066308 16116 tablet_loader.cc:96] loaded metadata for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b])
I20260810 13:54:30.067776 16116 tablet_loader.cc:96] loaded metadata for tablet b7a45cb763a84c7aa557fde815a92c07 (table default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f [id=cb722d559fe647018b6c959f6a93a037])
W20260810 13:54:30.071862 16799 log.cc:927] Time spent T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d: Append to log took a long time: real 0.056s user 0.002s sys 0.001s
I20260810 13:54:30.072099 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:30.072443 16116 tablet_loader.cc:96] loaded metadata for tablet b8fcd43569dd49b38d3227b312b896c4 (table default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb [id=dea63931a83f494b8fa574685cd4ff24])
I20260810 13:54:30.072937 13035 raft_consensus.cc:2468] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:30.075690 16116 tablet_loader.cc:96] loaded metadata for tablet baa17cc9fd524b0981cb2368a7265df1 (table default.Table_a80ad2cc0680447898f832a3da957607 [id=b7e44fb60b9b401db5517c2fd7e8c70b])
I20260810 13:54:30.076915 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:30.077703 13033 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.077956 16116 tablet_loader.cc:96] loaded metadata for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e])
I20260810 13:54:30.079150 16116 tablet_loader.cc:96] loaded metadata for tablet bcac39f031b44408bdbe043720dcae57 (table default.Table_86221744224e4ac4aeebf77dbd274d49 [id=fe2f8409777b4c94b59159a106e77e7f])
I20260810 13:54:30.080564 16116 tablet_loader.cc:96] loaded metadata for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734])
I20260810 13:54:30.081983 16116 tablet_loader.cc:96] loaded metadata for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01])
I20260810 13:54:30.083432 16116 tablet_loader.cc:96] loaded metadata for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162])
I20260810 13:54:30.087356 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:30.093025 16116 tablet_loader.cc:96] loaded metadata for tablet bf9beaff9d5245f8b0e8606ed0d888c6 (table default.Table_b5e6f89f8d854f7e991193036d4d8321 [id=5d59e07d6bc5465eaaf40d68610bc154])
I20260810 13:54:30.094343 16116 tablet_loader.cc:96] loaded metadata for tablet bfc9c907fe50470ca860728883fb6d9e (table default.Table_c4942145f1414e939000a9b7443c0d29 [id=b88902dec1e34475b3ae470c1c17f777])
I20260810 13:54:30.095651 16116 tablet_loader.cc:96] loaded metadata for tablet c0e45366954740528fb37c7cfdc639c6 (table default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 [id=8129beecaba3450c9041bb715af80988])
I20260810 13:54:30.101504 16116 tablet_loader.cc:96] loaded metadata for tablet c1510cd3523646eba9333f7e6d85a5e8 (table default.Table_c39a51586fe847b990c6d2c59e2280ff [id=44428a121dc24f5ba5e5d74158f9f4d0])
I20260810 13:54:30.102829 16116 tablet_loader.cc:96] loaded metadata for tablet c4a656fba31f49d99303e6a71cc4a9a6 (table default.Table_e4f9174b7de74fd79642def9d4d0fffd [id=f8ba71724c3f4068a8377462165aee32])
I20260810 13:54:30.116044 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:30.116688 13049 raft_consensus.cc:3060] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.126893 16116 tablet_loader.cc:96] loaded metadata for tablet ca26c63f9dc142318b648f456f111ebb (table default.Table_5d55900f1adf4aca973dbf4e94ca29c3 [id=63c1004ec7f44526929d7b9f809c0e04])
I20260810 13:54:30.129978 16116 tablet_loader.cc:96] loaded metadata for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18])
I20260810 13:54:30.131458 16116 tablet_loader.cc:96] loaded metadata for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3])
I20260810 13:54:30.145077 16116 tablet_loader.cc:96] loaded metadata for tablet cd3d4b038acb48ebaebef7a424f721c5 (table default.Table_57980e60ac6549c8b24861967f6cc198 [id=18ade4a3af044a498725f45a06e04b81])
I20260810 13:54:30.150856 16116 tablet_loader.cc:96] loaded metadata for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6])
I20260810 13:54:30.154806 16116 tablet_loader.cc:96] loaded metadata for tablet ceba68b27a63430fad93a30c452fb1a3 (table default.Table_772227d6702d4cf7bf6729e922d3eea5 [id=6ffcaf4f90f14e24b6d02b21e2936bd3])
I20260810 13:54:30.161330 13640 tablet_bootstrap.cc:492] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:30.161877 16116 tablet_loader.cc:96] loaded metadata for tablet d18c4ddd51b6463ea28dfb2456128a18 (table default.Table_72fd7834d8574cb1a74c1d08699d1f7e [id=8cdd566d9af748b6a8d998ecf7221fb6])
I20260810 13:54:30.162992 16116 tablet_loader.cc:96] loaded metadata for tablet d1b2835286e14a8e827f7a61801ffb17 (table default.Table_a3085b5448ff4df8a25c4802ca130085 [id=b3648e88a1fc44808dcf824092d5de35])
I20260810 13:54:30.164064 16116 tablet_loader.cc:96] loaded metadata for tablet d1ec72a86a08452fb8b390b62f8c6dec (table default.Table_63e74b1d9a4e48c3b9343a12f0b926e6 [id=a17784f2e3a940e59b5603273436c417])
I20260810 13:54:30.164745 13049 raft_consensus.cc:2468] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:30.176020 16116 tablet_loader.cc:96] loaded metadata for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49])
I20260810 13:54:30.178555 16116 tablet_loader.cc:96] loaded metadata for tablet d36f17094e504d80a2443dc12855c744 (table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67])
I20260810 13:54:30.182749 16116 tablet_loader.cc:96] loaded metadata for tablet d5cb099133c04a07956581f23378ddf4 (table default.Table_4b93246ea61e418db4efb3c2732711af [id=847e7c0039964b3f94192d5032791e4a])
I20260810 13:54:30.189368 16116 tablet_loader.cc:96] loaded metadata for tablet d6487d26c6524c38a313b54d5431b6f6 (table default.Table_e8940f9b8b5647b29566e6383b5c8fd7 [id=866777afb37d48b7bc025eba1377a8d0])
I20260810 13:54:30.192039 16116 tablet_loader.cc:96] loaded metadata for tablet d669bb7f769c44df994efae1d39eb7a8 (table default.Table_a34a40f45be7413bb670738c4199fa50 [id=fd9cae2939d9440b92dc923383e5839c])
I20260810 13:54:30.194795 16116 tablet_loader.cc:96] loaded metadata for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694])
I20260810 13:54:30.199038 16116 tablet_loader.cc:96] loaded metadata for tablet d982e709c71a4440b0cf07f11e429d72 (table default.Table_ec24cdc578624353b8936b6a7add0b7b [id=bf5a9955305343258f05d827cd3e8aec])
I20260810 13:54:30.201551 16116 tablet_loader.cc:96] loaded metadata for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_e0bb4403efd84db5ac45ace77b9b1a90 [id=c9ebbfcd82964aa798abcf82aaf3e881])
I20260810 13:54:30.203094 16116 tablet_loader.cc:96] loaded metadata for tablet da66e50033cf48d4897128b3aa77127f (table default.Table_94153e136b9f4ea9aeb589c1a0322981 [id=12299e0dca554badab42ee7a73ea9723])
I20260810 13:54:30.204623 16116 tablet_loader.cc:96] loaded metadata for tablet da7c4d83667c4c188e5f2774c40e5e53 (table default.Table_40ebe892a09b471581cb322124cf7630 [id=a79fc8e8c8ec420fb2c6e6cc0fdbc17e])
I20260810 13:54:30.207336 13033 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:30.208194 16116 tablet_loader.cc:96] loaded metadata for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec])
I20260810 13:54:30.051416 13638 consensus_queue.cc:260] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.212821 16116 tablet_loader.cc:96] loaded metadata for tablet df3031d8f75d4548b458cee6dd2083d2 (table default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0])
I20260810 13:54:30.214422 16996 raft_consensus.cc:493] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:30.215204 16996 raft_consensus.cc:515] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.218096 16116 tablet_loader.cc:96] loaded metadata for tablet dfbb2036c800469f90ad4d5d211ac462 (table default.Table_2a27c95d054b44dd84ede3639a6395c5 [id=232f082ff5eb446bbb2e7869e83b2449])
I20260810 13:54:30.220082 16116 tablet_loader.cc:96] loaded metadata for tablet e1e8e52e3605464fb40b78ab3d104ce8 (table default.Table_d3680fc81fed4821bc9a2eccc77c35d8 [id=c9181e9bcc3546a5ac7aed13b663deaa])
I20260810 13:54:30.222201 16116 tablet_loader.cc:96] loaded metadata for tablet e24ce014b17f418fbea698adb0d7ff60 (table default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c])
I20260810 13:54:30.228785 16116 tablet_loader.cc:96] loaded metadata for tablet e30f03b6b326429eab7227616059a0db (table default.Table_d171e1a65676495882912f18dddff2ee [id=4f6c1859cd1a481da7b9b3c2013365c3])
I20260810 13:54:30.230294 16116 tablet_loader.cc:96] loaded metadata for tablet e37ff84ae1f84d8ea0e57066273536be (table default.Table_e8a597f1c0ec4cd8878f49046eb45e66 [id=047df8b2dabc4682a2227e841b10a53c])
I20260810 13:54:30.231925 16116 tablet_loader.cc:96] loaded metadata for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391])
I20260810 13:54:30.235472 16116 tablet_loader.cc:96] loaded metadata for tablet e637fca32f12429d8cba24d15680051e (table default.Table_98fbef24cbef43679502dae9e67e35cf [id=1e5fe6bb81ec41d3be1b189a0631e695])
I20260810 13:54:30.234486 16996 leader_election.cc:290] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:30.238322 16116 tablet_loader.cc:96] loaded metadata for tablet e7553445e6124227872c0f2306940225 (table default.Table_2c6e1c408acb44358898a1a4ff356bdd [id=909cf43e9f9e4d439f8f246cef081d56])
I20260810 13:54:30.239396 16911 consensus_queue.cc:1048] T 61169145c539464fa9cf62eaaf8168e5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:30.241071 16116 tablet_loader.cc:96] loaded metadata for tablet e7b637166ce24e4fa1fd32aaa1ada207 (table default.Table_03b06d24159c4b079c0008aa041c517b [id=af367ad99e9a4fa9907c170b0a5dee49])
I20260810 13:54:30.241739 16968 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:30.243208 16116 tablet_loader.cc:96] loaded metadata for tablet e837879f1c2549c795b240589dfa9bf7 (table default.Table_209ee5a105144c7e871214eaafcd0cbe [id=9a05ad06179141dfabe2d12858c1746c])
I20260810 13:54:30.244513 16116 tablet_loader.cc:96] loaded metadata for tablet e839b2604ad640419fc845b54706cd4d (table default.Table_70a5ed6b181b4db1ae5c28b4b6ca4553 [id=c93d3c57643543cda0f021e1171b3365])
I20260810 13:54:30.246630 16999 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:30.247848 16116 tablet_loader.cc:96] loaded metadata for tablet ea80282f10e647ebb4b7c87112f579c9 (table default.Table_7c53cfb1808c47e59a8e23b0e6325acd [id=5558467decbe4ca29c989c08073be0de])
I20260810 13:54:30.247594 16999 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:30.250982 16116 tablet_loader.cc:96] loaded metadata for tablet eb7fe3793da743e293800961b029fc56 (table default.Table_e424bd25638b4b23b721c8529aa42285 [id=126e0229d9904feba5c16222cecf5140])
I20260810 13:54:30.252202 16116 tablet_loader.cc:96] loaded metadata for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80])
I20260810 13:54:30.253504 16116 tablet_loader.cc:96] loaded metadata for tablet ec0c424fdefb4d38a9946203c6521012 (table default.Table_18833ebfc83a4c33a1a94a902b97ffaf [id=bb2789ba0fd043c2a44479f23111dcbb])
I20260810 13:54:30.258685 16116 tablet_loader.cc:96] loaded metadata for tablet ec901677e46946578fe0929794df881f (table default.Table_586e39daebb14dfaa08b3cc251eeb18a [id=46490c79e3814a82b21ab79f2a53814e])
I20260810 13:54:30.260879 16116 tablet_loader.cc:96] loaded metadata for tablet ee650f1e57294de89643e84bf7914298 (table default.Table_09a6fde1eefc4ce0a591129d6ab65e3a [id=8b4fe3206c2344728b61ed31b33580a6])
I20260810 13:54:30.263763 16116 tablet_loader.cc:96] loaded metadata for tablet efc446acced34a6c87e459c5542c1c77 (table default.Table_3fb4e7e2f617464f930b338a8ece6e38 [id=0acde9f8e2f7483c9eb7f3df14b0859d])
I20260810 13:54:30.264616 13640 tablet_bootstrap.cc:654] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:30.268307 16116 tablet_loader.cc:96] loaded metadata for tablet f1c3e25d16f847a9b7f4194b5a0bbe90 (table default.Table_4f9508194c21480d9b603b139bdaf902 [id=98e554f12bf944c98887ed2293df2e26])
I20260810 13:54:30.270176 16116 tablet_loader.cc:96] loaded metadata for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a])
I20260810 13:54:30.270481 13639 tablet_bootstrap.cc:492] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:30.270885 13639 ts_tablet_manager.cc:1403] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.329s user 0.015s sys 0.030s
I20260810 13:54:30.271802 16116 tablet_loader.cc:96] loaded metadata for tablet f2b97ddd62b547ba997bf3044d37029d (table default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21])
I20260810 13:54:30.273087 16116 tablet_loader.cc:96] loaded metadata for tablet f37d338cf7244b68b6c6e4868113d248 (table default.Table_ee9ef5f74a944eaabe6af879e8ab15a2 [id=7a8f1c3ab411436fa3940b3261d0e05f])
I20260810 13:54:30.274243 16116 tablet_loader.cc:96] loaded metadata for tablet f37f4b2d04f84e119da2743234865baf (table default.Table_071663fc830e44ef9d25a38fc8301ba7 [id=dd579b0cb2684ce08640cf4f5edae65c])
I20260810 13:54:30.275674 16116 tablet_loader.cc:96] loaded metadata for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1])
I20260810 13:54:30.277922 16116 tablet_loader.cc:96] loaded metadata for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea])
I20260810 13:54:30.280055 16116 tablet_loader.cc:96] loaded metadata for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470])
I20260810 13:54:30.282150 16116 tablet_loader.cc:96] loaded metadata for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810])
I20260810 13:54:30.285168 16116 tablet_loader.cc:96] loaded metadata for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8])
I20260810 13:54:30.287281 16116 tablet_loader.cc:96] loaded metadata for tablet f7cf6e6b67994c139d920fd1a3e014e6 (table default.Table_f7160fbf49d74f79b79a300e67af5cbf [id=440aa3e8a24a415eb98a448b4848e76d])
I20260810 13:54:30.289723 16116 tablet_loader.cc:96] loaded metadata for tablet fa5fb50327a3454090bc41a2892df8c0 (table default.Table_bc50dbac8249499e90b8d763fd7041f2 [id=92622bf6828843419776bf2bbe0c6aee])
W20260810 13:54:30.291584 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 51381.8us
I20260810 13:54:30.292271 16116 tablet_loader.cc:96] loaded metadata for tablet fd1a9d7bb08b45b780137e7acf8111bb (table default.Table_9d26366e03454a73ae877683e6700ff0 [id=3587a6d27d294470ac7551a3bb96a701])
I20260810 13:54:30.292276 12951 leader_election.cc:304] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:30.293169 16911 raft_consensus.cc:2749] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:30.294404 12951 leader_election.cc:304] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:30.295351 16116 tablet_loader.cc:96] loaded metadata for tablet fe4755e4fcfd4af087ce5831a4e02022 (table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9])
I20260810 13:54:30.295585 16911 raft_consensus.cc:2804] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:30.295976 13638 ts_tablet_manager.cc:1434] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.431s user 0.009s sys 0.001s
I20260810 13:54:30.296049 16911 raft_consensus.cc:493] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:30.296447 16911 raft_consensus.cc:3060] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.297322 16116 tablet_loader.cc:96] loaded metadata for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98])
I20260810 13:54:30.298444 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:30.299877 13467 raft_consensus.cc:2393] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:30.299736 16116 tablet_loader.cc:96] loaded metadata for tablet ff1229ebe9304f19ab84d5a172aba937 (table default.Table_5ac9d00cb7b3422e9810b51a4f20e029 [id=6f7b1b6d99b64d008a7c3c527f172e24])
I20260810 13:54:30.306560 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:30.307226 13470 raft_consensus.cc:3060] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.306540 13639 raft_consensus.cc:359] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.316776 13639 raft_consensus.cc:385] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:30.316852 13470 raft_consensus.cc:2468] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:30.317145 13639 raft_consensus.cc:740] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:30.317814 13639 consensus_queue.cc:260] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.319295 13639 ts_tablet_manager.cc:1434] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.048s user 0.006s sys 0.000s
I20260810 13:54:30.326983 13639 tablet_bootstrap.cc:492] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:30.334631 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:30.343931 16116 catalog_manager.cc:1512] Time spent T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Loading table and tablet metadata into memory: real 15.053s user 0.940s sys 0.193s
I20260810 13:54:30.344519 16116 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260810 13:54:30.344416 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 819 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb"
I20260810 13:54:30.345425 12506 raft_consensus.cc:1240] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 6 LEADER]: Rejecting Update request from peer 1298bde14cec4cd3a9d6338c7d47f0b7 for earlier term 3. Current term is 6. Ops: []
W20260810 13:54:30.347211 12511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 949) took 14445 ms (client timeout 531 ms). Trace:
W20260810 13:54:30.348141 12511 rpcz_store.cc:269] 0810 13:54:15.901557 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.902121 (+ 564us) service_pool.cc:224] Handling call
0810 13:54:30.347057 (+14444936us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:30.346946 12506 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36088 (request call id 951) took 13913 ms. Trace:
I20260810 13:54:30.348088 12497 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 820 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:30.350015 12506 rpcz_store.cc:276] 0810 13:54:16.433703 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:16.434270 (+ 567us) service_pool.cc:224] Handling call
0810 13:54:30.344402 (+13910132us) raft_consensus.cc:1471] Updating replica for 0 ops
0810 13:54:30.346226 (+ 1824us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:30.346697 (+ 471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:30.350976 12500 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 820 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
W20260810 13:54:30.352442 12497 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 955) took 9174 ms (client timeout 558 ms). Trace:
W20260810 13:54:30.352363 12500 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 953) took 9746 ms (client timeout 558 ms). Trace:
W20260810 13:54:30.352947 12497 rpcz_store.cc:269] 0810 13:54:21.178549 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:21.179357 (+ 808us) service_pool.cc:224] Handling call
0810 13:54:30.352333 (+9172976us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:30.353332 12500 rpcz_store.cc:269] 0810 13:54:20.605559 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:20.605838 (+ 279us) service_pool.cc:224] Handling call
0810 13:54:30.352231 (+9746393us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:30.354723 12497 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 958) took 6624 ms (client timeout 725 ms). Trace:
I20260810 13:54:30.355528 12504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 4 candidate_status { last_received { term: 1 index: 556 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:30.360759 13639 tablet_bootstrap.cc:654] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:30.362028 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 67692.2us
I20260810 13:54:30.364823 12951 leader_election.cc:304] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:30.365604 17001 raft_consensus.cc:2804] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:30.366030 17001 raft_consensus.cc:697] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:30.366781 17001 consensus_queue.cc:237] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.378988 13638 tablet_bootstrap.cc:492] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:30.382273 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 59949.5us
I20260810 13:54:30.383381 13164 leader_election.cc:304] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:30.384948 16968 raft_consensus.cc:2804] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:30.385447 13639 tablet_bootstrap.cc:492] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:30.385427 16968 raft_consensus.cc:697] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:30.385929 13639 ts_tablet_manager.cc:1403] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.059s user 0.012s sys 0.007s
I20260810 13:54:30.386615 16968 consensus_queue.cc:237] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.388464 13639 raft_consensus.cc:359] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.392946 13639 raft_consensus.cc:385] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:30.393261 13639 raft_consensus.cc:740] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:30.394193 13639 consensus_queue.cc:260] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.388638 16911 raft_consensus.cc:515] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.399607 13639 ts_tablet_manager.cc:1434] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260810 13:54:30.344782 12512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 818 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
W20260810 13:54:30.401273 12506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51916 (request call id 7) took 7221 ms (client timeout 3051 ms). Trace:
W20260810 13:54:30.401661 12512 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 950) took 14174 ms (client timeout 675 ms). Trace:
W20260810 13:54:30.402002 12506 rpcz_store.cc:269] 0810 13:54:23.180453 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:30.400862 (+7220409us) service_pool.cc:211] Skipping call since client already timed out
0810 13:54:30.401108 (+ 246us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260810 13:54:30.355453 12497 rpcz_store.cc:269] 0810 13:54:23.730426 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:30.354473 (+6624047us) service_pool.cc:211] Skipping call since client already timed out
0810 13:54:30.354645 (+ 172us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260810 13:54:30.403887 12497 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 961) took 3412 ms (client timeout 1116 ms). Trace:
W20260810 13:54:30.403985 12506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 960) took 4569 ms (client timeout 1116 ms). Trace:
W20260810 13:54:30.404407 12497 rpcz_store.cc:269] 0810 13:54:26.991505 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:30.403688 (+3412183us) service_pool.cc:211] Skipping call since client already timed out
0810 13:54:30.403823 (+ 135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260810 13:54:30.404541 12506 rpcz_store.cc:269] 0810 13:54:25.834914 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:30.403732 (+4568818us) service_pool.cc:211] Skipping call since client already timed out
0810 13:54:30.403906 (+ 174us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260810 13:54:30.406127 12497 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51916 (request call id 8) took 4125 ms (client timeout 3051 ms). Trace:
I20260810 13:54:30.406977 12510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 3 candidate_status { last_received { term: 2 index: 819 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb"
I20260810 13:54:30.400637 16911 leader_election.cc:290] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:30.410281 13639 tablet_bootstrap.cc:492] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:30.406597 12497 rpcz_store.cc:269] 0810 13:54:26.281196 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:30.405870 (+4124674us) service_pool.cc:211] Skipping call since client already timed out
0810 13:54:30.406028 (+ 158us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260810 13:54:30.415735 12497 raft_consensus.cc:1240] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [term 6 LEADER]: Rejecting Update request from peer 1298bde14cec4cd3a9d6338c7d47f0b7 for earlier term 5. Current term is 6. Ops: []
W20260810 13:54:30.354723 12500 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 959) took 5792 ms (client timeout 725 ms). Trace:
I20260810 13:54:30.414218 12951 leader_election.cc:304] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:30.416718 12497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36088 (request call id 956) took 9105 ms. Trace:
W20260810 13:54:30.417122 12500 rpcz_store.cc:269] 0810 13:54:24.562597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:30.354463 (+5791866us) service_pool.cc:211] Skipping call since client already timed out
0810 13:54:30.354607 (+ 144us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260810 13:54:30.417366 12497 rpcz_store.cc:276] 0810 13:54:21.311507 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:30.414939 (+9103432us) service_pool.cc:224] Handling call
0810 13:54:30.415465 (+ 526us) raft_consensus.cc:1471] Updating replica for 0 ops
0810 13:54:30.416312 (+ 847us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:30.416585 (+ 273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:30.420074 17001 raft_consensus.cc:2804] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:30.420641 17001 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:30.421401 17001 raft_consensus.cc:3060] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:30.427096 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 43780.1us
I20260810 13:54:30.344462 12513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 3 candidate_status { last_received { term: 1 index: 818 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:30.433125 12951 leader_election.cc:304] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:54:30.434914 12951 consensus_peers.cc:597] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a1b35d369474ba9bee379089796bd3c. This is attempt 6: this message will repeat every 5th retry.
I20260810 13:54:30.436662 12951 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:30.435391 16911 raft_consensus.cc:2804] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:30.442137 16911 raft_consensus.cc:493] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:30.442895 16911 raft_consensus.cc:3060] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.432091 12506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
W20260810 13:54:30.445214 12506 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 962) took 1289 ms (client timeout 1381 ms). Trace:
W20260810 13:54:30.445777 12506 rpcz_store.cc:269] 0810 13:54:29.155378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:30.424754 (+1269376us) service_pool.cc:224] Handling call
0810 13:54:30.445139 (+ 20385us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:30.408432 12510 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 952) took 13973 ms (client timeout 531 ms). Trace:
W20260810 13:54:30.448643 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f consensus state has no leader
W20260810 13:54:30.447129 12510 rpcz_store.cc:269] 0810 13:54:16.434813 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:16.434999 (+ 186us) service_pool.cc:224] Handling call
0810 13:54:30.408309 (+13973310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:30.438725 12494 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:53556 (request call id 1) took 14972 ms. Trace:
I20260810 13:54:30.449579 12729 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:30.449941 12494 rpcz_store.cc:276] 0810 13:54:15.446753 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.465361 (+ 18608us) service_pool.cc:224] Handling call
0810 13:54:30.418196 (+14952835us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5400030554. stack: 00007f13ff6aacf3 00007f13ff6aabf0 00007f13ff258574 0000000000516de4 0000000000516d79 00007f14067ab951 00007f140684b3d9 00007f1408671cd6 00007f14086b5087 00007f1406262534 00007f14062624c2 00007f14062623f1 00007f140626236c 00007f1406261622 00007f140450d07c 00007f140450c4b6
0810 13:54:30.418616 (+ 420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26504064}
I20260810 13:54:30.457726 13640 tablet_bootstrap.cc:492] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:30.458431 13640 ts_tablet_manager.cc:1403] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.297s user 0.018s sys 0.000s
I20260810 13:54:30.455546 16761 raft_consensus.cc:493] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:30.464885 16913 raft_consensus.cc:2804] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:30.465258 16913 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:30.465574 16913 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.461772 16761 raft_consensus.cc:515] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.468026 16761 leader_election.cc:290] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:30.437529 12501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 4 candidate_status { last_received { term: 1 index: 556 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:30.476007 16913 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:30.402066 12512 rpcz_store.cc:269] 0810 13:54:16.226762 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:16.226888 (+ 126us) service_pool.cc:224] Handling call
0810 13:54:30.401547 (+14174659us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:30.482772 12501 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51916 (request call id 6) took 10884 ms (client timeout 1446 ms). Trace:
W20260810 13:54:30.350325 12511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 957) took 8816 ms (client timeout 698 ms). Trace:
W20260810 13:54:30.483152 12501 rpcz_store.cc:269] 0810 13:54:19.598178 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:19.598391 (+ 213us) service_pool.cc:224] Handling call
0810 13:54:30.482655 (+10884264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:30.484987 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 5 candidate_status { last_received { term: 3 index: 820 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb"
W20260810 13:54:30.487031 12498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 954) took 9654 ms (client timeout 698 ms). Trace:
W20260810 13:54:30.491885 12504 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51916 (request call id 5) took 12428 ms (client timeout 1446 ms). Trace:
W20260810 13:54:30.492237 12504 rpcz_store.cc:269] 0810 13:54:18.064005 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:18.064268 (+ 263us) service_pool.cc:224] Handling call
0810 13:54:30.491802 (+12427534us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:30.492723 12513 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 948) took 14988 ms (client timeout 675 ms). Trace:
W20260810 13:54:30.493359 12513 rpcz_store.cc:269] 0810 13:54:15.504072 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:15.504201 (+ 129us) service_pool.cc:224] Handling call
0810 13:54:30.489096 (+14984895us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:30.487680 12498 rpcz_store.cc:269] 0810 13:54:20.832929 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:20.835825 (+ 2896us) service_pool.cc:224] Handling call
0810 13:54:30.486885 (+9651060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:30.372504 16999 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:30.497206 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
W20260810 13:54:30.484032 12511 rpcz_store.cc:269] 0810 13:54:21.533790 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:30.349866 (+8816076us) service_pool.cc:211] Skipping call since client already timed out
0810 13:54:30.350216 (+ 350us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260810 13:54:30.504585 16913 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:30.534416 16913 raft_consensus.cc:493] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:30.534408 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:30.542173 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:30.547577 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:30.560902 16913 raft_consensus.cc:515] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.563472 16913 leader_election.cc:290] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:30.566665 13639 tablet_bootstrap.cc:654] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:30.556394 16116 catalog_manager.cc:1295] Loaded cluster ID: 13e3d414686543de8210a2d9c5898299
I20260810 13:54:30.567076 16116 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260810 13:54:30.464862 13640 raft_consensus.cc:359] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.582274 17001 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:30.583842 12952 leader_election.cc:343] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:30.585397 13638 tablet_bootstrap.cc:654] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:30.576217 13382 leader_election.cc:343] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:30.592659 13640 raft_consensus.cc:385] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:30.594388 12952 leader_election.cc:343] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:30.597709 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:30.464241 16911 raft_consensus.cc:515] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.605697 13640 raft_consensus.cc:740] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:30.606906 13640 consensus_queue.cc:260] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.608553 16911 leader_election.cc:290] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:30.607337 17007 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:30.615618 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:30.629213 13050 raft_consensus.cc:2393] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:30.661394 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:30.662268 13043 raft_consensus.cc:2393] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:30.632287 17001 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:30.636400 13639 tablet_bootstrap.cc:492] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:30.664486 13639 ts_tablet_manager.cc:1403] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.255s user 0.014s sys 0.001s
I20260810 13:54:30.671454 13638 tablet_bootstrap.cc:492] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:30.673121 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:30.677871 13638 ts_tablet_manager.cc:1403] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.299s user 0.009s sys 0.004s
I20260810 13:54:30.678226 13640 ts_tablet_manager.cc:1434] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.219s user 0.004s sys 0.003s
I20260810 13:54:30.688007 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:30.694334 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:30.701323 13640 tablet_bootstrap.cc:492] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:30.688292 13638 raft_consensus.cc:359] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.705394 13638 raft_consensus.cc:385] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:30.708103 13638 raft_consensus.cc:740] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:30.708993 13638 consensus_queue.cc:260] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:30.720868 12952 leader_election.cc:343] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:30.721936 12952 leader_election.cc:343] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:30.731667 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:30.732200 13470 raft_consensus.cc:2468] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:30.733332 17008 raft_consensus.cc:493] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:30.733908 17008 raft_consensus.cc:515] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.737419 17008 leader_election.cc:290] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:30.746248 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:30.747123 13638 ts_tablet_manager.cc:1434] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.062s user 0.002s sys 0.005s
I20260810 13:54:30.764341 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:30.767433 13049 raft_consensus.cc:2393] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:30.770736 16995 raft_consensus.cc:493] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:30.771260 16995 raft_consensus.cc:515] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.774744 16995 leader_election.cc:290] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:30.775215 13639 raft_consensus.cc:359] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.775913 13639 raft_consensus.cc:385] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:30.776160 13639 raft_consensus.cc:740] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:30.780654 13639 consensus_queue.cc:260] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.791440 13638 tablet_bootstrap.cc:492] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:30.797606 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:30.799389 13467 raft_consensus.cc:2468] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:54:30.799707 13382 leader_election.cc:343] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:30.807550 13638 tablet_bootstrap.cc:654] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:30.808422 13639 ts_tablet_manager.cc:1434] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.144s user 0.003s sys 0.003s
I20260810 13:54:30.820981 13639 tablet_bootstrap.cc:492] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:30.828406 13164 leader_election.cc:304] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:30.830021 16968 raft_consensus.cc:2804] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:30.830386 16968 raft_consensus.cc:493] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:30.832613 13639 tablet_bootstrap.cc:654] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:30.832887 16968 raft_consensus.cc:3060] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.809371 13640 tablet_bootstrap.cc:654] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:30.870378 13638 tablet_bootstrap.cc:492] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:30.870918 13638 ts_tablet_manager.cc:1403] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.080s user 0.005s sys 0.007s
I20260810 13:54:30.875306 13638 raft_consensus.cc:359] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.876029 13638 raft_consensus.cc:385] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:30.876320 13638 raft_consensus.cc:740] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:30.877295 13638 consensus_queue.cc:260] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:30.878679 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 50452us
W20260810 13:54:30.888266 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 438749us
I20260810 13:54:30.891124 13639 tablet_bootstrap.cc:492] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:30.891577 13639 ts_tablet_manager.cc:1403] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.071s user 0.011s sys 0.000s
I20260810 13:54:30.895130 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:30.895763 13033 raft_consensus.cc:2468] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:30.896879 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:30.870378 16968 raft_consensus.cc:515] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.905673 13639 raft_consensus.cc:359] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.906526 13639 raft_consensus.cc:385] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:30.906842 13639 raft_consensus.cc:740] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:30.907493 13639 consensus_queue.cc:260] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.915545 13638 ts_tablet_manager.cc:1434] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20260810 13:54:30.916997 13638 tablet_bootstrap.cc:492] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:30.926941 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 51524.4us
I20260810 13:54:30.927618 13382 leader_election.cc:304] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:30.928310 16885 raft_consensus.cc:2804] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:30.928643 16885 raft_consensus.cc:493] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:30.928994 16885 raft_consensus.cc:3060] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.942381 13640 tablet_bootstrap.cc:492] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:30.942859 13640 ts_tablet_manager.cc:1403] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.242s user 0.008s sys 0.005s
I20260810 13:54:30.950408 16885 raft_consensus.cc:515] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:30.952627 13167 leader_election.cc:304] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:30.954490 16997 raft_consensus.cc:3060] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.967362 16997 raft_consensus.cc:2749] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:31.001288 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 73743.9us
W20260810 13:54:31.003043 13382 leader_election.cc:343] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:31.003486 13382 leader_election.cc:304] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:31.004191 16892 raft_consensus.cc:2749] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:31.000186 16116 catalog_manager.cc:1540] Loading token signing keys...
I20260810 13:54:31.008184 13638 tablet_bootstrap.cc:654] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:31.005219 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 107417us
I20260810 13:54:30.954938 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:31.033147 13054 raft_consensus.cc:2393] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:30.955749 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:30.998310 12951 leader_election.cc:304] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:31.034078 17001 raft_consensus.cc:2804] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:31.034196 13033 raft_consensus.cc:2393] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:31.034480 17001 raft_consensus.cc:493] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:31.034574 13639 ts_tablet_manager.cc:1434] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.143s user 0.006s sys 0.001s
I20260810 13:54:31.034859 17001 raft_consensus.cc:3060] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:30.946126 13640 raft_consensus.cc:359] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.038988 13640 raft_consensus.cc:385] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:31.039364 13640 raft_consensus.cc:740] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:31.040115 13640 consensus_queue.cc:260] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.047331 16968 leader_election.cc:290] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:31.057780 16885 leader_election.cc:290] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:31.072641 16892 raft_consensus.cc:493] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:31.075799 16892 raft_consensus.cc:515] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.077745 16892 leader_election.cc:290] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:31.084793 17009 consensus_queue.cc:1048] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:54:31.073112 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 66137.8us
I20260810 13:54:31.088928 16761 consensus_queue.cc:1048] T 729ffbfd767f4aa0b95f6545011aae3d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:31.092069 13382 leader_election.cc:304] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:31.092777 16761 raft_consensus.cc:2804] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:31.093258 16761 raft_consensus.cc:697] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:31.094046 16761 consensus_queue.cc:237] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.074404 13640 ts_tablet_manager.cc:1434] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.131s user 0.008s sys 0.000s
I20260810 13:54:31.110664 13640 tablet_bootstrap.cc:492] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:31.118069 17009 raft_consensus.cc:493] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.118485 17009 raft_consensus.cc:515] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.123231 17001 raft_consensus.cc:515] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.120358 17009 leader_election.cc:290] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:31.148110 13639 tablet_bootstrap.cc:492] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:31.158495 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:31.163523 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 71519.8us
I20260810 13:54:31.166788 17011 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.167804 17011 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.168915 17001 leader_election.cc:290] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:31.170295 17011 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:31.200629 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:31.201748 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:31.223024 13638 tablet_bootstrap.cc:492] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:31.223613 13638 ts_tablet_manager.cc:1403] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.307s user 0.013s sys 0.009s
I20260810 13:54:31.225564 13382 leader_election.cc:304] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:54:31.226611 13382 leader_election.cc:343] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:31.226527 13638 raft_consensus.cc:359] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.226962 13382 leader_election.cc:304] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:31.227345 13638 raft_consensus.cc:385] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:31.227610 16761 raft_consensus.cc:2804] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:31.227665 13638 raft_consensus.cc:740] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:31.227955 16761 raft_consensus.cc:493] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:31.228277 16761 raft_consensus.cc:3060] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:31.229243 13638 consensus_queue.cc:260] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.232800 16885 raft_consensus.cc:2749] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:31.247325 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:31.249095 13638 ts_tablet_manager.cc:1434] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.025s user 0.006s sys 0.000s
I20260810 13:54:31.250044 13638 tablet_bootstrap.cc:492] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:31.259944 13640 tablet_bootstrap.cc:654] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:31.295051 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 68461.1us
I20260810 13:54:31.297816 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:31.298400 13470 raft_consensus.cc:3060] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:31.306214 13470 raft_consensus.cc:2468] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:31.309155 13638 tablet_bootstrap.cc:654] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:31.331280 13164 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 44204.5us
I20260810 13:54:31.333078 13638 tablet_bootstrap.cc:492] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:31.336531 13638 ts_tablet_manager.cc:1403] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.087s user 0.007s sys 0.004s
I20260810 13:54:31.339164 13638 raft_consensus.cc:359] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.359997 16761 raft_consensus.cc:515] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.360831 13638 raft_consensus.cc:385] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:31.361203 13638 raft_consensus.cc:740] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:31.361974 13638 consensus_queue.cc:260] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.371623 13638 ts_tablet_manager.cc:1434] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20260810 13:54:31.385597 13638 tablet_bootstrap.cc:492] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:31.406872 12952 leader_election.cc:343] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:31.411744 13638 tablet_bootstrap.cc:654] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:31.408598 12952 leader_election.cc:343] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:31.419417 12952 leader_election.cc:343] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:31.461037 13638 tablet_bootstrap.cc:492] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:31.464020 13638 ts_tablet_manager.cc:1403] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.079s user 0.011s sys 0.000s
I20260810 13:54:31.466980 13638 raft_consensus.cc:359] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.420140 13640 tablet_bootstrap.cc:492] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:31.474677 13638 raft_consensus.cc:385] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:31.424587 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:31.426673 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:31.476976 13467 raft_consensus.cc:2468] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:31.477190 13464 raft_consensus.cc:2393] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:31.475380 13638 raft_consensus.cc:740] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:31.479779 16761 leader_election.cc:290] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:31.483093 13639 tablet_bootstrap.cc:654] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:31.474097 13640 ts_tablet_manager.cc:1403] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.364s user 0.009s sys 0.003s
I20260810 13:54:31.489660 13640 raft_consensus.cc:359] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.485400 13638 consensus_queue.cc:260] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.510716 13638 ts_tablet_manager.cc:1434] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.046s user 0.004s sys 0.001s
I20260810 13:54:31.513453 16968 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.518049 16968 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.520138 16968 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:31.530977 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.513s (SENT)
I20260810 13:54:31.531418 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:31.565682 16116 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Loaded TSK: 0
I20260810 13:54:31.512406 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:31.527753 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:31.576006 13464 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:31.530824 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:31.580941 13476 raft_consensus.cc:2468] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:31.582469 13470 raft_consensus.cc:2393] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:31.586141 13464 raft_consensus.cc:2468] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:31.561132 16761 raft_consensus.cc:493] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.587150 16761 raft_consensus.cc:515] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.588142 17057 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:31.589561 16761 leader_election.cc:290] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:31.591643 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 60706.2us
I20260810 13:54:31.592475 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:31.593042 13480 raft_consensus.cc:3060] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:31.593815 17062 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.594252 17062 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:31.596232 16116 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260810 13:54:31.597386 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:31.599613 13480 raft_consensus.cc:2468] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:31.607635 16911 consensus_queue.cc:1048] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:31.609395 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:31.610180 13464 raft_consensus.cc:2393] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:31.611001 13640 raft_consensus.cc:385] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:31.611315 13640 raft_consensus.cc:740] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:31.612048 13640 consensus_queue.cc:260] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.614318 13640 ts_tablet_manager.cc:1434] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.129s user 0.005s sys 0.001s
I20260810 13:54:31.621631 16968 consensus_queue.cc:1048] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:31.626391 15213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:31.627228 15213 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1298bde14cec4cd3a9d6338c7d47f0b7 for term 7 because replica has last-logged OpId of term: 6 index: 821, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 821.
I20260810 13:54:31.628715 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:31.636181 17062 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:31.636696 17062 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:31.675088 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:31.676069 13049 raft_consensus.cc:2393] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:31.690188 13638 tablet_bootstrap.cc:492] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:31.692840 16761 raft_consensus.cc:493] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.693499 16761 raft_consensus.cc:515] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.695578 16761 leader_election.cc:290] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:31.696383 13638 tablet_bootstrap.cc:654] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:31.697759 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:31.698302 13476 raft_consensus.cc:2468] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:31.699534 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:31.700133 13476 raft_consensus.cc:3060] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:31.701167 13639 tablet_bootstrap.cc:492] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:31.701623 13639 ts_tablet_manager.cc:1403] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.571s user 0.013s sys 0.014s
I20260810 13:54:31.705869 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:31.710616 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:31.725832 13476 raft_consensus.cc:2468] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:31.758838 13638 tablet_bootstrap.cc:492] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:31.759302 13638 ts_tablet_manager.cc:1403] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.069s user 0.008s sys 0.000s
I20260810 13:54:31.766151 13639 raft_consensus.cc:359] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.767302 13639 raft_consensus.cc:385] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:31.767614 13639 raft_consensus.cc:740] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:31.768419 13639 consensus_queue.cc:260] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.770128 13639 ts_tablet_manager.cc:1434] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.068s user 0.006s sys 0.000s
I20260810 13:54:31.794298 13638 raft_consensus.cc:359] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.795043 13638 raft_consensus.cc:385] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:31.795315 13638 raft_consensus.cc:740] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:31.795990 13638 consensus_queue.cc:260] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.809363 13639 tablet_bootstrap.cc:492] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:31.811866 13640 tablet_bootstrap.cc:492] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:31.815207 16968 raft_consensus.cc:493] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.815685 16968 raft_consensus.cc:515] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.817777 13640 tablet_bootstrap.cc:654] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:31.818184 16968 leader_election.cc:290] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:31.818434 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:31.819062 13049 raft_consensus.cc:2468] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:31.820030 13167 leader_election.cc:304] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:31.820999 16968 raft_consensus.cc:2804] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:31.821308 16968 raft_consensus.cc:493] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:31.821589 16968 raft_consensus.cc:3060] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:31.827400 13638 ts_tablet_manager.cc:1434] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.068s user 0.007s sys 0.000s
I20260810 13:54:31.828338 13638 tablet_bootstrap.cc:492] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:31.841871 16968 raft_consensus.cc:515] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.906652 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:31.907227 13049 raft_consensus.cc:3060] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:31.907708 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:31.921797 13049 raft_consensus.cc:2468] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:31.927992 16968 leader_election.cc:290] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:31.928614 16968 raft_consensus.cc:493] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.929936 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:31.929730 16968 raft_consensus.cc:515] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.930546 13054 raft_consensus.cc:3060] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:31.974709 17009 raft_consensus.cc:493] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.975205 17009 raft_consensus.cc:515] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.899386 16997 raft_consensus.cc:493] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:31.924157 16995 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:31.899547 13638 tablet_bootstrap.cc:654] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:31.999022 16995 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:31.999001 16997 raft_consensus.cc:515] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:32.004544 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet aa0567b908974da5817ed62aafecee35 consensus state has no leader
I20260810 13:54:32.012709 16116 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260810 13:54:32.022344 13640 tablet_bootstrap.cc:492] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:32.023006 13640 ts_tablet_manager.cc:1403] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.211s user 0.007s sys 0.007s
I20260810 13:54:32.025465 13640 raft_consensus.cc:359] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.026319 13640 raft_consensus.cc:385] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:32.026583 13640 raft_consensus.cc:740] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:32.027261 13640 consensus_queue.cc:260] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.042044 13054 raft_consensus.cc:2468] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:32.051968 17041 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:32.064558 13640 ts_tablet_manager.cc:1434] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260810 13:54:32.052492 17041 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.101573 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:32.116348 16995 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:32.117868 16968 leader_election.cc:290] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:32.118515 16997 leader_election.cc:290] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:32.128763 17080 raft_consensus.cc:493] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:32.128772 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:32.130872 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:32.141960 13258 raft_consensus.cc:3060] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:32.133430 13254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:32.135196 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:32.143669 17080 raft_consensus.cc:515] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.145669 13043 raft_consensus.cc:2393] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:32.149816 17009 leader_election.cc:290] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:32.150610 17041 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:32.159871 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:32.160671 13046 raft_consensus.cc:2393] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:32.161338 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:32.162034 13056 raft_consensus.cc:3060] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:32.168443 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:32.170571 12951 leader_election.cc:304] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:32.171958 17041 raft_consensus.cc:2804] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:32.172310 17041 raft_consensus.cc:493] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:32.172650 17041 raft_consensus.cc:3060] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:32.140393 13638 tablet_bootstrap.cc:492] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:32.174523 13638 ts_tablet_manager.cc:1403] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.346s user 0.006s sys 0.005s
I20260810 13:54:32.177166 13638 raft_consensus.cc:359] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.177932 13638 raft_consensus.cc:385] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:32.178260 13638 raft_consensus.cc:740] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:32.178968 13638 consensus_queue.cc:260] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.172967 13056 raft_consensus.cc:2468] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:32.150759 13258 raft_consensus.cc:2468] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:32.230966 12951 leader_election.cc:304] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:32.232259 17009 raft_consensus.cc:2749] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:32.263571 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:32.279354 17096 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:32.285339 17096 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:32.291941 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:32.294705 13480 raft_consensus.cc:2393] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:32.297884 17096 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:32.313922 17097 raft_consensus.cc:493] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:32.314419 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:32.314437 17097 raft_consensus.cc:515] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.315210 13467 raft_consensus.cc:2468] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:32.316449 17097 leader_election.cc:290] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:32.317906 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:32.318517 13467 raft_consensus.cc:3060] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:32.330145 13467 raft_consensus.cc:2468] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:32.330572 12951 leader_election.cc:304] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:32.331584 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:32.331902 12951 leader_election.cc:304] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:32.333004 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:32.333662 17052 raft_consensus.cc:2804] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:32.334033 17052 raft_consensus.cc:493] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:32.334352 17052 raft_consensus.cc:3060] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:32.336958 17001 raft_consensus.cc:2749] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:32.341774 13382 leader_election.cc:304] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:32.342489 17097 raft_consensus.cc:2804] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:32.342943 17097 raft_consensus.cc:697] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:32.343751 17097 consensus_queue.cc:237] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.350682 17080 leader_election.cc:290] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:32.351418 13638 ts_tablet_manager.cc:1434] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.177s user 0.005s sys 0.001s
I20260810 13:54:32.354544 13167 leader_election.cc:304] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:32.356676 17086 raft_consensus.cc:2804] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:32.358053 17086 raft_consensus.cc:697] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:32.357039 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:32.358907 17086 consensus_queue.cc:237] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.362103 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:32.366127 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9f48e93a010b4fc5b43124a1f8248ddf [id=011f63bf5ea44f918070a9ead229fa95]
I20260810 13:54:32.368359 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e317f4e20e124c60bbed5450c6c3ca07 [id=01638b930a5e4b46925cdbfd23f204ea]
I20260810 13:54:32.369997 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_230d8010fef046048e532692ee7681c8 [id=01dba6a69dec44aeb2f402dddb3e0cae]
I20260810 13:54:32.371584 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]
I20260810 13:54:32.373493 13638 tablet_bootstrap.cc:492] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:32.374358 17041 raft_consensus.cc:515] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.385893 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e8a597f1c0ec4cd8878f49046eb45e66 [id=047df8b2dabc4682a2227e841b10a53c]
I20260810 13:54:32.387511 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8054f93e82de4c898987acb86f25e5d0 [id=0685b3b0945a493db836d29e5993e447]
I20260810 13:54:32.388872 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a8f5484f0ff14287be783696e6d8525d [id=06f3859cd5e748a3800b66ecf0a93c28]
I20260810 13:54:32.390389 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]
I20260810 13:54:32.392624 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b392780f45ab4b899ddb12eefbcdd556 [id=0a7b7ff4685e4a8884b4aab7a835890d]
I20260810 13:54:32.394295 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3fb4e7e2f617464f930b338a8ece6e38 [id=0acde9f8e2f7483c9eb7f3df14b0859d]
I20260810 13:54:32.398108 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_88dee97116de4d0dac8a7af552b06f14 [id=0b34e431b94a4d24ad26858d4630420f]
I20260810 13:54:32.398350 13638 tablet_bootstrap.cc:654] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:32.399299 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f0a8373b96114e0c896e54dcb940f74d [id=0c70c375ac604d158df38f374fc3c1d1]
I20260810 13:54:32.400650 17041 leader_election.cc:290] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:32.404825 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_1668535b5107458a842c0def2c55461f [id=0cdd1449d5734d559f49933deef6bb19]
I20260810 13:54:32.406853 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]
I20260810 13:54:32.408072 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9]
I20260810 13:54:32.415994 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_94153e136b9f4ea9aeb589c1a0322981 [id=12299e0dca554badab42ee7a73ea9723]
I20260810 13:54:32.417621 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e424bd25638b4b23b721c8529aa42285 [id=126e0229d9904feba5c16222cecf5140]
I20260810 13:54:32.425675 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_72e9522a295642b28aa17f724e010d9e [id=143a3ec1ee2d409fa9de19aa1c8c8ab3]
I20260810 13:54:32.427079 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2695264893564646a621e76ff6443e84 [id=147b038d3de54c8d85e666747153cb7d]
I20260810 13:54:32.429153 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]
I20260810 13:54:32.431898 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68]
W20260810 13:54:32.435688 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 103905us
I20260810 13:54:32.436383 13640 tablet_bootstrap.cc:492] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:32.436738 12951 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:32.437894 12951 leader_election.cc:304] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:32.438760 17058 raft_consensus.cc:2804] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:32.439328 17058 raft_consensus.cc:697] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:32.439518 17009 raft_consensus.cc:2804] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:32.440019 17009 raft_consensus.cc:697] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:32.440900 17009 consensus_queue.cc:237] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.442071 16911 consensus_queue.cc:1048] T 69ecda19e4f143c99654aff6058ad8bb P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:32.442456 13640 tablet_bootstrap.cc:654] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:32.440320 17058 consensus_queue.cc:237] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.408481 17052 raft_consensus.cc:515] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.451181 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c752da6252ce4541be9cef2bce47bfe3 [id=178f273145a74eb2a2de7da53f248126]
I20260810 13:54:32.448580 17052 leader_election.cc:290] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:32.458154 13639 tablet_bootstrap.cc:654] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:32.452471 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d]
I20260810 13:54:32.472509 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_57980e60ac6549c8b24861967f6cc198 [id=18ade4a3af044a498725f45a06e04b81]
I20260810 13:54:32.475437 12951 leader_election.cc:304] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:32.477108 12951 leader_election.cc:304] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:32.476639 17041 raft_consensus.cc:2749] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:32.478263 17041 raft_consensus.cc:2764] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260810 13:54:32.483425 12951 leader_election.cc:343] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:32.485838 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]
I20260810 13:54:32.489374 12951 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:32.494987 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 [id=19cf8ac217b34ed1b6ceccb40508fd56]
I20260810 13:54:32.499259 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:32.490953 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:32.510443 13258 raft_consensus.cc:3060] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:32.509832 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]
I20260810 13:54:32.519661 13639 tablet_bootstrap.cc:492] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:32.520226 13639 ts_tablet_manager.cc:1403] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.711s user 0.014s sys 0.004s
I20260810 13:54:32.522574 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_98fbef24cbef43679502dae9e67e35cf [id=1e5fe6bb81ec41d3be1b189a0631e695]
I20260810 13:54:32.523581 12951 leader_election.cc:304] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:32.527153 13640 tablet_bootstrap.cc:492] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:32.527639 13640 ts_tablet_manager.cc:1403] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.091s user 0.012s sys 0.000s
I20260810 13:54:32.529556 17052 raft_consensus.cc:2749] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:32.531472 13639 raft_consensus.cc:359] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.531932 13258 raft_consensus.cc:2468] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:32.532925 13639 raft_consensus.cc:385] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:32.533288 13639 raft_consensus.cc:740] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:32.532109 17058 raft_consensus.cc:2804] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:32.534201 17058 raft_consensus.cc:697] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:32.534925 17118 consensus_queue.cc:1048] T 691aac16d50745d6965bebe94831b67b P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:32.536428 17118 raft_consensus.cc:493] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:32.536031 17058 consensus_queue.cc:237] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.537092 13639 consensus_queue.cc:260] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.540016 13639 ts_tablet_manager.cc:1434] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.019s user 0.001s sys 0.005s
I20260810 13:54:32.537091 17118 raft_consensus.cc:515] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.543602 17118 leader_election.cc:290] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:32.541040 13639 tablet_bootstrap.cc:492] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:32.553272 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]
I20260810 13:54:32.554548 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6d071c01702c4d3cb0e693f02ef8a90f [id=20edfa4b7c00446bae121b000f8faf5f]
W20260810 13:54:32.556216 12951 leader_election.cc:343] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:32.558596 13167 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
W20260810 13:54:32.573053 13382 leader_election.cc:343] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:32.574313 13382 leader_election.cc:304] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:32.575274 17097 raft_consensus.cc:2804] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:32.575766 17097 raft_consensus.cc:697] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:32.576577 17097 consensus_queue.cc:237] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.591681 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_734de53e103d480c93e2779ef687142e [id=23152d9b944747f89cd06ee3a569b5b3]
I20260810 13:54:32.592002 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:32.592813 13480 raft_consensus.cc:2393] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:32.593825 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:32.594525 13464 raft_consensus.cc:3060] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:32.573081 13640 raft_consensus.cc:359] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.600875 13640 raft_consensus.cc:385] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:32.602236 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:32.602823 13470 raft_consensus.cc:3060] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:32.602388 13640 raft_consensus.cc:740] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:32.605546 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2a27c95d054b44dd84ede3639a6395c5 [id=232f082ff5eb446bbb2e7869e83b2449]
I20260810 13:54:32.609741 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]
I20260810 13:54:32.608747 13640 consensus_queue.cc:260] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.627213 13639 tablet_bootstrap.cc:654] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:32.629992 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_004ad2bd15214f94a0c183ec75f725ca [id=240ee1976c8f40c59438f7f22839e297]
I20260810 13:54:32.613963 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:32.635620 13467 raft_consensus.cc:2468] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:32.626648 13464 raft_consensus.cc:2468] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:32.631433 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]
I20260810 13:54:32.620615 13470 raft_consensus.cc:2468] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:32.648764 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:32.659300 13640 ts_tablet_manager.cc:1434] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.089s user 0.005s sys 0.000s
W20260810 13:54:32.657583 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:32.649385 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]
I20260810 13:54:32.662985 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]
I20260810 13:54:32.665737 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]
I20260810 13:54:32.667723 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]
I20260810 13:54:32.670142 17097 consensus_queue.cc:1048] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:32.660413 13640 tablet_bootstrap.cc:492] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:32.685287 13638 tablet_bootstrap.cc:492] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:32.701061 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:32.701669 13043 raft_consensus.cc:2468] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:32.709378 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_40e69780eeb744aa8a192c8623bc7d4b [id=2ef48298f4404224bb44136ff71befd8]
I20260810 13:54:32.714146 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]
I20260810 13:54:32.716889 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:32.720552 13640 tablet_bootstrap.cc:654] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:32.723035 13638 ts_tablet_manager.cc:1403] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.350s user 0.012s sys 0.000s
I20260810 13:54:32.734853 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]
I20260810 13:54:32.736150 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]
W20260810 13:54:32.744563 12952 leader_election.cc:343] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:32.747539 12952 leader_election.cc:304] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:32.748641 12952 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:32.750607 16911 raft_consensus.cc:2749] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:32.751276 16911 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:32.757567 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_da87a4b83c12422e999c5b88c825d890 [id=3064108a10bd4f76b2be6614ebed22fc]
I20260810 13:54:32.791419 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]
I20260810 13:54:32.793684 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6]
I20260810 13:54:32.816059 13640 tablet_bootstrap.cc:492] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:32.816529 13640 ts_tablet_manager.cc:1403] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.156s user 0.023s sys 0.020s
I20260810 13:54:32.818913 13640 raft_consensus.cc:359] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.819522 13640 raft_consensus.cc:385] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:32.819774 13640 raft_consensus.cc:740] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:32.823454 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c]
W20260810 13:54:32.783900 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 46960.9us
I20260810 13:54:32.830195 13382 leader_election.cc:304] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:32.838347 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dfe0fd41b106448e8a729e593ac63e5a [id=342af46254364715a3eb6166299c7275]
I20260810 13:54:32.820423 13640 consensus_queue.cc:260] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.865720 17134 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:32.866297 17134 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:32.869784 15213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:32.870654 15213 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1298bde14cec4cd3a9d6338c7d47f0b7 for term 7 because replica has last-logged OpId of term: 6 index: 821, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 821.
I20260810 13:54:32.840566 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4b2d4fca101f4cbc9f296c50ca183066 [id=35087d7e2d0642a59670773333dda055]
I20260810 13:54:32.875506 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9d26366e03454a73ae877683e6700ff0 [id=3587a6d27d294470ac7551a3bb96a701]
I20260810 13:54:32.884404 13639 tablet_bootstrap.cc:492] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:32.888505 17134 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:32.892894 13639 ts_tablet_manager.cc:1403] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.352s user 0.032s sys 0.023s
I20260810 13:54:32.895473 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_51b05316075a49bc898ede0e35031c70 [id=359af78e1c844299a56756c90613d641]
I20260810 13:54:32.771837 13638 raft_consensus.cc:359] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.904089 13638 raft_consensus.cc:385] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:32.906720 13639 raft_consensus.cc:359] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:32.907132 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 78445.2us
I20260810 13:54:32.907538 13639 raft_consensus.cc:385] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:32.907938 13639 raft_consensus.cc:740] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:32.907979 13382 leader_election.cc:343] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:32.911443 13640 ts_tablet_manager.cc:1434] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.095s user 0.007s sys 0.004s
I20260810 13:54:32.913753 13640 tablet_bootstrap.cc:492] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:32.914971 17097 raft_consensus.cc:2749] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:32.926760 13640 tablet_bootstrap.cc:654] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:32.908706 13639 consensus_queue.cc:260] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.904436 13638 raft_consensus.cc:740] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:32.934949 13638 consensus_queue.cc:260] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.938428 13639 ts_tablet_manager.cc:1434] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.044s user 0.007s sys 0.001s
I20260810 13:54:32.966802 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]
I20260810 13:54:32.969890 12951 leader_election.cc:304] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:32.970880 17058 raft_consensus.cc:2804] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:32.971318 17058 raft_consensus.cc:493] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:32.971745 17058 raft_consensus.cc:3060] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:32.975838 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2416e07beb8d42a6a48de9dab42936cf [id=39551fb5d1804467bb58d5b00de27be4]
I20260810 13:54:32.979955 12951 leader_election.cc:304] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:32.988359 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]
I20260810 13:54:32.989678 17058 raft_consensus.cc:515] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:32.990428 13640 tablet_bootstrap.cc:492] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:32.991884 13640 ts_tablet_manager.cc:1403] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.078s user 0.013s sys 0.000s
W20260810 13:54:32.993857 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 85917.7us
W20260810 13:54:32.994535 13382 leader_election.cc:343] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:32.994874 13382 leader_election.cc:304] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:32.995602 17136 raft_consensus.cc:2749] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:32.997159 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d460b63b63de413ebdeeb708b4be6b10 [id=3d7325460d7842658631298c2538a71c]
I20260810 13:54:32.937157 13638 ts_tablet_manager.cc:1434] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.168s user 0.006s sys 0.000s
I20260810 13:54:33.024087 13638 tablet_bootstrap.cc:492] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:33.025104 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4f780597fcec4261acd040c8816826c4 [id=3e00d0fc074747809ebc1f6b3696649d]
I20260810 13:54:32.995047 16911 raft_consensus.cc:2804] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:33.026587 16911 raft_consensus.cc:697] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:33.027540 16911 consensus_queue.cc:237] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.028354 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a0e9339c31fa470380def2ad49326176 [id=3e51b3dca7144d7b8494e0a36e61706a]
I20260810 13:54:32.996107 12951 leader_election.cc:304] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:33.000393 13639 tablet_bootstrap.cc:492] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:33.041107 17118 raft_consensus.cc:2804] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:33.041618 17118 raft_consensus.cc:697] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:33.042441 17118 consensus_queue.cc:237] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.036813 13640 raft_consensus.cc:359] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.045048 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]
I20260810 13:54:33.045568 13640 raft_consensus.cc:385] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:33.050796 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 54758.2us
I20260810 13:54:33.048318 13640 raft_consensus.cc:740] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:33.005358 13164 leader_election.cc:304] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:33.055212 17086 raft_consensus.cc:2804] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:33.055876 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fd80397e5f4247339b3e3d483a671afa [id=3f7a51368fe34ca6b66f5c810e94ae60]
I20260810 13:54:33.056156 17086 raft_consensus.cc:697] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:33.057022 17086 consensus_queue.cc:237] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.057596 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_83164f9e96c540f58a5af47229b70854 [id=3f7f1db8228e4efa9b34bc33cb13be40]
I20260810 13:54:33.058982 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 [id=3fa9cd2a62034a4d81a0b740d5c31447]
W20260810 13:54:33.066327 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 61062.1us
I20260810 13:54:33.068228 17089 consensus_queue.cc:1048] T 7a745bc711004993830b40ca1c93c63b P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:33.063340 13640 consensus_queue.cc:260] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.081940 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_57828eb9ca764faf923e3e68fd0233a8 [id=3fff8bc92af84e59a10a592e85ad8503]
I20260810 13:54:33.083364 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e9c73c2f54b54ea485cdcadc15b0a420 [id=41772225716845f794c8c7d1ab21fd32]
I20260810 13:54:33.106346 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_def78e8fb6b74845bf2ef24bcef6691b [id=42af124147fe44c1875a9803af2e97a9]
I20260810 13:54:33.109413 13639 tablet_bootstrap.cc:654] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:33.109933 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]
W20260810 13:54:33.119122 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 60684.1us
I20260810 13:54:33.121399 13382 leader_election.cc:304] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:33.122072 17136 raft_consensus.cc:2804] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:33.122394 17136 raft_consensus.cc:493] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:33.122700 17136 raft_consensus.cc:3060] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:33.123472 17058 leader_election.cc:290] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:33.129688 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f7160fbf49d74f79b79a300e67af5cbf [id=440aa3e8a24a415eb98a448b4848e76d]
I20260810 13:54:33.132263 17136 raft_consensus.cc:515] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.133356 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]
I20260810 13:54:33.134445 17136 leader_election.cc:290] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:33.136778 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c39a51586fe847b990c6d2c59e2280ff [id=44428a121dc24f5ba5e5d74158f9f4d0]
I20260810 13:54:33.145669 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_51d643dcb2a5451e9cff367f2b3649c5 [id=46372d6eedfe4d56b2f2ce9a85f7f1fc]
I20260810 13:54:33.147704 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_586e39daebb14dfaa08b3cc251eeb18a [id=46490c79e3814a82b21ab79f2a53814e]
I20260810 13:54:33.150511 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]
I20260810 13:54:33.160974 17143 consensus_queue.cc:1048] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:33.162719 13164 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:33.163030 16761 consensus_queue.cc:1048] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:33.163421 17089 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:33.163715 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_87c087a440044f9483716cce60bb4777 [id=4777400951884e84a747cbc635b6a087]
I20260810 13:54:33.169907 13638 tablet_bootstrap.cc:654] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:33.178591 13639 tablet_bootstrap.cc:492] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
W20260810 13:54:33.178956 13164 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:33.179347 13164 leader_election.cc:304] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:33.181617 13639 ts_tablet_manager.cc:1403] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.181s user 0.006s sys 0.005s
I20260810 13:54:33.181103 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1]
I20260810 13:54:33.183133 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f6d23e8eec824ef08b26dec8c7c6d010 [id=4d373c8f174b46e99209a83ab947b204]
I20260810 13:54:33.189815 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_276835c42e5a48309351dd4e441cc62f [id=4d5771db00ae42b9957c6453d83f81ae]
I20260810 13:54:33.191057 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_312808fed3bf45e8923e2b1be7f4d9fa [id=4de804595a6142819c0ea2f64fd1e34c]
I20260810 13:54:33.195747 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_10638f441f654317829d436d2e7eb979 [id=4f21b5213a724ce5989d7684473d65e9]
I20260810 13:54:33.202603 13640 ts_tablet_manager.cc:1434] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.209s user 0.020s sys 0.002s
I20260810 13:54:33.203706 13640 tablet_bootstrap.cc:492] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:33.206969 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d171e1a65676495882912f18dddff2ee [id=4f6c1859cd1a481da7b9b3c2013365c3]
I20260810 13:54:33.220055 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e16662a9b5514b04b2d2fad48ad3d82f [id=51cc3d6cb6d248fc94d93654adfc72c0]
W20260810 13:54:33.164613 13382 leader_election.cc:343] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:33.225112 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 60532.9us
I20260810 13:54:33.228116 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]
I20260810 13:54:33.228950 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:33.228888 13639 raft_consensus.cc:359] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.229597 13474 raft_consensus.cc:2393] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:33.229525 13639 raft_consensus.cc:385] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:33.230018 13639 raft_consensus.cc:740] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:33.231065 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]
I20260810 13:54:33.230772 13639 consensus_queue.cc:260] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.234210 13639 ts_tablet_manager.cc:1434] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.051s user 0.006s sys 0.000s
I20260810 13:54:33.236276 17086 raft_consensus.cc:2749] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:33.242770 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7c53cfb1808c47e59a8e23b0e6325acd [id=5558467decbe4ca29c989c08073be0de]
I20260810 13:54:33.246434 13638 tablet_bootstrap.cc:492] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:33.248579 13640 tablet_bootstrap.cc:654] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:33.248831 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]
I20260810 13:54:33.254020 13638 ts_tablet_manager.cc:1403] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.230s user 0.010s sys 0.000s
I20260810 13:54:33.254489 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]
I20260810 13:54:33.259174 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7e2df1474a324a139e9e31ca581a4f34 [id=5b1484c8fdc64ee6a07bd203fa140fcb]
W20260810 13:54:33.266371 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:33.268445 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_bd734d41b4c04e8fae8551c8d2f341dc [id=5b4eac88920044a7ba18bf40b8783a9d]
I20260810 13:54:33.273082 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ed026dd607ea4b2e8b1f22bee438879d [id=5b919872756647048ea2e4fecbe78537]
I20260810 13:54:33.192584 17089 raft_consensus.cc:2749] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:33.280181 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b5e6f89f8d854f7e991193036d4d8321 [id=5d59e07d6bc5465eaaf40d68610bc154]
W20260810 13:54:33.247001 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 68068.5us
I20260810 13:54:33.281185 13164 leader_election.cc:304] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:33.282392 13164 leader_election.cc:304] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:33.284237 17089 raft_consensus.cc:2749] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:33.290499 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]
I20260810 13:54:33.292392 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d4a38708152b4705af7eaf9af6ddc436 [id=5edfc8942f7145adae70b892942fbd64]
I20260810 13:54:33.295825 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_856a1bf64ef9498890c9b6d98edcc8ad [id=60b4f30b701344d79b0c64b4e8127dbd]
W20260810 13:54:33.295876 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 108609us
I20260810 13:54:33.287588 17089 raft_consensus.cc:3060] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:33.305909 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8eeb870902124e9696cfa7e98dfa0e88 [id=614fbd4b5dd440cb8f5a6fa4d994266d]
I20260810 13:54:33.305987 13638 raft_consensus.cc:359] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.306715 13638 raft_consensus.cc:385] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:33.307003 13638 raft_consensus.cc:740] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:33.307510 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_32a20912aef145aabc1b19b2b796c682 [id=6180bc58d52049fa82f92dc5e5a6b891]
I20260810 13:54:33.307658 13638 consensus_queue.cc:260] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.309062 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0cd1166b3e534639918d41544e409ec7 [id=631d4e81ac6b445183e988a0821e0e61]
I20260810 13:54:33.310413 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5d55900f1adf4aca973dbf4e94ca29c3 [id=63c1004ec7f44526929d7b9f809c0e04]
I20260810 13:54:33.314334 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:33.317286 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_96cdf642a68642ce9fe947569577b42a [id=667ccf7ba20c49b2be82e167aa212ecd]
I20260810 13:54:33.317355 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:33.317782 13640 tablet_bootstrap.cc:492] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:33.318214 13640 ts_tablet_manager.cc:1403] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.115s user 0.011s sys 0.002s
I20260810 13:54:33.322750 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3ffb4babc30c4b76ae97168cb6dbdeee [id=66920d867573408d811d1fa6b877d355]
I20260810 13:54:33.324849 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]
I20260810 13:54:33.332219 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_cc339254bace4b5e87544b721a6493a5 [id=685e6bce7ba5467693e2b0e1c739897b]
I20260810 13:54:33.333590 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]
I20260810 13:54:33.335462 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad]
I20260810 13:54:33.336314 13639 tablet_bootstrap.cc:492] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:33.340189 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_77e30d5f98584b9e9711faa0b7a824df [id=6afc4e9a485640dda167bbaa0d6b347e]
I20260810 13:54:33.341586 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]
I20260810 13:54:33.345496 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]
I20260810 13:54:33.344573 13640 raft_consensus.cc:359] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.346354 13640 raft_consensus.cc:385] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:33.347215 13640 raft_consensus.cc:740] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:33.349013 13640 consensus_queue.cc:260] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.360067 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:33.360867 13467 raft_consensus.cc:2393] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:33.363662 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9]
I20260810 13:54:33.373804 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5ac9d00cb7b3422e9810b51a4f20e029 [id=6f7b1b6d99b64d008a7c3c527f172e24]
I20260810 13:54:33.378787 13639 tablet_bootstrap.cc:654] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:33.389509 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_772227d6702d4cf7bf6729e922d3eea5 [id=6ffcaf4f90f14e24b6d02b21e2936bd3]
I20260810 13:54:33.391701 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8606de06b2994b3291a5ee1e28ad7100 [id=7162bee4392749a38057f272df172987]
I20260810 13:54:33.391389 13640 ts_tablet_manager.cc:1434] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.073s user 0.011s sys 0.000s
I20260810 13:54:33.408908 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 [id=766aaf50fb2f4fbca53416a8e853f9c1]
I20260810 13:54:33.410400 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9]
I20260810 13:54:33.414605 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]
I20260810 13:54:33.421837 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 [id=7a54639f4e1a4f1a82278d5d64b347b8]
I20260810 13:54:33.423445 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 [id=7a8b712d0b1a4766ab00cd2c4739c311]
I20260810 13:54:33.424757 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ee9ef5f74a944eaabe6af879e8ab15a2 [id=7a8f1c3ab411436fa3940b3261d0e05f]
I20260810 13:54:33.426216 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 [id=7b407001f6d54bd2929f1f0d141b065e]
I20260810 13:54:33.429461 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_acc827f97bb244f59d2eed071cc9bd55 [id=7b4d23c35bc14f8598821f2838a18148]
I20260810 13:54:33.431315 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b33cb4c7a80141c49d306885213f30a9 [id=7dff57e81c064728a8160d5c02c11de5]
I20260810 13:54:33.432476 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:33.433429 13033 raft_consensus.cc:2393] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:33.439769 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]
I20260810 13:54:33.447310 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 [id=8129beecaba3450c9041bb715af80988]
I20260810 13:54:33.448088 13639 tablet_bootstrap.cc:492] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:33.449353 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_921fde42e0214ef58181c03785687004 [id=828ce62882b949d6887e75923229655e]
I20260810 13:54:33.450660 17136 raft_consensus.cc:493] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:33.451105 17136 raft_consensus.cc:515] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.453142 17136 leader_election.cc:290] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:33.455884 13639 ts_tablet_manager.cc:1403] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.120s user 0.011s sys 0.000s
I20260810 13:54:33.459805 13639 raft_consensus.cc:359] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.465346 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_383bd937c51942a1b124430d2b5086af [id=82f67714ca3b4e6aab8557bd0f53d264]
I20260810 13:54:33.466737 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_54ea5af3ae44427eb0031a29dd62e663 [id=834d810fa56c49de9d97b91dabab82f1]
I20260810 13:54:33.469303 17086 consensus_queue.cc:1048] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:33.473879 13638 ts_tablet_manager.cc:1434] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.209s user 0.006s sys 0.000s
I20260810 13:54:33.473979 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6964fe82ae0c4d96a86d800f82062b3e [id=83fc760e794d422d8614bf728e3e47df]
I20260810 13:54:33.475205 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_612d612a32794a8998dd3a19129b79c3 [id=840614d5bd744a82bf94fd2f23a31d69]
I20260810 13:54:33.479547 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4b93246ea61e418db4efb3c2732711af [id=847e7c0039964b3f94192d5032791e4a]
I20260810 13:54:33.481063 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f835565354f042368700f4252335e8eb [id=84ca48404db8439697f8035aa3bc34d3]
I20260810 13:54:33.485447 13638 tablet_bootstrap.cc:492] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:33.513095 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]
I20260810 13:54:33.514230 17089 raft_consensus.cc:2749] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:33.525133 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 109648us
I20260810 13:54:33.526216 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]
I20260810 13:54:33.527516 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d5c509cabbb84883a9a911c2f4e04c88 [id=865c0ec036ca45caaec23fe2cf899d1d]
I20260810 13:54:33.520130 13638 tablet_bootstrap.cc:654] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:33.540791 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e8940f9b8b5647b29566e6383b5c8fd7 [id=866777afb37d48b7bc025eba1377a8d0]
I20260810 13:54:33.542666 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7cf74351dd314634a7a8ca1b1a24302b [id=884f2bca73394b0b97902104a5b68976]
I20260810 13:54:33.550487 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7cbcdca887724284a33c681c9574ea82 [id=8a8a45a7ac264648b3810d9c69a36751]
I20260810 13:54:33.557803 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a49a2f11e36d4162bc5847bacee456e7 [id=8aad892ad49f4c0aa7681d88843d3561]
I20260810 13:54:33.563339 13640 tablet_bootstrap.cc:492] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:33.568980 13640 tablet_bootstrap.cc:654] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:33.572244 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]
I20260810 13:54:33.594944 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_09a6fde1eefc4ce0a591129d6ab65e3a [id=8b4fe3206c2344728b61ed31b33580a6]
I20260810 13:54:33.596346 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_213c40da56b549d3bb97fccaa8f872cd [id=8bb576bce14b4fc3b1848496c6081841]
I20260810 13:54:33.599821 13640 tablet_bootstrap.cc:492] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:33.600333 13640 ts_tablet_manager.cc:1403] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.003s
I20260810 13:54:33.605230 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_72fd7834d8574cb1a74c1d08699d1f7e [id=8cdd566d9af748b6a8d998ecf7221fb6]
I20260810 13:54:33.611778 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ee42df273bce4386bbf8edb282c2059a [id=8d115ba01bfd4ed7b90f6531e9ef66c2]
I20260810 13:54:33.491698 17052 raft_consensus.cc:493] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:33.612712 17052 raft_consensus.cc:515] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.502223 17058 raft_consensus.cc:493] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:33.614423 17058 raft_consensus.cc:515] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.618975 17058 leader_election.cc:290] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:33.622413 13638 tablet_bootstrap.cc:492] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:33.622593 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_819cbf37633d4c75ba529b0d037cb8db [id=8d2ee7c5b732405c804aec9f79e98038]
I20260810 13:54:33.622864 13638 ts_tablet_manager.cc:1403] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.138s user 0.006s sys 0.004s
I20260810 13:54:33.622748 17052 leader_election.cc:290] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:33.623729 13639 raft_consensus.cc:385] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:33.625092 13639 raft_consensus.cc:740] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:33.625295 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]
I20260810 13:54:33.626358 13639 consensus_queue.cc:260] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.629963 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fe0baa9629ad42fbb05cfbc004e62688 [id=907a4591204d4db697b44488fef76406]
I20260810 13:54:33.606261 13640 raft_consensus.cc:359] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.636791 13640 raft_consensus.cc:385] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:33.637449 13640 raft_consensus.cc:740] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:33.638218 17136 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:33.638664 17136 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.638901 13640 consensus_queue.cc:260] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.640625 17136 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:33.642385 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2c6e1c408acb44358898a1a4ff356bdd [id=909cf43e9f9e4d439f8f246cef081d56]
I20260810 13:54:33.648416 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]
I20260810 13:54:33.666958 13639 ts_tablet_manager.cc:1434] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.210s user 0.005s sys 0.001s
I20260810 13:54:33.666460 13638 raft_consensus.cc:359] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.668140 13638 raft_consensus.cc:385] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:33.668884 13638 raft_consensus.cc:740] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:33.672044 13640 ts_tablet_manager.cc:1434] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.071s user 0.010s sys 0.000s
I20260810 13:54:33.652361 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_bc50dbac8249499e90b8d763fd7041f2 [id=92622bf6828843419776bf2bbe0c6aee]
I20260810 13:54:33.685508 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]
I20260810 13:54:33.670472 13638 consensus_queue.cc:260] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.692467 13640 tablet_bootstrap.cc:492] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:33.693289 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3c8a09c1dfda4797918bd6715bdfebce [id=9656e3a9a8f6431cb7b42ea64ae16159]
I20260810 13:54:33.694154 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:33.694689 13260 raft_consensus.cc:3060] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:33.695801 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ea7f41d802964936a967be553d7418fe [id=96574627e23442ebb0323b065423efae]
I20260810 13:54:33.703016 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:33.703536 13258 raft_consensus.cc:3060] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:33.706625 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_eebc498aa5734ab8b23c00b74d896ba9 [id=9756f3d17c15460e84863e49504d8349]
I20260810 13:54:33.710388 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4f9508194c21480d9b603b139bdaf902 [id=98e554f12bf944c98887ed2293df2e26]
I20260810 13:54:33.714192 13254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:33.716717 13258 raft_consensus.cc:2468] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:33.723277 13260 raft_consensus.cc:2468] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:33.726475 13638 ts_tablet_manager.cc:1434] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.103s user 0.007s sys 0.006s
I20260810 13:54:33.727413 13638 tablet_bootstrap.cc:492] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:33.729907 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 57173.3us
W20260810 13:54:33.732769 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 52747.8us
I20260810 13:54:33.742108 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_209ee5a105144c7e871214eaafcd0cbe [id=9a05ad06179141dfabe2d12858c1746c]
I20260810 13:54:33.745312 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_215968e7ab2540ab8a35960795941543 [id=9bac646089c94e54b68ff14ce2a50793]
W20260810 13:54:33.757212 13382 leader_election.cc:343] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:33.759066 13382 leader_election.cc:343] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:33.759456 13382 leader_election.cc:304] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:33.759838 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_6c443ac64289437d8c7dcf5ea44469dd [id=9c99ad2364cc45fba0746cbae06deeeb]
I20260810 13:54:33.762792 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]
I20260810 13:54:33.766305 13640 tablet_bootstrap.cc:654] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:33.770639 13252 raft_consensus.cc:3060] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:33.780165 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5388dd61e30949a5a2b9c07a35637080 [id=9fe82107b8344dfdae308a0d7091488d]
I20260810 13:54:33.783572 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]
I20260810 13:54:33.785674 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]
I20260810 13:54:33.786907 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_63e74b1d9a4e48c3b9343a12f0b926e6 [id=a17784f2e3a940e59b5603273436c417]
W20260810 13:54:33.797921 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 60776.1us
I20260810 13:54:33.802081 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:33.803359 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:33.808673 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]
I20260810 13:54:33.810043 13638 tablet_bootstrap.cc:654] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:33.811496 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5022f9898a2b4343b457ad28e07a933f [id=a31aa9b4d20f46b4bd283aca2d2b446c]
I20260810 13:54:33.812731 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_23cb4b4f896b48b1adc91079a7382c5c [id=a32ace7c7992464c8a5ef3f8169906b6]
I20260810 13:54:33.814911 17058 consensus_queue.cc:1048] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:33.817449 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]
I20260810 13:54:33.822561 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e9bf94db05cb46279abaeba00681ab82 [id=a547ccb6c9c24877b0b8d81d52e1630a]
I20260810 13:54:33.827630 13640 tablet_bootstrap.cc:492] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:33.828053 13640 ts_tablet_manager.cc:1403] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.136s user 0.011s sys 0.000s
I20260810 13:54:33.830266 13639 tablet_bootstrap.cc:492] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:33.841092 17144 raft_consensus.cc:2749] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:33.841782 17144 raft_consensus.cc:493] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:33.842221 17144 raft_consensus.cc:515] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.844460 17144 leader_election.cc:290] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:33.845697 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 86661.1us
I20260810 13:54:33.848197 17058 raft_consensus.cc:493] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:33.848696 17058 raft_consensus.cc:515] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.851686 17058 leader_election.cc:290] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:33.849568 16761 raft_consensus.cc:493] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:33.854725 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2901b91576984ac4a165471a90e86a8b [id=a67f03853a964c2fbf175165ee422881]
I20260810 13:54:33.861021 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]
I20260810 13:54:33.868264 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_40ebe892a09b471581cb322124cf7630 [id=a79fc8e8c8ec420fb2c6e6cc0fdbc17e]
I20260810 13:54:33.872035 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_210fb0797673402e8e79fcf4e3c293b6 [id=aa1bdb6bb7c04faabb47c1552cc4aaff]
I20260810 13:54:33.875746 13639 tablet_bootstrap.cc:654] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:33.882980 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3abcbf71e2004a07888fe131143e8e76 [id=ab67527f31ce42d7a92bb0cba8f69ff6]
I20260810 13:54:33.885500 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]
I20260810 13:54:33.887131 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607]
I20260810 13:54:33.893069 16761 raft_consensus.cc:515] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:33.887327 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:33.894532 13640 raft_consensus.cc:359] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.895179 13640 raft_consensus.cc:385] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:33.895424 13640 raft_consensus.cc:740] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:33.896127 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4]
I20260810 13:54:33.898068 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_03b06d24159c4b079c0008aa041c517b [id=af367ad99e9a4fa9907c170b0a5dee49]
I20260810 13:54:33.898213 13638 tablet_bootstrap.cc:492] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:33.898638 13638 ts_tablet_manager.cc:1403] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.171s user 0.005s sys 0.005s
W20260810 13:54:33.901584 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 44331.6us
I20260810 13:54:33.902540 17144 consensus_queue.cc:1048] T 29ace970eee349d6b669b5c531f91c8b P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:33.903237 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]
I20260810 13:54:33.905953 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a3085b5448ff4df8a25c4802ca130085 [id=b3648e88a1fc44808dcf824092d5de35]
I20260810 13:54:33.909690 13640 consensus_queue.cc:260] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.910198 16761 leader_election.cc:290] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:33.912127 13640 ts_tablet_manager.cc:1434] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.084s user 0.006s sys 0.001s
I20260810 13:54:33.913815 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]
I20260810 13:54:33.921824 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_029a3ba2ee734a729e84a4482938ed5b [id=b437e76811d440ca817fca27a8dcbd45]
I20260810 13:54:33.923461 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dfe60ded8ca240529710962e7f530298 [id=b4ce0aca49834e698812644caf8b8a94]
I20260810 13:54:33.925417 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9ec2734c1c43472ca16731c99911a350 [id=b5072df8be3e4cc58980380d089942e2]
I20260810 13:54:33.926738 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]
W20260810 13:54:33.926842 15135 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 1.635s (SENT) [suppressed 2 similar messages]
I20260810 13:54:33.928265 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_131ccf6f50394a4facf6e622d5449b17 [id=b559d903254d433989a2deb00eb27361]
I20260810 13:54:33.934545 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5b39c1bb4b614f97ab6eb4d521628013 [id=b69ad2b0c70949b98192ae056eb2cab0]
W20260810 13:54:33.934859 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 58611.7us
I20260810 13:54:33.935916 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d8ab37a103a5426b81dcf295239ec9af [id=b7130fcdfcf54b76861fd9c87559beeb]
I20260810 13:54:33.937196 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a80ad2cc0680447898f832a3da957607 [id=b7e44fb60b9b401db5517c2fd7e8c70b]
I20260810 13:54:33.945456 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4f02931df6b0437a9cb7869b14b73084 [id=b8289db1d29241f3815ff2da32fcfc1a]
I20260810 13:54:33.946786 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_c4942145f1414e939000a9b7443c0d29 [id=b88902dec1e34475b3ae470c1c17f777]
I20260810 13:54:33.947459 13640 tablet_bootstrap.cc:492] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:33.949474 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_18833ebfc83a4c33a1a94a902b97ffaf [id=bb2789ba0fd043c2a44479f23111dcbb]
I20260810 13:54:33.954089 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ec24cdc578624353b8936b6a7add0b7b [id=bf5a9955305343258f05d827cd3e8aec]
I20260810 13:54:33.955152 13639 tablet_bootstrap.cc:492] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:33.955646 13639 ts_tablet_manager.cc:1403] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.126s user 0.006s sys 0.003s
I20260810 13:54:33.968729 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_86dcc5d091024407b7e167806ec593a3 [id=c07ecd00b44e49c9b0a32e8710373471]
I20260810 13:54:33.971020 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]
I20260810 13:54:33.973541 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]
I20260810 13:54:33.975286 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]
I20260810 13:54:33.977936 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d21ea3e2ede2490b963de16453e2ad9e [id=c34177c45eda4d9e892e77cc723efbf1]
I20260810 13:54:33.981909 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]
I20260810 13:54:33.983405 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_ecb9a9595610488796d066d45e53880a [id=c478e4b06e604e5d8277d76680a5e8f8]
I20260810 13:54:33.944294 13638 raft_consensus.cc:359] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.985538 13638 raft_consensus.cc:385] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:33.985934 13638 raft_consensus.cc:740] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:33.986610 13638 consensus_queue.cc:260] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:33.989342 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]
I20260810 13:54:33.990696 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_d3680fc81fed4821bc9a2eccc77c35d8 [id=c9181e9bcc3546a5ac7aed13b663deaa]
I20260810 13:54:33.998049 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_70a5ed6b181b4db1ae5c28b4b6ca4553 [id=c93d3c57643543cda0f021e1171b3365]
I20260810 13:54:34.007829 13639 raft_consensus.cc:359] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:34.019843 13113 debug-util.cc:398] Leaking SignalData structure 0x7b0800163ce0 after lost signal to thread 12903
W20260810 13:54:34.021071 13113 debug-util.cc:398] Leaking SignalData structure 0x7b0800153440 after lost signal to thread 13119
I20260810 13:54:34.012974 13639 raft_consensus.cc:385] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:34.021405 13113 debug-util.cc:398] Leaking SignalData structure 0x7b080017fa00 after lost signal to thread 17073
I20260810 13:54:34.021458 13639 raft_consensus.cc:740] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:34.029633 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e0bb4403efd84db5ac45ace77b9b1a90 [id=c9ebbfcd82964aa798abcf82aaf3e881]
I20260810 13:54:34.029470 13638 ts_tablet_manager.cc:1434] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.130s user 0.004s sys 0.005s
I20260810 13:54:34.045135 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]
I20260810 13:54:34.047854 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f [id=cb722d559fe647018b6c959f6a93a037]
I20260810 13:54:34.061319 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c]
I20260810 13:54:34.063611 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_890e94f5e2914f4e9e3994ab8bc4075c [id=d08463e955564de898a2af8457a26457]
I20260810 13:54:34.064946 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2da57f87f29a425dbef85d4f4db4bc26 [id=d3522604bed74abf8b357894ca97ddad]
I20260810 13:54:34.069028 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]
I20260810 13:54:34.078061 13640 tablet_bootstrap.cc:654] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:34.081837 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_278ad8ed658b48d28fcc3aa3eec747b0 [id=d585e61cb61a4312ba2dbadbcae39899]
I20260810 13:54:34.083766 17176 raft_consensus.cc:493] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:34.084302 17176 raft_consensus.cc:515] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.086391 17176 leader_election.cc:290] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:34.088064 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]
I20260810 13:54:34.094269 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_78c6761fe1e748bf8bea32e7a13650f3 [id=d855b11b57bd447a9285b0945f28219d]
I20260810 13:54:34.095671 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 [id=d8943f60b8e3464087c954a42ff795ba]
I20260810 13:54:34.097739 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_8a8233c099eb45dba66c3d0f9bdbe18b [id=d9a327f6557d42bb998964e1d594cb1c]
I20260810 13:54:34.106993 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fe8abad5649f2a42686c00148d957" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:34.107609 13050 raft_consensus.cc:2468] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:34.109047 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_2ca2243ef2fe4479bb1edec0046866b9 [id=d9cc836fbee549a08553ed113e483bf6]
I20260810 13:54:34.112987 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67]
I20260810 13:54:34.114252 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b6a730448efc42958de4f9513cbd365b [id=dbf489131f724a7b85f1bac4f9e3e614]
I20260810 13:54:34.023149 13639 consensus_queue.cc:260] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.115068 16911 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:34.115681 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_071663fc830e44ef9d25a38fc8301ba7 [id=dd579b0cb2684ce08640cf4f5edae65c]
I20260810 13:54:34.115525 16911 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.118796 16911 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:34.119894 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb [id=dea63931a83f494b8fa574685cd4ff24]
I20260810 13:54:34.125387 13640 tablet_bootstrap.cc:492] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:34.125838 13640 ts_tablet_manager.cc:1403] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.179s user 0.007s sys 0.007s
I20260810 13:54:34.127833 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]
I20260810 13:54:34.133504 13639 ts_tablet_manager.cc:1434] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.178s user 0.011s sys 0.000s
I20260810 13:54:34.134531 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_9d81870e910444848f2c714a1b9da18c [id=e506f8a07858485398058c93c553f904]
I20260810 13:54:34.134905 13639 tablet_bootstrap.cc:492] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:34.137372 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]
I20260810 13:54:34.143077 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 [id=e992c0b15e564af7a0722b50e969adf4]
I20260810 13:54:34.143298 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:34.143877 13056 raft_consensus.cc:2468] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:34.148752 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]
I20260810 13:54:34.154662 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]
I20260810 13:54:34.156011 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_dd910306a7864aeb9230c62730dc3ff4 [id=ee077cecabdd48809356d55acc5604a6]
I20260810 13:54:34.128396 13640 raft_consensus.cc:359] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.157310 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_df8743b260984398bf1a3a7c1ee5c4a2 [id=f01c22584d5f4cb696573d09deec464e]
I20260810 13:54:34.162729 13640 raft_consensus.cc:385] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:34.163028 13640 raft_consensus.cc:740] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:34.163980 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_4f7895e8b4164093b5fa194d7f828d2a [id=f492b2e2f4cf4205a7d147ddad56af40]
I20260810 13:54:34.163661 13640 consensus_queue.cc:260] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.165354 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_699797a1320b40709d0bf25947241900 [id=f656a6598c1145d89230d014ba6873a6]
I20260810 13:54:34.166554 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 [id=f6ba2bd3294c4b49a617aee9388a1248]
I20260810 13:54:34.167723 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_08e421ad9e1d4274b11c4cb314c36201 [id=f7546e5fae5641d0b1747c71934496ec]
I20260810 13:54:34.173080 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_229c64c5f5804f6c8a3047ec7858322b [id=f8aaac66943a4d9d8d2bf15d12a18009]
I20260810 13:54:34.181736 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:34.182337 13056 raft_consensus.cc:2468] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:34.183456 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_356ec0418a38420d8a4e18b2f69682c3 [id=f8b08e6c518647d194daba555502622a]
I20260810 13:54:34.184584 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:34.184937 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_e4f9174b7de74fd79642def9d4d0fffd [id=f8ba71724c3f4068a8377462165aee32]
I20260810 13:54:34.187814 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb]
I20260810 13:54:34.189085 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_7c263dc08783483d941121c9c3cafdc6 [id=fc5a0ae7f9074bfc89acd9077b020821]
I20260810 13:54:34.190377 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]
I20260810 13:54:34.191710 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_5967f54814d04534b6a591a3bf9a4e8e [id=fd3f5c353a584a6b9d955543762bb8c6]
I20260810 13:54:34.190439 13640 ts_tablet_manager.cc:1434] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.064s user 0.008s sys 0.000s
I20260810 13:54:34.195731 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a34a40f45be7413bb670738c4199fa50 [id=fd9cae2939d9440b92dc923383e5839c]
I20260810 13:54:34.197036 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_86221744224e4ac4aeebf77dbd274d49 [id=fe2f8409777b4c94b59159a106e77e7f]
I20260810 13:54:34.205762 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]
I20260810 13:54:34.207736 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_a232694e27574131946f967d95a292f4 [id=fec6784b9d334a72907abaf252914033]
I20260810 13:54:34.209173 16116 catalog_manager.cc:679] Loaded metadata for table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]
I20260810 13:54:34.240334 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:34.241017 13467 raft_consensus.cc:2468] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:34.243196 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:34.244033 13467 raft_consensus.cc:2468] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:34.267638 13639 tablet_bootstrap.cc:654] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:34.283026 13640 tablet_bootstrap.cc:492] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:34.288614 13640 tablet_bootstrap.cc:654] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:34.296263 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:34.301015 12952 leader_election.cc:304] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:34.302775 17052 raft_consensus.cc:2804] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:34.303263 17052 raft_consensus.cc:697] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:34.304132 17052 consensus_queue.cc:237] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.308899 16116 tablet_loader.cc:96] loaded metadata for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085])
I20260810 13:54:34.311568 17144 raft_consensus.cc:493] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:34.312052 17144 raft_consensus.cc:515] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.313941 17144 leader_election.cc:290] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:34.320331 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fe8abad5649f2a42686c00148d957" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:34.320874 13480 raft_consensus.cc:2468] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:34.321617 17177 consensus_queue.cc:1048] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:34.322893 16116 tablet_loader.cc:96] loaded metadata for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd])
I20260810 13:54:34.346892 16116 tablet_loader.cc:96] loaded metadata for tablet 01d42c8476514b71af3ce2fbc12270d0 (table default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad])
I20260810 13:54:34.347988 13639 tablet_bootstrap.cc:492] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:34.313090 13164 leader_election.cc:304] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:34.348425 13639 ts_tablet_manager.cc:1403] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.214s user 0.011s sys 0.000s
I20260810 13:54:34.348819 16116 tablet_loader.cc:96] loaded metadata for tablet 01f616bc07234fa2a454811e75a1aec2 (table default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 [id=7a8b712d0b1a4766ab00cd2c4739c311])
I20260810 13:54:34.356565 16116 tablet_loader.cc:96] loaded metadata for tablet 049416892e964159a06d5817932bbd7a (table default.Table_612d612a32794a8998dd3a19129b79c3 [id=840614d5bd744a82bf94fd2f23a31d69])
I20260810 13:54:34.357887 16116 tablet_loader.cc:96] loaded metadata for tablet 058562eef38d46a8a3a39e3ce5425dd6 (table default.Table_9d81870e910444848f2c714a1b9da18c [id=e506f8a07858485398058c93c553f904])
I20260810 13:54:34.362161 16116 tablet_loader.cc:96] loaded metadata for tablet 07405ca45a9c4575bc653c2dd95fea6b (table default.Table_356ec0418a38420d8a4e18b2f69682c3 [id=f8b08e6c518647d194daba555502622a])
I20260810 13:54:34.377051 13638 tablet_bootstrap.cc:492] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:34.383606 16116 tablet_loader.cc:96] loaded metadata for tablet 094a3448b54c409281c31813e60dcb7f (table default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6])
I20260810 13:54:34.385187 16116 tablet_loader.cc:96] loaded metadata for tablet 09d572e2dc764d259df43026f49e0831 (table default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 [id=7b407001f6d54bd2929f1f0d141b065e])
I20260810 13:54:34.385584 13639 raft_consensus.cc:359] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.393869 16116 tablet_loader.cc:96] loaded metadata for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c])
I20260810 13:54:34.396040 16116 tablet_loader.cc:96] loaded metadata for tablet 0d147e624d4243b9b330c874e0f27f6c (table default.Table_213c40da56b549d3bb97fccaa8f872cd [id=8bb576bce14b4fc3b1848496c6081841])
I20260810 13:54:34.399330 17136 raft_consensus.cc:493] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:34.399362 17144 raft_consensus.cc:493] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:34.399921 16761 raft_consensus.cc:493] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:34.400003 17144 raft_consensus.cc:515] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.399981 17136 raft_consensus.cc:515] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.400417 16761 raft_consensus.cc:515] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.402047 17144 leader_election.cc:290] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:34.402129 16761 leader_election.cc:290] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:34.402218 17136 leader_election.cc:290] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:34.403254 17136 raft_consensus.cc:493] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:34.403707 17136 raft_consensus.cc:515] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.405751 17136 leader_election.cc:290] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:34.411443 16116 tablet_loader.cc:96] loaded metadata for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb])
I20260810 13:54:34.418154 13640 tablet_bootstrap.cc:492] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:34.418627 13640 ts_tablet_manager.cc:1403] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.136s user 0.010s sys 0.001s
I20260810 13:54:34.389156 13639 raft_consensus.cc:385] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:34.428979 13639 raft_consensus.cc:740] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:34.429733 13639 consensus_queue.cc:260] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.441335 16116 tablet_loader.cc:96] loaded metadata for tablet 121d7abf368a4cf99fd045b8c8ba4b69 (table default.Table_1efc108552b047538e81a19f9d985680 [id=b0c2c10c7abb49c0b0026662e9edba2a])
I20260810 13:54:34.448808 16116 tablet_loader.cc:96] loaded metadata for tablet 146ff83104d247cfa565cec8579ca00f (table default.Table_7cf74351dd314634a7a8ca1b1a24302b [id=884f2bca73394b0b97902104a5b68976])
I20260810 13:54:34.456727 16116 tablet_loader.cc:96] loaded metadata for tablet 14a19e0d12cf4582b0b5ec5c2fa25f49 (table default.Table_23cb4b4f896b48b1adc91079a7382c5c [id=a32ace7c7992464c8a5ef3f8169906b6])
W20260810 13:54:34.443436 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 101070us
I20260810 13:54:34.463982 17160 raft_consensus.cc:493] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:34.467620 16116 tablet_loader.cc:96] loaded metadata for tablet 14e68b57d7fb40cd8430144733749c21 (table default.Table_40e69780eeb744aa8a192c8623bc7d4b [id=2ef48298f4404224bb44136ff71befd8])
I20260810 13:54:34.466986 17160 raft_consensus.cc:515] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.470525 17160 leader_election.cc:290] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:34.474465 17198 raft_consensus.cc:2749] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:34.470810 16116 tablet_loader.cc:96] loaded metadata for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_a49a2f11e36d4162bc5847bacee456e7 [id=8aad892ad49f4c0aa7681d88843d3561])
I20260810 13:54:34.477845 16116 tablet_loader.cc:96] loaded metadata for tablet 15857ead4a9a48c49b4acea92d4bba60 (table default.Table_2da57f87f29a425dbef85d4f4db4bc26 [id=d3522604bed74abf8b357894ca97ddad])
I20260810 13:54:34.479525 13639 ts_tablet_manager.cc:1434] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.131s user 0.009s sys 0.000s
I20260810 13:54:34.490761 16116 tablet_loader.cc:96] loaded metadata for tablet 1946995eb9354e19916f31e1f8e46996 (table default.Table_b6a730448efc42958de4f9513cbd365b [id=dbf489131f724a7b85f1bac4f9e3e614])
I20260810 13:54:34.501777 16116 tablet_loader.cc:96] loaded metadata for tablet 1956edd131c14f93994b5d9f2a7420b1 (table default.Table_72e9522a295642b28aa17f724e010d9e [id=143a3ec1ee2d409fa9de19aa1c8c8ab3])
I20260810 13:54:34.513686 16116 tablet_loader.cc:96] loaded metadata for tablet 19fe94b1d72b4bb29f0154f58c9fa43f (table default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9])
I20260810 13:54:34.515097 16116 tablet_loader.cc:96] loaded metadata for tablet 1a0f39d7fa7e4cac9dda6ec101229efd (table default.Table_131ccf6f50394a4facf6e622d5449b17 [id=b559d903254d433989a2deb00eb27361])
I20260810 13:54:34.518095 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:34.518626 13467 raft_consensus.cc:2468] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:34.518857 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:34.519421 13474 raft_consensus.cc:2468] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:34.522416 16116 tablet_loader.cc:96] loaded metadata for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e])
I20260810 13:54:34.531713 16116 tablet_loader.cc:96] loaded metadata for tablet 1a7fb49228fa4a0c8d28a4ed0a4ae180 (table default.Table_2ca2243ef2fe4479bb1edec0046866b9 [id=d9cc836fbee549a08553ed113e483bf6])
I20260810 13:54:34.539774 13640 raft_consensus.cc:359] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.540474 13640 raft_consensus.cc:385] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:34.540750 13640 raft_consensus.cc:740] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:34.541955 16116 tablet_loader.cc:96] loaded metadata for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6])
I20260810 13:54:34.549562 16116 tablet_loader.cc:96] loaded metadata for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc])
I20260810 13:54:34.562609 16116 tablet_loader.cc:96] loaded metadata for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e])
I20260810 13:54:34.572791 16116 tablet_loader.cc:96] loaded metadata for tablet 1c68d8171bf847eab37c505640b831fc (table default.Table_df8743b260984398bf1a3a7c1ee5c4a2 [id=f01c22584d5f4cb696573d09deec464e])
I20260810 13:54:34.574854 16116 tablet_loader.cc:96] loaded metadata for tablet 1ee6e694366543328526313d7018b5db (table default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9])
I20260810 13:54:34.592967 16116 tablet_loader.cc:96] loaded metadata for tablet 213e54b67ee94d299345a3d1eabc9ae6 (table default.Table_88dee97116de4d0dac8a7af552b06f14 [id=0b34e431b94a4d24ad26858d4630420f])
I20260810 13:54:34.594182 16116 tablet_loader.cc:96] loaded metadata for tablet 21e31826c3a94981b6a47bf9feee9f83 (table default.Table_d21ea3e2ede2490b963de16453e2ad9e [id=c34177c45eda4d9e892e77cc723efbf1])
I20260810 13:54:34.596019 16116 tablet_loader.cc:96] loaded metadata for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607])
W20260810 13:54:34.546617 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 87094.8us
I20260810 13:54:34.553418 13638 tablet_bootstrap.cc:654] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:34.601068 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 288379us
I20260810 13:54:34.627502 16116 tablet_loader.cc:96] loaded metadata for tablet 26ca6ce1b13942f4af59ea1d38fd395c (table default.Table_734de53e103d480c93e2779ef687142e [id=23152d9b944747f89cd06ee3a569b5b3])
I20260810 13:54:34.630693 16116 tablet_loader.cc:96] loaded metadata for tablet 27036a9813b9404aa174f7af9d6e51e0 (table default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 [id=e992c0b15e564af7a0722b50e969adf4])
I20260810 13:54:34.637183 16116 tablet_loader.cc:96] loaded metadata for tablet 27649cff0c5f4e6783e8a2f0a1f847ae (table default.Table_1668535b5107458a842c0def2c55461f [id=0cdd1449d5734d559f49933deef6bb19])
I20260810 13:54:34.641741 16116 tablet_loader.cc:96] loaded metadata for tablet 288debea4aa045d1898483cde1d4d3b1 (table default.Table_a8f5484f0ff14287be783696e6d8525d [id=06f3859cd5e748a3800b66ecf0a93c28])
I20260810 13:54:34.649752 16116 tablet_loader.cc:96] loaded metadata for tablet 29ace970eee349d6b669b5c531f91c8b (table default.Table_5b39c1bb4b614f97ab6eb4d521628013 [id=b69ad2b0c70949b98192ae056eb2cab0])
I20260810 13:54:34.660364 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:34.663619 16116 tablet_loader.cc:96] loaded metadata for tablet 2b88b4fa155d4364b4fa1b2c724755bb (table default.Table_856a1bf64ef9498890c9b6d98edcc8ad [id=60b4f30b701344d79b0c64b4e8127dbd])
I20260810 13:54:34.669735 16116 tablet_loader.cc:96] loaded metadata for tablet 2be6cc62ea1e4299b8b243b70700d064 (table default.Table_def78e8fb6b74845bf2ef24bcef6691b [id=42af124147fe44c1875a9803af2e97a9])
I20260810 13:54:34.684274 16116 tablet_loader.cc:96] loaded metadata for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf])
I20260810 13:54:34.685702 16116 tablet_loader.cc:96] loaded metadata for tablet 2e5616cea29148a49ac6db261351f460 (table default.Table_5967f54814d04534b6a591a3bf9a4e8e [id=fd3f5c353a584a6b9d955543762bb8c6])
I20260810 13:54:34.541378 13640 consensus_queue.cc:260] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.694617 13638 tablet_bootstrap.cc:492] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:34.694865 16116 tablet_loader.cc:96] loaded metadata for tablet 2e5ad84fe2604dd2959768db31f66e7c (table default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0])
I20260810 13:54:34.695055 13638 ts_tablet_manager.cc:1403] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.319s user 0.015s sys 0.003s
I20260810 13:54:34.701658 16116 tablet_loader.cc:96] loaded metadata for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03])
I20260810 13:54:34.709857 16116 tablet_loader.cc:96] loaded metadata for tablet 3066b475871c45fdbe585947fd6800c9 (table default.Table_6c443ac64289437d8c7dcf5ea44469dd [id=9c99ad2364cc45fba0746cbae06deeeb])
I20260810 13:54:34.711110 16116 tablet_loader.cc:96] loaded metadata for tablet 30676a11ab60455aa4ccd22347beb80e (table default.Table_d8ab37a103a5426b81dcf295239ec9af [id=b7130fcdfcf54b76861fd9c87559beeb])
I20260810 13:54:34.711333 17201 consensus_queue.cc:1048] T 393e23a9c03049a280f3ef89bdca5011 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:34.713747 16116 tablet_loader.cc:96] loaded metadata for tablet 30a5adc9446543eb91f5a1c0f0859c31 (table default.Table_b33cb4c7a80141c49d306885213f30a9 [id=7dff57e81c064728a8160d5c02c11de5])
I20260810 13:54:34.717381 17201 consensus_queue.cc:1048] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:34.718345 13638 raft_consensus.cc:359] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.719045 13638 raft_consensus.cc:385] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:34.719352 13638 raft_consensus.cc:740] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:34.720057 13638 consensus_queue.cc:260] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.719103 16116 tablet_loader.cc:96] loaded metadata for tablet 30d9e5103fe644f38d969c64182f7cbb (table default.Table_215968e7ab2540ab8a35960795941543 [id=9bac646089c94e54b68ff14ce2a50793])
I20260810 13:54:34.725685 16116 tablet_loader.cc:96] loaded metadata for tablet 32905f89c1d3480abb007f8dd130e2de (table default.Table_7c263dc08783483d941121c9c3cafdc6 [id=fc5a0ae7f9074bfc89acd9077b020821])
I20260810 13:54:34.737607 17136 consensus_queue.cc:1048] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:34.739446 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 115530us
I20260810 13:54:34.743623 16116 tablet_loader.cc:96] loaded metadata for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef])
I20260810 13:54:34.759061 16116 tablet_loader.cc:96] loaded metadata for tablet 387ebbb8677c4fb082006585389c6582 (table default.Table_10638f441f654317829d436d2e7eb979 [id=4f21b5213a724ce5989d7684473d65e9])
W20260810 13:54:34.759479 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 48180.9us
I20260810 13:54:34.770223 13638 ts_tablet_manager.cc:1434] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.075s user 0.008s sys 0.001s
I20260810 13:54:34.771785 16116 tablet_loader.cc:96] loaded metadata for tablet 393e23a9c03049a280f3ef89bdca5011 (table default.Table_4f780597fcec4261acd040c8816826c4 [id=3e00d0fc074747809ebc1f6b3696649d])
I20260810 13:54:34.776229 16116 tablet_loader.cc:96] loaded metadata for tablet 39514e069d6841df9fced9e62981eac5 (table default.Table_f6d23e8eec824ef08b26dec8c7c6d010 [id=4d373c8f174b46e99209a83ab947b204])
I20260810 13:54:34.777535 13638 tablet_bootstrap.cc:492] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:34.801452 16116 tablet_loader.cc:96] loaded metadata for tablet 3b7b408a9ad34ea39c912b33e26b49b6 (table default.Table_029a3ba2ee734a729e84a4482938ed5b [id=b437e76811d440ca817fca27a8dcbd45])
I20260810 13:54:34.803488 16116 tablet_loader.cc:96] loaded metadata for tablet 419f1f8bae1c458f83d6be2978cb6ecc (table default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d])
I20260810 13:54:34.808610 16116 tablet_loader.cc:96] loaded metadata for tablet 41b258122c6e4de982cd95ec04ffc3ae (table default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 [id=f6ba2bd3294c4b49a617aee9388a1248])
I20260810 13:54:34.810185 13639 tablet_bootstrap.cc:492] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:34.811614 16116 tablet_loader.cc:96] loaded metadata for tablet 420ee600a4174916827aa7b64bbcd8d2 (table default.Table_86dcc5d091024407b7e167806ec593a3 [id=c07ecd00b44e49c9b0a32e8710373471])
I20260810 13:54:34.816231 13639 tablet_bootstrap.cc:654] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:34.818650 16116 tablet_loader.cc:96] loaded metadata for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd])
I20260810 13:54:34.821696 13638 tablet_bootstrap.cc:654] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:34.823526 16116 tablet_loader.cc:96] loaded metadata for tablet 45530faa785a4642b4efc18733d0d9b1 (table default.Table_8eeb870902124e9696cfa7e98dfa0e88 [id=614fbd4b5dd440cb8f5a6fa4d994266d])
I20260810 13:54:34.835932 13639 tablet_bootstrap.cc:492] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:34.836416 13639 ts_tablet_manager.cc:1403] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.007s
I20260810 13:54:34.839038 13639 raft_consensus.cc:359] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.839629 13639 raft_consensus.cc:385] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:34.839867 13639 raft_consensus.cc:740] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:34.841655 16116 tablet_loader.cc:96] loaded metadata for tablet 4687f8fd44034ce28727c3b7e58e7fe9 (table default.Table_bd734d41b4c04e8fae8551c8d2f341dc [id=5b4eac88920044a7ba18bf40b8783a9d])
I20260810 13:54:34.843602 16116 tablet_loader.cc:96] loaded metadata for tablet 4744dd484c3d4e0cb903840759ec532f (table default.Table_08e421ad9e1d4274b11c4cb314c36201 [id=f7546e5fae5641d0b1747c71934496ec])
I20260810 13:54:34.856665 16116 tablet_loader.cc:96] loaded metadata for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2])
W20260810 13:54:34.859622 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 82294.2us
I20260810 13:54:34.860841 13382 leader_election.cc:304] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:34.861802 17144 raft_consensus.cc:2804] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:34.862147 17144 raft_consensus.cc:493] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:34.862478 17144 raft_consensus.cc:3060] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:34.866151 16116 tablet_loader.cc:96] loaded metadata for tablet 48ff07074f4a4392adc6c3aa0360454f (table default.Table_da87a4b83c12422e999c5b88c825d890 [id=3064108a10bd4f76b2be6614ebed22fc])
I20260810 13:54:34.867901 16116 tablet_loader.cc:96] loaded metadata for tablet 49bf6a1f14bb4513b1addc4141b71373 (table default.Table_d4a38708152b4705af7eaf9af6ddc436 [id=5edfc8942f7145adae70b892942fbd64])
I20260810 13:54:34.873795 17144 raft_consensus.cc:515] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.877647 17144 leader_election.cc:290] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:34.877717 13639 consensus_queue.cc:260] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.879344 13639 ts_tablet_manager.cc:1434] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.043s user 0.004s sys 0.000s
I20260810 13:54:34.882964 13640 ts_tablet_manager.cc:1434] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.464s user 0.005s sys 0.007s
I20260810 13:54:34.883438 16116 tablet_loader.cc:96] loaded metadata for tablet 4bd68cdc1322448292c481925ad33c79 (table default.Table_278ad8ed658b48d28fcc3aa3eec747b0 [id=d585e61cb61a4312ba2dbadbcae39899])
I20260810 13:54:34.885426 16116 tablet_loader.cc:96] loaded metadata for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279])
I20260810 13:54:34.886628 13638 tablet_bootstrap.cc:492] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:34.887063 13638 ts_tablet_manager.cc:1403] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.113s user 0.005s sys 0.005s
W20260810 13:54:34.893589 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:34.893504 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:34.894335 13260 raft_consensus.cc:2393] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:34.892583 16116 tablet_loader.cc:96] loaded metadata for tablet 50d8651946d242feb9cf993aff99ba1b (table default.Table_2901b91576984ac4a165471a90e86a8b [id=a67f03853a964c2fbf175165ee422881])
I20260810 13:54:34.905786 16116 tablet_loader.cc:96] loaded metadata for tablet 515727ae51d94c009b4446c8b6e2c8f6 (table default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68])
I20260810 13:54:34.907021 16116 tablet_loader.cc:96] loaded metadata for tablet 51813605283e43f2b4efe6fb2fab652c (table default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d])
I20260810 13:54:34.908241 16116 tablet_loader.cc:96] loaded metadata for tablet 52900269b7f74b338d6f81480686a940 (table default.Table_ecb9a9595610488796d066d45e53880a [id=c478e4b06e604e5d8277d76680a5e8f8])
I20260810 13:54:34.915783 16116 tablet_loader.cc:96] loaded metadata for tablet 5577bf52bd794919986e2bfa3f708efb (table default.Table_a0e9339c31fa470380def2ad49326176 [id=3e51b3dca7144d7b8494e0a36e61706a])
I20260810 13:54:34.916889 16116 tablet_loader.cc:96] loaded metadata for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224])
I20260810 13:54:34.922300 13638 raft_consensus.cc:359] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.923341 13638 raft_consensus.cc:385] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:34.923724 13638 raft_consensus.cc:740] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:54:34.925473 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 63881.8us
I20260810 13:54:34.930301 16116 tablet_loader.cc:96] loaded metadata for tablet 5797a5de96ad4c3c80741e6673a8f194 (table default.Table_210fb0797673402e8e79fcf4e3c293b6 [id=aa1bdb6bb7c04faabb47c1552cc4aaff])
I20260810 13:54:34.931492 16116 tablet_loader.cc:96] loaded metadata for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d])
I20260810 13:54:34.932641 16116 tablet_loader.cc:96] loaded metadata for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f])
I20260810 13:54:34.936054 16116 tablet_loader.cc:96] loaded metadata for tablet 5e99055cb9814d4d9b22e7a99a9ca61e (table default.Table_4b2d4fca101f4cbc9f296c50ca183066 [id=35087d7e2d0642a59670773333dda055])
I20260810 13:54:34.943701 17177 raft_consensus.cc:493] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:34.944152 17177 raft_consensus.cc:515] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.947275 16116 tablet_loader.cc:96] loaded metadata for tablet 5f1df2c9593442afa84849da6874f0f4 (table default.Table_57828eb9ca764faf923e3e68fd0233a8 [id=3fff8bc92af84e59a10a592e85ad8503])
I20260810 13:54:34.947650 17177 leader_election.cc:290] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:34.948535 16116 tablet_loader.cc:96] loaded metadata for tablet 5f518df5c1414edba15ad72983c7f362 (table default.Table_fe0baa9629ad42fbb05cfbc004e62688 [id=907a4591204d4db697b44488fef76406])
I20260810 13:54:34.953133 13638 consensus_queue.cc:260] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:34.954890 13638 ts_tablet_manager.cc:1434] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.068s user 0.004s sys 0.004s
I20260810 13:54:34.960372 16116 tablet_loader.cc:96] loaded metadata for tablet 5f5cf3efa54b4344b04a87a87509d1f6 (table default.Table_e9bf94db05cb46279abaeba00681ab82 [id=a547ccb6c9c24877b0b8d81d52e1630a])
I20260810 13:54:34.961187 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fe8abad5649f2a42686c00148d957" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:34.961650 16116 tablet_loader.cc:96] loaded metadata for tablet 5f7cac512bcd48cfb6aaba4dc7e5681e (table default.Table_d460b63b63de413ebdeeb708b4be6b10 [id=3d7325460d7842658631298c2538a71c])
I20260810 13:54:34.962425 13240 raft_consensus.cc:3060] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:34.964287 16116 tablet_loader.cc:96] loaded metadata for tablet 6187783a473a42488fabf362f9a156cf (table default.Table_fd80397e5f4247339b3e3d483a671afa [id=3f7a51368fe34ca6b66f5c810e94ae60])
I20260810 13:54:34.966199 16116 tablet_loader.cc:96] loaded metadata for tablet 62aabe97aca9485fb2b40d67c989c210 (table default.Table_ee42df273bce4386bbf8edb282c2059a [id=8d115ba01bfd4ed7b90f6531e9ef66c2])
W20260810 13:54:34.991978 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 65804.1us
I20260810 13:54:35.008183 13382 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:35.010190 17221 raft_consensus.cc:2804] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:35.010557 17221 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:35.010885 17221 raft_consensus.cc:3060] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:35.019825 16116 tablet_loader.cc:96] loaded metadata for tablet 62e88a52755140019a6d9f7041db0837 (table default.Table_9f48e93a010b4fc5b43124a1f8248ddf [id=011f63bf5ea44f918070a9ead229fa95])
I20260810 13:54:35.020435 17221 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.027945 17211 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:35.029241 16116 tablet_loader.cc:96] loaded metadata for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5])
I20260810 13:54:35.028571 17211 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.031412 17211 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.034780 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:35.035535 13245 raft_consensus.cc:2468] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:35.037068 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:35.037917 13240 raft_consensus.cc:2468] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
W20260810 13:54:35.042963 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 65913.9us
I20260810 13:54:35.043494 16116 tablet_loader.cc:96] loaded metadata for tablet 67ec9aba240b49e6a78c268b20dc901b (table default.Table_32a20912aef145aabc1b19b2b796c682 [id=6180bc58d52049fa82f92dc5e5a6b891])
I20260810 13:54:35.044703 16116 tablet_loader.cc:96] loaded metadata for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f])
I20260810 13:54:35.051978 16116 tablet_loader.cc:96] loaded metadata for tablet 6ad53d1da7b34194b4b7a78c52870c6b (table default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 [id=766aaf50fb2f4fbca53416a8e853f9c1])
I20260810 13:54:35.053933 16116 tablet_loader.cc:96] loaded metadata for tablet 6d19fba564324475a790174b4033ab1b (table default.Table_eebc498aa5734ab8b23c00b74d896ba9 [id=9756f3d17c15460e84863e49504d8349])
I20260810 13:54:35.055080 16116 tablet_loader.cc:96] loaded metadata for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64])
W20260810 13:54:35.061743 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 53638us
I20260810 13:54:35.062662 17136 raft_consensus.cc:493] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:35.063267 17136 raft_consensus.cc:515] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.065382 17136 leader_election.cc:290] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.056187 16116 tablet_loader.cc:96] loaded metadata for tablet 6ec1f506c6cd4222b4bd6176ccd54e56 (table default.Table_e16662a9b5514b04b2d2fad48ad3d82f [id=51cc3d6cb6d248fc94d93654adfc72c0])
I20260810 13:54:35.073829 16116 tablet_loader.cc:96] loaded metadata for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a])
I20260810 13:54:35.075035 16116 tablet_loader.cc:96] loaded metadata for tablet 73749dd3ba784553b316d2f70ae34073 (table default.Table_0cd1166b3e534639918d41544e409ec7 [id=631d4e81ac6b445183e988a0821e0e61])
I20260810 13:54:35.076180 16116 tablet_loader.cc:96] loaded metadata for tablet 73a7e7c310e24d8caca5756fe67631ce (table default.Table_3c8a09c1dfda4797918bd6715bdfebce [id=9656e3a9a8f6431cb7b42ea64ae16159])
I20260810 13:54:35.078037 16116 tablet_loader.cc:96] loaded metadata for tablet 73bc868e3bba4d8c80ac234e4be6b3a4 (table default.Table_7e2df1474a324a139e9e31ca581a4f34 [id=5b1484c8fdc64ee6a07bd203fa140fcb])
I20260810 13:54:35.079149 16116 tablet_loader.cc:96] loaded metadata for tablet 73c03f98d7804d22acbba72da63c121b (table default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c])
I20260810 13:54:35.080263 16116 tablet_loader.cc:96] loaded metadata for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311])
I20260810 13:54:35.093647 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:35.099642 16116 tablet_loader.cc:96] loaded metadata for tablet 7529b349395a42ec96c7816f9e566079 (table default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 [id=7a54639f4e1a4f1a82278d5d64b347b8])
I20260810 13:54:35.100672 17210 consensus_queue.cc:1048] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:35.101699 16116 tablet_loader.cc:96] loaded metadata for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa])
I20260810 13:54:35.102843 16116 tablet_loader.cc:96] loaded metadata for tablet 760914a47cc744b7bdf3b40a85b3369c (table default.Table_7cbcdca887724284a33c681c9574ea82 [id=8a8a45a7ac264648b3810d9c69a36751])
I20260810 13:54:35.103822 16116 tablet_loader.cc:96] loaded metadata for tablet 7685f9b4b25541d98cfdaba36cd0276c (table default.Table_f0a8373b96114e0c896e54dcb940f74d [id=0c70c375ac604d158df38f374fc3c1d1])
I20260810 13:54:35.104943 16116 tablet_loader.cc:96] loaded metadata for tablet 7800f588f3d64230b759c8814d169dbe (table default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 [id=3fa9cd2a62034a4d81a0b740d5c31447])
I20260810 13:54:35.106069 16116 tablet_loader.cc:96] loaded metadata for tablet 788ac374894c437fa8644493b7678747 (table default.Table_c752da6252ce4541be9cef2bce47bfe3 [id=178f273145a74eb2a2de7da53f248126])
I20260810 13:54:35.107213 16116 tablet_loader.cc:96] loaded metadata for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343])
I20260810 13:54:35.108168 16116 tablet_loader.cc:96] loaded metadata for tablet 7967a22850ae48a58fbcb8cb17f189e9 (table default.Table_d5c509cabbb84883a9a911c2f4e04c88 [id=865c0ec036ca45caaec23fe2cf899d1d])
I20260810 13:54:35.120932 17118 consensus_queue.cc:1048] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:35.134883 13639 tablet_bootstrap.cc:492] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:35.136785 16116 tablet_loader.cc:96] loaded metadata for tablet 7a07cf0ebb0f4bc6816c119a4b2af17f (table default.Table_51b05316075a49bc898ede0e35031c70 [id=359af78e1c844299a56756c90613d641])
I20260810 13:54:35.138660 16116 tablet_loader.cc:96] loaded metadata for tablet 7a5114911fdf4b19afec0c71ded5ef9a (table default.Table_8a8233c099eb45dba66c3d0f9bdbe18b [id=d9a327f6557d42bb998964e1d594cb1c])
I20260810 13:54:35.140960 16116 tablet_loader.cc:96] loaded metadata for tablet 7a7bddc8e6374437a37aeb755389d91f (table default.Table_3ffb4babc30c4b76ae97168cb6dbdeee [id=66920d867573408d811d1fa6b877d355])
I20260810 13:54:35.141235 13639 tablet_bootstrap.cc:654] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:35.142108 16116 tablet_loader.cc:96] loaded metadata for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480])
I20260810 13:54:35.147295 16116 tablet_loader.cc:96] loaded metadata for tablet 7ca9ab174bc8461a9fccdc7a7d11b486 (table default.Table_230d8010fef046048e532692ee7681c8 [id=01dba6a69dec44aeb2f402dddb3e0cae])
I20260810 13:54:35.152132 16116 tablet_loader.cc:96] loaded metadata for tablet 815f4333c441441ca8e857df66a0263e (table default.Table_8606de06b2994b3291a5ee1e28ad7100 [id=7162bee4392749a38057f272df172987])
W20260810 13:54:35.152628 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 52138.4us
I20260810 13:54:35.153468 13382 leader_election.cc:304] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:35.154387 17210 raft_consensus.cc:2804] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:35.154775 17210 raft_consensus.cc:493] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:35.155154 17210 raft_consensus.cc:3060] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:35.156481 17118 raft_consensus.cc:493] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:35.156980 17118 raft_consensus.cc:515] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.159052 17118 leader_election.cc:290] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:35.169524 12952 leader_election.cc:343] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:35.170972 16116 tablet_loader.cc:96] loaded metadata for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_96cdf642a68642ce9fe947569577b42a [id=667ccf7ba20c49b2be82e167aa212ecd])
I20260810 13:54:35.170895 17118 consensus_queue.cc:1048] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:35.171360 12952 leader_election.cc:343] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:35.172264 16116 tablet_loader.cc:96] loaded metadata for tablet 82848ef8dc904879854929de47db1e50 (table default.Table_229c64c5f5804f6c8a3047ec7858322b [id=f8aaac66943a4d9d8d2bf15d12a18009])
I20260810 13:54:35.173492 16116 tablet_loader.cc:96] loaded metadata for tablet 82fde417598648968b4013c54f0bc854 (table default.Table_8054f93e82de4c898987acb86f25e5d0 [id=0685b3b0945a493db836d29e5993e447])
I20260810 13:54:35.174630 16116 tablet_loader.cc:96] loaded metadata for tablet 82fe5ef58d9a49389a201ea7c51faad5 (table default.Table_77e30d5f98584b9e9711faa0b7a824df [id=6afc4e9a485640dda167bbaa0d6b347e])
I20260810 13:54:35.175733 16116 tablet_loader.cc:96] loaded metadata for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b])
I20260810 13:54:35.176903 16116 tablet_loader.cc:96] loaded metadata for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751])
I20260810 13:54:35.177035 13638 tablet_bootstrap.cc:492] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:35.183408 13638 tablet_bootstrap.cc:654] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:35.184253 16116 tablet_loader.cc:96] loaded metadata for tablet 8473def35a97492a9172b483c2d670d9 (table default.Table_312808fed3bf45e8923e2b1be7f4d9fa [id=4de804595a6142819c0ea2f64fd1e34c])
W20260810 13:54:35.190784 13382 leader_election.cc:343] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:35.022956 17221 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.197444 17118 consensus_queue.cc:1048] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:35.199113 16116 tablet_loader.cc:96] loaded metadata for tablet 8d860c257b794cce8f215ca7e871d6b0 (table default.Table_004ad2bd15214f94a0c183ec75f725ca [id=240ee1976c8f40c59438f7f22839e297])
I20260810 13:54:35.209235 13640 tablet_bootstrap.cc:492] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:35.209875 16116 tablet_loader.cc:96] loaded metadata for tablet 8e11d3197c5146e19dcbc2ca5015d224 (table default.Table_dd910306a7864aeb9230c62730dc3ff4 [id=ee077cecabdd48809356d55acc5604a6])
I20260810 13:54:35.210565 13639 tablet_bootstrap.cc:492] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:35.211066 13639 ts_tablet_manager.cc:1403] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.076s user 0.011s sys 0.001s
I20260810 13:54:35.211068 16116 tablet_loader.cc:96] loaded metadata for tablet 8e82c1366b534a11b7d615c3602406af (table default.Table_9ec2734c1c43472ca16731c99911a350 [id=b5072df8be3e4cc58980380d089942e2])
I20260810 13:54:35.215135 16116 tablet_loader.cc:96] loaded metadata for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_383bd937c51942a1b124430d2b5086af [id=82f67714ca3b4e6aab8557bd0f53d264])
I20260810 13:54:35.215372 13640 tablet_bootstrap.cc:654] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:35.218987 16116 tablet_loader.cc:96] loaded metadata for tablet 9334ba72cfd94fa4a7062a29445c69f9 (table default.Table_276835c42e5a48309351dd4e441cc62f [id=4d5771db00ae42b9957c6453d83f81ae])
I20260810 13:54:35.223615 16116 tablet_loader.cc:96] loaded metadata for tablet 9467e5c106b14619a7bf1f3e1f4f9c72 (table default.Table_6d071c01702c4d3cb0e693f02ef8a90f [id=20edfa4b7c00446bae121b000f8faf5f])
I20260810 13:54:35.233760 16116 tablet_loader.cc:96] loaded metadata for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582])
I20260810 13:54:35.236749 16116 tablet_loader.cc:96] loaded metadata for tablet 95ad70febdef4f59b252bc5f1bf6d25e (table default.Table_ea7f41d802964936a967be553d7418fe [id=96574627e23442ebb0323b065423efae])
I20260810 13:54:35.241710 16116 tablet_loader.cc:96] loaded metadata for tablet 96f66a5c6837404b96e1937a73aa1f19 (table default.Table_dfe0fd41b106448e8a729e593ac63e5a [id=342af46254364715a3eb6166299c7275])
I20260810 13:54:35.251039 16116 tablet_loader.cc:96] loaded metadata for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe])
I20260810 13:54:35.253000 17118 consensus_queue.cc:1048] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:35.254211 16116 tablet_loader.cc:96] loaded metadata for tablet 97127b08237c4d2e81f9966db12d3fdb (table default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1])
I20260810 13:54:35.255522 13638 tablet_bootstrap.cc:492] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:35.255968 13638 ts_tablet_manager.cc:1403] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.079s user 0.012s sys 0.001s
I20260810 13:54:35.255513 16116 tablet_loader.cc:96] loaded metadata for tablet 9752c50dac794b3f9e6430e982d9cbe2 (table default.Table_f835565354f042368700f4252335e8eb [id=84ca48404db8439697f8035aa3bc34d3])
I20260810 13:54:35.265935 16116 tablet_loader.cc:96] loaded metadata for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e])
I20260810 13:54:35.266412 12951 leader_election.cc:304] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:35.267409 17118 raft_consensus.cc:2804] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:35.268532 17118 raft_consensus.cc:493] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:35.268931 17118 raft_consensus.cc:3060] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:35.272377 16116 tablet_loader.cc:96] loaded metadata for tablet 98ce3cccca464b938fd45afe292b4ad8 (table default.Table_4f7895e8b4164093b5fa194d7f828d2a [id=f492b2e2f4cf4205a7d147ddad56af40])
I20260810 13:54:35.275357 16116 tablet_loader.cc:96] loaded metadata for tablet 9b1cfcc6b1834ebbb0d5cd4a7967e2cd (table default.Table_51d643dcb2a5451e9cff367f2b3649c5 [id=46372d6eedfe4d56b2f2ce9a85f7f1fc])
I20260810 13:54:35.276631 16116 tablet_loader.cc:96] loaded metadata for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1])
I20260810 13:54:35.283840 16116 tablet_loader.cc:96] loaded metadata for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3])
I20260810 13:54:35.285245 16116 tablet_loader.cc:96] loaded metadata for tablet 9f3485a1b77a4b80acbf48de92b5cf33 (table default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 [id=d8943f60b8e3464087c954a42ff795ba])
I20260810 13:54:35.285173 13639 raft_consensus.cc:359] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.286054 13639 raft_consensus.cc:385] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:35.286332 13639 raft_consensus.cc:740] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:35.287063 13639 consensus_queue.cc:260] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.288131 17210 raft_consensus.cc:515] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.289109 13639 ts_tablet_manager.cc:1434] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.078s user 0.006s sys 0.000s
I20260810 13:54:35.287626 16116 tablet_loader.cc:96] loaded metadata for tablet 9f3e50e523354dd7898ff1768ae824bb (table default.Table_54ea5af3ae44427eb0031a29dd62e663 [id=834d810fa56c49de9d97b91dabab82f1])
I20260810 13:54:35.290287 17210 leader_election.cc:290] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.291481 16116 tablet_loader.cc:96] loaded metadata for tablet a008d393fcdf441eb17dbe0c1fa2393f (table default.Table_78c6761fe1e748bf8bea32e7a13650f3 [id=d855b11b57bd447a9285b0945f28219d])
I20260810 13:54:35.293229 17221 raft_consensus.cc:493] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:35.293720 17221 raft_consensus.cc:515] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.294999 17211 raft_consensus.cc:493] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:35.295682 17221 leader_election.cc:290] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.295476 17211 raft_consensus.cc:515] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.296191 17221 raft_consensus.cc:493] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:35.296628 17221 raft_consensus.cc:515] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:35.297264 16116 tablet_loader.cc:96] loaded metadata for tablet a04498da4fce45bb9a906e75594a023f (table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f])
I20260810 13:54:35.297338 17211 leader_election.cc:290] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.298476 17221 leader_election.cc:290] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.299870 16116 tablet_loader.cc:96] loaded metadata for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_cc339254bace4b5e87544b721a6493a5 [id=685e6bce7ba5467693e2b0e1c739897b])
I20260810 13:54:35.302145 12951 leader_election.cc:304] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:35.302927 17177 raft_consensus.cc:2804] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:35.303246 17177 raft_consensus.cc:493] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:35.303555 17177 raft_consensus.cc:3060] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:35.305814 16116 tablet_loader.cc:96] loaded metadata for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee])
I20260810 13:54:35.306995 13640 tablet_bootstrap.cc:492] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:35.307493 13640 ts_tablet_manager.cc:1403] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.098s user 0.008s sys 0.002s
I20260810 13:54:35.307940 16116 tablet_loader.cc:96] loaded metadata for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055])
I20260810 13:54:35.312707 17177 raft_consensus.cc:515] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.315985 17177 leader_election.cc:290] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:35.321878 16116 tablet_loader.cc:96] loaded metadata for tablet a2a2e00edb244e54b04a511dd0e76c9f (table default.Table_5022f9898a2b4343b457ad28e07a933f [id=a31aa9b4d20f46b4bd283aca2d2b446c])
I20260810 13:54:35.323320 16116 tablet_loader.cc:96] loaded metadata for tablet a4159387c6364989bc5f8bfef7f8458c (table default.Table_e9c73c2f54b54ea485cdcadc15b0a420 [id=41772225716845f794c8c7d1ab21fd32])
I20260810 13:54:35.324676 16116 tablet_loader.cc:96] loaded metadata for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970])
W20260810 13:54:35.326574 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:35.328526 16116 tablet_loader.cc:96] loaded metadata for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7])
W20260810 13:54:35.339143 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 84141.5us
I20260810 13:54:35.343080 16116 tablet_loader.cc:96] loaded metadata for tablet a46ee6471e914b63afddc7d6dc967b9a (table default.Table_921fde42e0214ef58181c03785687004 [id=828ce62882b949d6887e75923229655e])
I20260810 13:54:35.345422 16116 tablet_loader.cc:96] loaded metadata for tablet a4b1451bb8254fcb8c507a837d6b2fa4 (table default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4])
I20260810 13:54:35.346822 16116 tablet_loader.cc:96] loaded metadata for tablet a4cca967e70b4164ba13c139d9610c73 (table default.Table_5388dd61e30949a5a2b9c07a35637080 [id=9fe82107b8344dfdae308a0d7091488d])
I20260810 13:54:35.347054 13638 raft_consensus.cc:359] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.347846 13638 raft_consensus.cc:385] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:35.348217 13638 raft_consensus.cc:740] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:35.348908 13638 consensus_queue.cc:260] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.351389 13638 ts_tablet_manager.cc:1434] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.095s user 0.003s sys 0.003s
I20260810 13:54:35.354604 17221 raft_consensus.cc:493] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:35.352506 16116 tablet_loader.cc:96] loaded metadata for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_ed026dd607ea4b2e8b1f22bee438879d [id=5b919872756647048ea2e4fecbe78537])
I20260810 13:54:35.355145 17221 raft_consensus.cc:515] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.356732 16116 tablet_loader.cc:96] loaded metadata for tablet a75054766c894d78bfa6d7f565700dce (table default.Table_83164f9e96c540f58a5af47229b70854 [id=3f7f1db8228e4efa9b34bc33cb13be40])
I20260810 13:54:35.357391 17221 leader_election.cc:290] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.363411 16116 tablet_loader.cc:96] loaded metadata for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414])
I20260810 13:54:35.369623 13640 raft_consensus.cc:359] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.370385 13640 raft_consensus.cc:385] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:35.370659 13640 raft_consensus.cc:740] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:35.372076 16116 tablet_loader.cc:96] loaded metadata for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879])
I20260810 13:54:35.382081 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fe8abad5649f2a42686c00148d957" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:35.382320 16116 tablet_loader.cc:96] loaded metadata for tablet ab9d43e8868c420ea0801d395ff9c102 (table default.Table_e317f4e20e124c60bbed5450c6c3ca07 [id=01638b930a5e4b46925cdbfd23f204ea])
I20260810 13:54:35.383548 16116 tablet_loader.cc:96] loaded metadata for tablet ac27a168faad4542967097f909ce3997 (table default.Table_b392780f45ab4b899ddb12eefbcdd556 [id=0a7b7ff4685e4a8884b4aab7a835890d])
I20260810 13:54:35.386088 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:35.390477 16116 tablet_loader.cc:96] loaded metadata for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb])
W20260810 13:54:35.397058 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 92968us
I20260810 13:54:35.398360 17052 raft_consensus.cc:493] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:35.398839 17052 raft_consensus.cc:515] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.400022 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:35.401043 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:35.401227 16116 tablet_loader.cc:96] loaded metadata for tablet ae74d69055ee4aa395c0f628864242e3 (table default.Table_6964fe82ae0c4d96a86d800f82062b3e [id=83fc760e794d422d8614bf728e3e47df])
I20260810 13:54:35.402047 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:35.402995 16116 tablet_loader.cc:96] loaded metadata for tablet af106f431764457bbeb43691f5b0a46a (table default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 [id=19cf8ac217b34ed1b6ceccb40508fd56])
I20260810 13:54:35.403208 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:35.404124 16116 tablet_loader.cc:96] loaded metadata for tablet afe75b90aa5548d8a6c35cf6db42bb25 (table default.Table_3abcbf71e2004a07888fe131143e8e76 [id=ab67527f31ce42d7a92bb0cba8f69ff6])
I20260810 13:54:35.405160 17052 leader_election.cc:290] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:35.408708 13639 tablet_bootstrap.cc:492] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:35.417553 16116 tablet_loader.cc:96] loaded metadata for tablet b09ec8ef75e94a83a155d901235e7ce0 (table default.Table_699797a1320b40709d0bf25947241900 [id=f656a6598c1145d89230d014ba6873a6])
I20260810 13:54:35.425426 16116 tablet_loader.cc:96] loaded metadata for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f])
I20260810 13:54:35.426599 16116 tablet_loader.cc:96] loaded metadata for tablet b0f98604d43049ac9b2befe5041a2bda (table default.Table_acc827f97bb244f59d2eed071cc9bd55 [id=7b4d23c35bc14f8598821f2838a18148])
I20260810 13:54:35.427747 16116 tablet_loader.cc:96] loaded metadata for tablet b2d9bca9a4e74f3aa7ea0a11c7906a09 (table default.Table_890e94f5e2914f4e9e3994ab8bc4075c [id=d08463e955564de898a2af8457a26457])
I20260810 13:54:35.429206 16116 tablet_loader.cc:96] loaded metadata for tablet b2f2b53b984441e4baee332183e4c5c3 (table default.Table_87c087a440044f9483716cce60bb4777 [id=4777400951884e84a747cbc635b6a087])
I20260810 13:54:35.431192 13638 tablet_bootstrap.cc:492] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:35.430365 16116 tablet_loader.cc:96] loaded metadata for tablet b335455cc01947a3a4ca6c368fea7bad (table default.Table_a232694e27574131946f967d95a292f4 [id=fec6784b9d334a72907abaf252914033])
I20260810 13:54:35.439328 16116 tablet_loader.cc:96] loaded metadata for tablet b3bbe54b2ba947a4a8b2d908f44c0db5 (table default.Table_4f02931df6b0437a9cb7869b14b73084 [id=b8289db1d29241f3815ff2da32fcfc1a])
I20260810 13:54:35.445655 16116 tablet_loader.cc:96] loaded metadata for tablet b3cbbc9bee4843dea818b514d42d42df (table default.Table_2416e07beb8d42a6a48de9dab42936cf [id=39551fb5d1804467bb58d5b00de27be4])
I20260810 13:54:35.446941 16116 tablet_loader.cc:96] loaded metadata for tablet b427309e4db942bd920539274bffe7cd (table default.Table_819cbf37633d4c75ba529b0d037cb8db [id=8d2ee7c5b732405c804aec9f79e98038])
I20260810 13:54:35.450095 16116 tablet_loader.cc:96] loaded metadata for tablet b449377349514576874b6c295ead5e9a (table default.Table_2695264893564646a621e76ff6443e84 [id=147b038d3de54c8d85e666747153cb7d])
I20260810 13:54:35.451249 16116 tablet_loader.cc:96] loaded metadata for tablet b4be757a47e3434081eef61dfd746be1 (table default.Table_dfe60ded8ca240529710962e7f530298 [id=b4ce0aca49834e698812644caf8b8a94])
I20260810 13:54:35.461740 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:35.462730 16116 tablet_loader.cc:96] loaded metadata for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7])
I20260810 13:54:35.463968 16116 tablet_loader.cc:96] loaded metadata for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b])
I20260810 13:54:35.465127 16116 tablet_loader.cc:96] loaded metadata for tablet b7a45cb763a84c7aa557fde815a92c07 (table default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f [id=cb722d559fe647018b6c959f6a93a037])
I20260810 13:54:35.472893 16116 tablet_loader.cc:96] loaded metadata for tablet b8fcd43569dd49b38d3227b312b896c4 (table default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb [id=dea63931a83f494b8fa574685cd4ff24])
I20260810 13:54:35.474121 13640 consensus_queue.cc:260] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.481961 16116 tablet_loader.cc:96] loaded metadata for tablet baa17cc9fd524b0981cb2368a7265df1 (table default.Table_a80ad2cc0680447898f832a3da957607 [id=b7e44fb60b9b401db5517c2fd7e8c70b])
I20260810 13:54:35.486449 16116 tablet_loader.cc:96] loaded metadata for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e])
I20260810 13:54:35.497785 16116 tablet_loader.cc:96] loaded metadata for tablet bcac39f031b44408bdbe043720dcae57 (table default.Table_86221744224e4ac4aeebf77dbd274d49 [id=fe2f8409777b4c94b59159a106e77e7f])
I20260810 13:54:35.499130 16116 tablet_loader.cc:96] loaded metadata for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734])
W20260810 13:54:35.502730 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 90446us
I20260810 13:54:35.504079 16116 tablet_loader.cc:96] loaded metadata for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01])
I20260810 13:54:35.505250 16116 tablet_loader.cc:96] loaded metadata for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162])
I20260810 13:54:35.509429 16116 tablet_loader.cc:96] loaded metadata for tablet bf9beaff9d5245f8b0e8606ed0d888c6 (table default.Table_b5e6f89f8d854f7e991193036d4d8321 [id=5d59e07d6bc5465eaaf40d68610bc154])
I20260810 13:54:35.510337 13638 tablet_bootstrap.cc:654] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:35.517643 16116 tablet_loader.cc:96] loaded metadata for tablet bfc9c907fe50470ca860728883fb6d9e (table default.Table_c4942145f1414e939000a9b7443c0d29 [id=b88902dec1e34475b3ae470c1c17f777])
I20260810 13:54:35.520026 16116 tablet_loader.cc:96] loaded metadata for tablet c0e45366954740528fb37c7cfdc639c6 (table default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 [id=8129beecaba3450c9041bb715af80988])
I20260810 13:54:35.521776 16116 tablet_loader.cc:96] loaded metadata for tablet c1510cd3523646eba9333f7e6d85a5e8 (table default.Table_c39a51586fe847b990c6d2c59e2280ff [id=44428a121dc24f5ba5e5d74158f9f4d0])
I20260810 13:54:35.529654 16116 tablet_loader.cc:96] loaded metadata for tablet c4a656fba31f49d99303e6a71cc4a9a6 (table default.Table_e4f9174b7de74fd79642def9d4d0fffd [id=f8ba71724c3f4068a8377462165aee32])
I20260810 13:54:35.535072 13639 tablet_bootstrap.cc:654] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:35.537364 16116 tablet_loader.cc:96] loaded metadata for tablet ca26c63f9dc142318b648f456f111ebb (table default.Table_5d55900f1adf4aca973dbf4e94ca29c3 [id=63c1004ec7f44526929d7b9f809c0e04])
I20260810 13:54:35.545526 13640 ts_tablet_manager.cc:1434] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.238s user 0.008s sys 0.001s
I20260810 13:54:35.536780 17118 raft_consensus.cc:515] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.548287 16116 tablet_loader.cc:96] loaded metadata for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18])
I20260810 13:54:35.557430 16116 tablet_loader.cc:96] loaded metadata for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3])
I20260810 13:54:35.559437 16116 tablet_loader.cc:96] loaded metadata for tablet cd3d4b038acb48ebaebef7a424f721c5 (table default.Table_57980e60ac6549c8b24861967f6cc198 [id=18ade4a3af044a498725f45a06e04b81])
I20260810 13:54:35.569744 16116 tablet_loader.cc:96] loaded metadata for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6])
I20260810 13:54:35.549871 12951 leader_election.cc:304] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:35.573335 17177 raft_consensus.cc:2804] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:35.573819 17177 raft_consensus.cc:493] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:35.573901 16116 tablet_loader.cc:96] loaded metadata for tablet ceba68b27a63430fad93a30c452fb1a3 (table default.Table_772227d6702d4cf7bf6729e922d3eea5 [id=6ffcaf4f90f14e24b6d02b21e2936bd3])
I20260810 13:54:35.574256 17177 raft_consensus.cc:3060] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:35.576145 16116 tablet_loader.cc:96] loaded metadata for tablet d18c4ddd51b6463ea28dfb2456128a18 (table default.Table_72fd7834d8574cb1a74c1d08699d1f7e [id=8cdd566d9af748b6a8d998ecf7221fb6])
I20260810 13:54:35.581393 17118 leader_election.cc:290] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:35.596570 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 1.635s (SENT)
I20260810 13:54:35.600554 16116 tablet_loader.cc:96] loaded metadata for tablet d1b2835286e14a8e827f7a61801ffb17 (table default.Table_a3085b5448ff4df8a25c4802ca130085 [id=b3648e88a1fc44808dcf824092d5de35])
I20260810 13:54:35.601845 16116 tablet_loader.cc:96] loaded metadata for tablet d1ec72a86a08452fb8b390b62f8c6dec (table default.Table_63e74b1d9a4e48c3b9343a12f0b926e6 [id=a17784f2e3a940e59b5603273436c417])
W20260810 13:54:35.604151 15135 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317): Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 1.635s (SENT)
I20260810 13:54:35.604588 15135 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:35.611405 16116 tablet_loader.cc:96] loaded metadata for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49])
I20260810 13:54:35.613845 13638 tablet_bootstrap.cc:492] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:35.605104 12951 leader_election.cc:304] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:35.615254 17118 raft_consensus.cc:2804] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:35.615698 17118 raft_consensus.cc:493] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:35.616097 17118 raft_consensus.cc:3060] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:35.621218 16116 tablet_loader.cc:96] loaded metadata for tablet d36f17094e504d80a2443dc12855c744 (table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67])
I20260810 13:54:35.624576 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d9e5103fe644f38d969c64182f7cbb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:35.625319 16116 tablet_loader.cc:96] loaded metadata for tablet d5cb099133c04a07956581f23378ddf4 (table default.Table_4b93246ea61e418db4efb3c2732711af [id=847e7c0039964b3f94192d5032791e4a])
I20260810 13:54:35.629127 17233 consensus_queue.cc:1048] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:35.633081 12951 leader_election.cc:304] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:35.629712 16116 tablet_loader.cc:96] loaded metadata for tablet d6487d26c6524c38a313b54d5431b6f6 (table default.Table_e8940f9b8b5647b29566e6383b5c8fd7 [id=866777afb37d48b7bc025eba1377a8d0])
I20260810 13:54:35.638190 16116 tablet_loader.cc:96] loaded metadata for tablet d669bb7f769c44df994efae1d39eb7a8 (table default.Table_a34a40f45be7413bb670738c4199fa50 [id=fd9cae2939d9440b92dc923383e5839c])
I20260810 13:54:35.641927 16116 tablet_loader.cc:96] loaded metadata for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694])
I20260810 13:54:35.645579 13640 tablet_bootstrap.cc:492] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:35.655913 16116 tablet_loader.cc:96] loaded metadata for tablet d982e709c71a4440b0cf07f11e429d72 (table default.Table_ec24cdc578624353b8936b6a7add0b7b [id=bf5a9955305343258f05d827cd3e8aec])
W20260810 13:54:35.664701 15135 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 60558.3us
I20260810 13:54:35.666491 16116 tablet_loader.cc:96] loaded metadata for tablet da664a1596554ee3890f58f0c54521a6 (table default.Table_e0bb4403efd84db5ac45ace77b9b1a90 [id=c9ebbfcd82964aa798abcf82aaf3e881])
I20260810 13:54:35.666643 17177 raft_consensus.cc:515] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.667794 16116 tablet_loader.cc:96] loaded metadata for tablet da66e50033cf48d4897128b3aa77127f (table default.Table_94153e136b9f4ea9aeb589c1a0322981 [id=12299e0dca554badab42ee7a73ea9723])
I20260810 13:54:35.669322 13639 tablet_bootstrap.cc:492] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:35.671316 16116 tablet_loader.cc:96] loaded metadata for tablet da7c4d83667c4c188e5f2774c40e5e53 (table default.Table_40ebe892a09b471581cb322124cf7630 [id=a79fc8e8c8ec420fb2c6e6cc0fdbc17e])
I20260810 13:54:35.667220 13638 ts_tablet_manager.cc:1403] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.236s user 0.010s sys 0.002s
I20260810 13:54:35.674201 17233 raft_consensus.cc:2804] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:35.675057 17233 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:35.675442 17233 raft_consensus.cc:3060] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:35.670915 17239 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:35.679280 17210 raft_consensus.cc:493] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:35.679904 17210 raft_consensus.cc:515] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:35.680816 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47822.7us
I20260810 13:54:35.682471 17210 leader_election.cc:290] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.689141 16116 tablet_loader.cc:96] loaded metadata for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec])
I20260810 13:54:35.699748 16116 tablet_loader.cc:96] loaded metadata for tablet df3031d8f75d4548b458cee6dd2083d2 (table default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0])
I20260810 13:54:35.706938 16116 tablet_loader.cc:96] loaded metadata for tablet dfbb2036c800469f90ad4d5d211ac462 (table default.Table_2a27c95d054b44dd84ede3639a6395c5 [id=232f082ff5eb446bbb2e7869e83b2449])
I20260810 13:54:35.709865 13639 ts_tablet_manager.cc:1403] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.301s user 0.005s sys 0.010s
I20260810 13:54:35.714144 16116 tablet_loader.cc:96] loaded metadata for tablet e1e8e52e3605464fb40b78ab3d104ce8 (table default.Table_d3680fc81fed4821bc9a2eccc77c35d8 [id=c9181e9bcc3546a5ac7aed13b663deaa])
I20260810 13:54:35.715633 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:35.730481 16116 tablet_loader.cc:96] loaded metadata for tablet e24ce014b17f418fbea698adb0d7ff60 (table default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c])
I20260810 13:54:35.735574 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:35.737287 16116 tablet_loader.cc:96] loaded metadata for tablet e30f03b6b326429eab7227616059a0db (table default.Table_d171e1a65676495882912f18dddff2ee [id=4f6c1859cd1a481da7b9b3c2013365c3])
I20260810 13:54:35.741302 17052 consensus_queue.cc:1048] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:35.743076 16116 tablet_loader.cc:96] loaded metadata for tablet e37ff84ae1f84d8ea0e57066273536be (table default.Table_e8a597f1c0ec4cd8878f49046eb45e66 [id=047df8b2dabc4682a2227e841b10a53c])
I20260810 13:54:35.743240 13638 raft_consensus.cc:359] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.743979 13638 raft_consensus.cc:385] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:35.744277 13638 raft_consensus.cc:740] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:35.745047 16116 tablet_loader.cc:96] loaded metadata for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391])
I20260810 13:54:35.745005 13638 consensus_queue.cc:260] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.747562 17221 raft_consensus.cc:493] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:35.748157 17221 raft_consensus.cc:515] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.751176 17221 leader_election.cc:290] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:35.760821 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b8030450554de3b97266f348329ea6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:35.761991 16116 tablet_loader.cc:96] loaded metadata for tablet e637fca32f12429d8cba24d15680051e (table default.Table_98fbef24cbef43679502dae9e67e35cf [id=1e5fe6bb81ec41d3be1b189a0631e695])
I20260810 13:54:35.763161 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:35.764140 13252 raft_consensus.cc:3060] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:35.766068 16116 tablet_loader.cc:96] loaded metadata for tablet e7553445e6124227872c0f2306940225 (table default.Table_2c6e1c408acb44358898a1a4ff356bdd [id=909cf43e9f9e4d439f8f246cef081d56])
I20260810 13:54:35.771734 16116 tablet_loader.cc:96] loaded metadata for tablet e7b637166ce24e4fa1fd32aaa1ada207 (table default.Table_03b06d24159c4b079c0008aa041c517b [id=af367ad99e9a4fa9907c170b0a5dee49])
I20260810 13:54:35.772176 13255 raft_consensus.cc:3060] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:35.786500 16116 tablet_loader.cc:96] loaded metadata for tablet e837879f1c2549c795b240589dfa9bf7 (table default.Table_209ee5a105144c7e871214eaafcd0cbe [id=9a05ad06179141dfabe2d12858c1746c])
I20260810 13:54:35.793710 16116 tablet_loader.cc:96] loaded metadata for tablet e839b2604ad640419fc845b54706cd4d (table default.Table_70a5ed6b181b4db1ae5c28b4b6ca4553 [id=c93d3c57643543cda0f021e1171b3365])
I20260810 13:54:35.794198 13640 tablet_bootstrap.cc:654] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:35.798529 12729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.62:33317 timed out after 2.929s (SENT)
I20260810 13:54:35.799769 13639 raft_consensus.cc:359] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.800468 13639 raft_consensus.cc:385] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:35.805797 16116 tablet_loader.cc:96] loaded metadata for tablet ea80282f10e647ebb4b7c87112f579c9 (table default.Table_7c53cfb1808c47e59a8e23b0e6325acd [id=5558467decbe4ca29c989c08073be0de])
I20260810 13:54:35.810928 13639 raft_consensus.cc:740] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:35.828955 16116 tablet_loader.cc:96] loaded metadata for tablet eb7fe3793da743e293800961b029fc56 (table default.Table_e424bd25638b4b23b721c8529aa42285 [id=126e0229d9904feba5c16222cecf5140])
I20260810 13:54:35.834995 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fe8abad5649f2a42686c00148d957" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:35.837410 16116 tablet_loader.cc:96] loaded metadata for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80])
I20260810 13:54:35.821996 13639 consensus_queue.cc:260] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.839440 16116 tablet_loader.cc:96] loaded metadata for tablet ec0c424fdefb4d38a9946203c6521012 (table default.Table_18833ebfc83a4c33a1a94a902b97ffaf [id=bb2789ba0fd043c2a44479f23111dcbb])
I20260810 13:54:35.850752 13382 leader_election.cc:304] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:35.852403 16116 tablet_loader.cc:96] loaded metadata for tablet ec901677e46946578fe0929794df881f (table default.Table_586e39daebb14dfaa08b3cc251eeb18a [id=46490c79e3814a82b21ab79f2a53814e])
I20260810 13:54:35.854951 16116 tablet_loader.cc:96] loaded metadata for tablet ee650f1e57294de89643e84bf7914298 (table default.Table_09a6fde1eefc4ce0a591129d6ab65e3a [id=8b4fe3206c2344728b61ed31b33580a6])
I20260810 13:54:35.861514 13639 ts_tablet_manager.cc:1434] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.151s user 0.002s sys 0.005s
I20260810 13:54:35.848791 17233 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:35.863651 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 44926.5us
I20260810 13:54:35.865074 17233 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:35.868973 17177 leader_election.cc:290] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:35.872103 17221 raft_consensus.cc:2749] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:35.878894 16116 tablet_loader.cc:96] loaded metadata for tablet efc446acced34a6c87e459c5542c1c77 (table default.Table_3fb4e7e2f617464f930b338a8ece6e38 [id=0acde9f8e2f7483c9eb7f3df14b0859d])
I20260810 13:54:35.881515 16116 tablet_loader.cc:96] loaded metadata for tablet f1c3e25d16f847a9b7f4194b5a0bbe90 (table default.Table_4f9508194c21480d9b603b139bdaf902 [id=98e554f12bf944c98887ed2293df2e26])
I20260810 13:54:35.881745 13638 ts_tablet_manager.cc:1434] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.203s user 0.006s sys 0.000s
I20260810 13:54:35.882762 16116 tablet_loader.cc:96] loaded metadata for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a])
W20260810 13:54:35.885963 15277 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260810 13:54:35.888888 13640 tablet_bootstrap.cc:492] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:35.889350 13640 ts_tablet_manager.cc:1403] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.244s user 0.003s sys 0.010s
W20260810 13:54:35.893222 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 94724us
W20260810 13:54:35.905659 13382 leader_election.cc:343] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:35.906893 17211 consensus_queue.cc:1048] T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:35.907564 16116 tablet_loader.cc:96] loaded metadata for tablet f2b97ddd62b547ba997bf3044d37029d (table default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21])
I20260810 13:54:35.909006 16116 tablet_loader.cc:96] loaded metadata for tablet f37d338cf7244b68b6c6e4868113d248 (table default.Table_ee9ef5f74a944eaabe6af879e8ab15a2 [id=7a8f1c3ab411436fa3940b3261d0e05f])
I20260810 13:54:35.909451 13639 tablet_bootstrap.cc:492] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:35.910218 16116 tablet_loader.cc:96] loaded metadata for tablet f37f4b2d04f84e119da2743234865baf (table default.Table_071663fc830e44ef9d25a38fc8301ba7 [id=dd579b0cb2684ce08640cf4f5edae65c])
I20260810 13:54:35.911408 16116 tablet_loader.cc:96] loaded metadata for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1])
I20260810 13:54:35.912660 16116 tablet_loader.cc:96] loaded metadata for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea])
I20260810 13:54:35.926784 16116 tablet_loader.cc:96] loaded metadata for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470])
W20260810 13:54:35.929589 12952 leader_election.cc:343] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:35.930820 12952 leader_election.cc:343] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:35.931931 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:35.934391 13640 raft_consensus.cc:359] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.934538 13255 raft_consensus.cc:2468] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:35.940981 16116 tablet_loader.cc:96] loaded metadata for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810])
I20260810 13:54:35.942538 17221 consensus_queue.cc:1048] T f19e7aa805bd417eae45fb43ac18a66d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:35.942943 16116 tablet_loader.cc:96] loaded metadata for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8])
I20260810 13:54:35.961097 16116 tablet_loader.cc:96] loaded metadata for tablet f7cf6e6b67994c139d920fd1a3e014e6 (table default.Table_f7160fbf49d74f79b79a300e67af5cbf [id=440aa3e8a24a415eb98a448b4848e76d])
W20260810 13:54:35.962771 13382 leader_election.cc:343] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:35.963234 16116 tablet_loader.cc:96] loaded metadata for tablet fa5fb50327a3454090bc41a2892df8c0 (table default.Table_bc50dbac8249499e90b8d763fd7041f2 [id=92622bf6828843419776bf2bbe0c6aee])
W20260810 13:54:35.965384 12952 leader_election.cc:343] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:35.965521 17052 consensus_queue.cc:1048] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:35.967868 17247 consensus_queue.cc:1048] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:35.972332 17118 raft_consensus.cc:515] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:35.982919 17118 leader_election.cc:290] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:35.986286 16116 tablet_loader.cc:96] loaded metadata for tablet fd1a9d7bb08b45b780137e7acf8111bb (table default.Table_9d26366e03454a73ae877683e6700ff0 [id=3587a6d27d294470ac7551a3bb96a701])
I20260810 13:54:35.991533 13382 leader_election.cc:304] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:35.979522 13640 raft_consensus.cc:385] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:35.992331 17211 raft_consensus.cc:2749] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:35.992530 13640 raft_consensus.cc:740] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:35.951988 13252 raft_consensus.cc:2468] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:36.002964 16116 tablet_loader.cc:96] loaded metadata for tablet fe4755e4fcfd4af087ce5831a4e02022 (table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9])
I20260810 13:54:35.997943 13640 consensus_queue.cc:260] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.007426 13638 tablet_bootstrap.cc:492] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:36.008809 16116 tablet_loader.cc:96] loaded metadata for tablet fe5796052fd94c1e8fce159a6a90830c (table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98])
I20260810 13:54:36.010120 16116 tablet_loader.cc:96] loaded metadata for tablet ff1229ebe9304f19ab84d5a172aba937 (table default.Table_5ac9d00cb7b3422e9810b51a4f20e029 [id=6f7b1b6d99b64d008a7c3c527f172e24])
I20260810 13:54:36.015090 13638 tablet_bootstrap.cc:654] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:36.015580 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 48419.8us
I20260810 13:54:36.033797 13640 ts_tablet_manager.cc:1434] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.144s user 0.006s sys 0.002s
I20260810 13:54:36.034126 17221 raft_consensus.cc:493] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:36.034842 17221 raft_consensus.cc:515] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.038756 17221 leader_election.cc:290] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:36.040542 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:36.043979 17251 raft_consensus.cc:493] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:36.045133 17251 raft_consensus.cc:515] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.048032 17251 leader_election.cc:290] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:35.989816 13639 tablet_bootstrap.cc:654] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:36.061180 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:36.075583 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:36.076316 13033 raft_consensus.cc:3060] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:36.076707 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fe8abad5649f2a42686c00148d957" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:36.077543 13056 raft_consensus.cc:2393] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:36.086009 13033 raft_consensus.cc:2468] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:36.093695 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:36.094883 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:36.106331 12952 leader_election.cc:343] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:36.121384 13639 tablet_bootstrap.cc:492] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:36.121794 13639 ts_tablet_manager.cc:1403] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.213s user 0.006s sys 0.006s
I20260810 13:54:36.129335 13638 tablet_bootstrap.cc:492] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:36.129786 13638 ts_tablet_manager.cc:1403] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.123s user 0.005s sys 0.006s
I20260810 13:54:36.133628 13638 raft_consensus.cc:359] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:36.137833 12952 leader_election.cc:343] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:36.151309 17254 raft_consensus.cc:493] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:36.151813 17254 raft_consensus.cc:515] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.153875 17254 leader_election.cc:290] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:36.174378 17257 consensus_queue.cc:1048] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:36.174721 12952 leader_election.cc:343] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:36.124279 13639 raft_consensus.cc:359] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.177348 13639 raft_consensus.cc:385] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:36.177639 13639 raft_consensus.cc:740] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:36.178342 13639 consensus_queue.cc:260] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.169020 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:36.185189 13638 raft_consensus.cc:385] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:36.185659 13638 raft_consensus.cc:740] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:36.186447 13638 consensus_queue.cc:260] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.180619 13639 ts_tablet_manager.cc:1434] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.059s user 0.004s sys 0.002s
I20260810 13:54:36.211225 13640 tablet_bootstrap.cc:492] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:36.217769 13640 tablet_bootstrap.cc:654] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:36.230440 17160 raft_consensus.cc:493] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:36.230991 17160 raft_consensus.cc:515] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.233322 17160 leader_election.cc:290] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:36.233322 13638 ts_tablet_manager.cc:1434] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.103s user 0.008s sys 0.000s
I20260810 13:54:36.241362 13638 tablet_bootstrap.cc:492] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:36.264302 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:36.267679 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:36.268313 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:36.268869 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:36.278247 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d9e5103fe644f38d969c64182f7cbb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:36.279289 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:36.279824 13467 raft_consensus.cc:3060] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:36.281214 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:36.288025 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:36.294039 13638 tablet_bootstrap.cc:654] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:36.299630 13467 raft_consensus.cc:2468] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:36.300026 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fe8abad5649f2a42686c00148d957" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:36.301260 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:36.301726 13260 raft_consensus.cc:3060] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:36.301810 13240 raft_consensus.cc:3060] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:36.306175 13640 tablet_bootstrap.cc:492] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:36.306646 13640 ts_tablet_manager.cc:1403] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.096s user 0.009s sys 0.000s
I20260810 13:54:36.318608 13640 raft_consensus.cc:359] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.319334 13640 raft_consensus.cc:385] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:36.319612 13640 raft_consensus.cc:740] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:36.321739 16116 catalog_manager.cc:1512] Time spent T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Loading table and tablet metadata into memory: real 4.292s user 0.899s sys 0.091s
I20260810 13:54:36.322060 16116 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260810 13:54:36.321903 12504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:36.323953 12729 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:36.326858 12513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
W20260810 13:54:36.327589 12513 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51916 (request call id 11) took 2359 ms (client timeout 1635 ms). Trace:
I20260810 13:54:36.327744 13240 raft_consensus.cc:2468] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
W20260810 13:54:36.327935 12513 rpcz_store.cc:269] 0810 13:54:33.968283 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:33.968604 (+ 321us) service_pool.cc:224] Handling call
0810 13:54:36.327532 (+2358928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:36.328856 12511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:36.329870 13260 raft_consensus.cc:2468] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
W20260810 13:54:36.331185 12511 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51916 (request call id 10) took 4040 ms (client timeout 1635 ms). Trace:
W20260810 13:54:36.331488 12511 rpcz_store.cc:269] 0810 13:54:32.290661 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:32.290799 (+ 138us) service_pool.cc:224] Handling call
0810 13:54:36.331094 (+4040295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:36.329825 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
W20260810 13:54:36.333244 12498 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36088 (request call id 964) took 3464 ms (client timeout 2929 ms). Trace:
W20260810 13:54:36.334793 12498 rpcz_store.cc:269] 0810 13:54:32.869089 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:32.869253 (+ 164us) service_pool.cc:224] Handling call
0810 13:54:36.333126 (+3463873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:36.320261 13640 consensus_queue.cc:260] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.338081 13640 ts_tablet_manager.cc:1434] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.031s user 0.007s sys 0.000s
I20260810 13:54:36.347082 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:36.350204 12952 leader_election.cc:343] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:36.351409 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:36.353191 12952 leader_election.cc:304] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:36.354151 17247 raft_consensus.cc:2804] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:36.355646 17247 raft_consensus.cc:697] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:36.357342 17247 consensus_queue.cc:237] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.359885 12952 leader_election.cc:304] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:36.361186 17257 raft_consensus.cc:2804] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:36.361801 17257 raft_consensus.cc:697] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:36.362905 17257 consensus_queue.cc:237] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.374130 13640 tablet_bootstrap.cc:492] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:36.375449 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:36.376593 17285 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:36.387665 13639 tablet_bootstrap.cc:492] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:36.393927 13639 tablet_bootstrap.cc:654] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:36.405715 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b8030450554de3b97266f348329ea6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:36.411046 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:36.411654 13468 raft_consensus.cc:3060] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:36.449481 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:36.456352 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:36.457247 13260 raft_consensus.cc:3060] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:36.481551 13638 tablet_bootstrap.cc:492] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:36.507633 13640 tablet_bootstrap.cc:654] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:36.516089 13468 raft_consensus.cc:2468] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:36.517768 13638 ts_tablet_manager.cc:1403] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.277s user 0.010s sys 0.005s
I20260810 13:54:36.535612 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:36.550058 17251 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:36.550678 17251 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.554914 17251 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:36.540683 16116 catalog_manager.cc:1295] Loaded cluster ID: 13e3d414686543de8210a2d9c5898299
I20260810 13:54:36.566455 16116 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260810 13:54:36.570832 13260 raft_consensus.cc:2468] T 4687f8fd44034ce28727c3b7e58e7fe9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:36.586514 13639 tablet_bootstrap.cc:492] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:36.589459 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:36.590021 13476 raft_consensus.cc:3060] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:36.596966 13476 raft_consensus.cc:2468] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:36.609789 13639 ts_tablet_manager.cc:1403] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.222s user 0.012s sys 0.001s
I20260810 13:54:36.605285 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fe8abad5649f2a42686c00148d957" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:36.617695 13468 raft_consensus.cc:2393] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:36.627282 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:36.630851 13468 raft_consensus.cc:3060] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:36.632329 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:36.612190 13639 raft_consensus.cc:359] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.635566 13639 raft_consensus.cc:385] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:36.658540 13639 raft_consensus.cc:740] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:36.665856 13639 consensus_queue.cc:260] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.687419 16116 catalog_manager.cc:1540] Loading token signing keys...
I20260810 13:54:36.730532 13639 ts_tablet_manager.cc:1434] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.120s user 0.004s sys 0.002s
I20260810 13:54:36.731613 17247 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:36.732589 17247 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.735414 17247 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:36.753573 16116 catalog_manager.cc:6103] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Loaded TSK: 0
I20260810 13:54:36.754892 16116 catalog_manager.cc:1550] Initializing in-progress tserver states...
W20260810 13:54:36.760056 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:36.742059 13638 raft_consensus.cc:359] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.766517 13638 raft_consensus.cc:385] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:36.766877 13638 raft_consensus.cc:740] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:36.775997 13640 tablet_bootstrap.cc:492] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:36.811095 13639 tablet_bootstrap.cc:492] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:36.814918 13640 ts_tablet_manager.cc:1403] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.442s user 0.004s sys 0.015s
I20260810 13:54:36.822193 13640 raft_consensus.cc:359] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.816582 13639 tablet_bootstrap.cc:654] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:36.844404 17247 raft_consensus.cc:493] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:36.845217 17247 raft_consensus.cc:515] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.849738 17247 leader_election.cc:290] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:36.853670 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 46288.8us
I20260810 13:54:36.782110 13638 consensus_queue.cc:260] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.902913 13639 tablet_bootstrap.cc:492] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:36.903398 13639 ts_tablet_manager.cc:1403] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.093s user 0.009s sys 0.002s
I20260810 13:54:36.914271 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:29.708078 15216 rpcz_store.cc:276] 0810 13:54:23.551118 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:23.551253 (+ 135us) service_pool.cc:224] Handling call
0810 13:54:23.678500 (+127247us) raft_consensus.cc:1471] Updating replica for 265 ops
0810 13:54:23.929210 (+250710us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:23.929238 (+ 28us) raft_consensus.cc:1539] Triggering prepare for 265 ops
0810 13:54:23.929836 (+ 598us) write_op.cc:270] Start()
0810 13:54:23.929961 (+ 125us) write_op.cc:276] Timestamp: P: 1786370036851786 usec, L: 0
0810 13:54:23.958219 (+ 28258us) write_op.cc:270] Start()
0810 13:54:23.958304 (+ 85us) write_op.cc:276] Timestamp: P: 1786370037022543 usec, L: 0
0810 13:54:23.958846 (+ 542us) write_op.cc:270] Start()
0810 13:54:23.958915 (+ 69us) write_op.cc:276] Timestamp: P: 1786370037136858 usec, L: 0
0810 13:54:23.959331 (+ 416us) write_op.cc:270] Start()
0810 13:54:23.959420 (+ 89us) write_op.cc:276] Timestamp: P: 1786370037311502 usec, L: 0
0810 13:54:23.959851 (+ 431us) write_op.cc:270] Start()
0810 13:54:23.959922 (+ 71us) write_op.cc:276] Timestamp: P: 1786370037489166 usec, L: 0
0810 13:54:23.960416 (+ 494us) write_op.cc:270] Start()
0810 13:54:23.960486 (+ 70us) write_op.cc:276] Timestamp: P: 1786370037503253 usec, L: 0
0810 13:54:23.960909 (+ 423us) write_op.cc:270] Start()
0810 13:54:23.961033 (+ 124us) write_op.cc:276] Timestamp: P: 1786370037668220 usec, L: 0
0810 13:54:23.961430 (+ 397us) write_op.cc:270] Start()
0810 13:54:23.961495 (+ 65us) write_op.cc:276] Timestamp: P: 1786370037730450 usec, L: 0
0810 13:54:23.961894 (+ 399us) write_op.cc:270] Start()
0810 13:54:23.961957 (+ 63us) write_op.cc:276] Timestamp: P: 1786370037976081 usec, L: 0
0810 13:54:23.962338 (+ 381us) write_op.cc:270] Start()
0810 13:54:23.962413 (+ 75us) write_op.cc:276] Timestamp: P: 1786370038152214 usec, L: 0
0810 13:54:23.962855 (+ 442us) write_op.cc:270] Start()
0810 13:54:23.962924 (+ 69us) write_op.cc:276] Timestamp: P: 1786370038262949 usec, L: 0
0810 13:54:24.036211 (+ 73287us) write_op.cc:270] Start()
0810 13:54:24.036320 (+ 109us) write_op.cc:276] Timestamp: P: 1786370038273732 usec, L: 0
0810 13:54:24.036988 (+ 668us) write_op.cc:270] Start()
0810 13:54:24.037064 (+ 76us) write_op.cc:276] Timestamp: P: 1786370038291567 usec, L: 0
0810 13:54:24.037502 (+ 438us) write_op.cc:270] Start()
0810 13:54:24.037571 (+ 69us) write_op.cc:276] Timestamp: P: 1786370038419653 usec, L: 0
0810 13:54:24.038015 (+ 444us) write_op.cc:270] Start()
0810 13:54:24.038082 (+ 67us) write_op.cc:276] Timestamp: P: 1786370038549465 usec, L: 0
0810 13:54:24.044356 (+ 6274us) write_op.cc:270] Start()
0810 13:54:24.044438 (+ 82us) write_op.cc:276] Timestamp: P: 1786370038577842 usec, L: 0
0810 13:54:24.045035 (+ 597us) write_op.cc:270] Start()
0810 13:54:24.045107 (+ 72us) write_op.cc:276] Timestamp: P: 1786370038671856 usec, L: 0
0810 13:54:24.045535 (+ 428us) write_op.cc:270] Start()
0810 13:54:24.045603 (+ 68us) write_op.cc:276] Timestamp: P: 1786370038948935 usec, L: 0
0810 13:54:24.046049 (+ 446us) write_op.cc:270] Start()
0810 13:54:24.046121 (+ 72us) write_op.cc:276] Timestamp: P: 1786370038997806 usec, L: 0
0810 13:54:24.046546 (+ 425us) write_op.cc:270] Start()
0810 13:54:24.046624 (+ 78us) write_op.cc:276] Timestamp: P: 1786370039135691 usec, L: 0
0810 13:54:24.047072 (+ 448us) write_op.cc:270] Start()
0810 13:54:24.047142 (+ 70us) write_op.cc:276] Timestamp: P: 1786370039159105 usec, L: 0
0810 13:54:24.047567 (+ 425us) write_op.cc:270] Start()
0810 13:54:24.047635 (+ 68us) write_op.cc:276] Timestamp: P: 1786370039220023 usec, L: 0
0810 13:54:24.048062 (+ 427us) write_op.cc:270] Start()
0810 13:54:24.048142 (+ 80us) write_op.cc:276] Timestamp: P: 1786370039222045 usec, L: 0
0810 13:54:24.048569 (+ 427us) write_op.cc:270] Start()
0810 13:54:24.048634 (+ 65us) write_op.cc:276] Timestamp: P: 1786370039293219 usec, L: 0
0810 13:54:24.081680 (+ 33046us) write_op.cc:270] Start()
0810 13:54:24.081775 (+ 95us) write_op.cc:276] Timestamp: P: 1786370039364445 usec, L: 0
0810 13:54:24.082275 (+ 500us) write_op.cc:270] Start()
0810 13:54:24.082349 (+ 74us) write_op.cc:276] Timestamp: P: 1786370039487049 usec, L: 0
0810 13:54:24.082806 (+ 457us) write_op.cc:270] Start()
0810 13:54:24.082877 (+ 71us) write_op.cc:276] Timestamp: P: 1786370039492979 usec, L: 0
0810 13:54:24.083326 (+ 449us) write_op.cc:270] Start()
0810 13:54:24.083390 (+ 64us) write_op.cc:276] Timestamp: P: 1786370039511027 usec, L: 0
0810 13:54:24.083819 (+ 429us) write_op.cc:270] Start()
0810 13:54:24.083896 (+ 77us) write_op.cc:276] Timestamp: P: 1786370039515041 usec, L: 0
0810 13:54:24.093626 (+ 9730us) write_op.cc:270] Start()
0810 13:54:24.093711 (+ 85us) write_op.cc:276] Timestamp: P: 1786370039596113 usec, L: 0
0810 13:54:24.094255 (+ 544us) write_op.cc:270] Start()
0810 13:54:24.094334 (+ 79us) write_op.cc:276] Timestamp: P: 1786370039598067 usec, L: 0
0810 13:54:24.094770 (+ 436us) write_op.cc:270] Start()
0810 13:54:24.094847 (+ 77us) write_op.cc:276] Timestamp: P: 1786370039613257 usec, L: 0
0810 13:54:24.095374 (+ 527us) write_op.cc:270] Start()
0810 13:54:24.095448 (+ 74us) write_op.cc:276] Timestamp: P: 1786370039615149 usec, L: 0
0810 13:54:24.095868 (+ 420us) write_op.cc:270] Start()
0810 13:54:24.095950 (+ 82us) write_op.cc:276] Timestamp: P: 1786370039616808 usec, L: 0
0810 13:54:24.096372 (+ 422us) write_op.cc:270] Start()
0810 13:54:24.096443 (+ 71us) write_op.cc:276] Timestamp: P: 1786370039618451 usec, L: 0
0810 13:54:24.096901 (+ 458us) write_op.cc:270] Start()
0810 13:54:24.096971 (+ 70us) write_op.cc:276] Timestamp: P: 1786370039620092 usec, L: 0
0810 13:54:24.149181 (+ 52210us) write_op.cc:270] Start()
0810 13:54:24.149275 (+ 94us) write_op.cc:276] Timestamp: P: 1786370039928822 usec, L: 0
0810 13:54:24.152149 (+ 2874us) write_op.cc:270] Start()
0810 13:54:24.152234 (+ 85us) write_op.cc:276] Timestamp: P: 1786370039942006 usec, L: 0
0810 13:54:24.152733 (+ 499us) write_op.cc:270] Start()
0810 13:54:24.152814 (+ 81us) write_op.cc:276] Timestamp: P: 1786370039958168 usec, L: 0
0810 13:54:24.153282 (+ 468us) write_op.cc:270] Start()
0810 13:54:24.153352 (+ 70us) write_op.cc:276] Timestamp: P: 1786370039960068 usec, L: 0
0810 13:54:24.153752 (+ 400us) write_op.cc:270] Start()
0810 13:54:24.153820 (+ 68us) write_op.cc:276] Timestamp: P: 1786370040144231 usec, L: 0
0810 13:54:24.154226 (+ 406us) write_op.cc:270] Start()
0810 13:54:24.154292 (+ 66us) write_op.cc:276] Timestamp: P: 1786370040148828 usec, L: 0
0810 13:54:24.154690 (+ 398us) write_op.cc:270] Start()
0810 13:54:24.154755 (+ 65us) write_op.cc:276] Timestamp: P: 1786370040151751 usec, L: 0
0810 13:54:24.167506 (+ 12751us) write_op.cc:270] Start()
0810 13:54:24.167594 (+ 88us) write_op.cc:276] Timestamp: P: 1786370040160714 usec, L: 0
0810 13:54:24.169677 (+ 2083us) write_op.cc:270] Start()
0810 13:54:24.169756 (+ 79us) write_op.cc:276] Timestamp: P: 1786370040264359 usec, L: 0
0810 13:54:24.170214 (+ 458us) write_op.cc:270] Start()
0810 13:54:24.170283 (+ 69us) write_op.cc:276] Timestamp: P: 1786370040374260 usec, L: 0
0810 13:54:24.170706 (+ 423us) write_op.cc:270] Start()
0810 13:54:24.180993 (+ 10287us) write_op.cc:276] Timestamp: P: 1786370040401338 usec, L: 0
0810 13:54:24.181513 (+ 520us) write_op.cc:270] Start()
0810 13:54:24.181587 (+ 74us) write_op.cc:276] Timestamp: P: 1786370040420969 usec, L: 0
0810 13:54:24.182025 (+ 438us) write_op.cc:270] Start()
0810 13:54:24.182107 (+ 82us) write_op.cc:276] Timestamp: P: 1786370040424035 usec, L: 0
0810 13:54:24.182546 (+ 439us) write_op.cc:270] Start()
0810 13:54:24.182614 (+ 68us) write_op.cc:276] Timestamp: P: 1786370040427201 usec, L: 0
0810 13:54:24.183059 (+ 445us) write_op.cc:270] Start()
0810 13:54:24.183135 (+ 76us) write_op.cc:276] Timestamp: P: 1786370040464625 usec, L: 0
0810 13:54:24.196148 (+ 13013us) write_op.cc:270] Start()
0810 13:54:24.196223 (+ 75us) write_op.cc:276] Timestamp: P: 1786370040467083 usec, L: 0
0810 13:54:24.196666 (+ 443us) write_op.cc:270] Start()
0810 13:54:24.196764 (+ 98us) write_op.cc:276] Timestamp: P: 1786370040529807 usec, L: 0
0810 13:54:24.205236 (+ 8472us) write_op.cc:270] Start()
0810 13:54:24.205308 (+ 72us) write_op.cc:276] Timestamp: P: 1786370040687175 usec, L: 0
0810 13:54:24.205790 (+ 482us) write_op.cc:270] Start()
0810 13:54:24.205863 (+ 73us) write_op.cc:276] Timestamp: P: 1786370040705224 usec, L: 0
0810 13:54:24.206359 (+ 496us) write_op.cc:270] Start()
0810 13:54:24.206428 (+ 69us) write_op.cc:276] Timestamp: P: 1786370040745185 usec, L: 0
0810 13:54:24.206850 (+ 422us) write_op.cc:270] Start()
0810 13:54:24.206933 (+ 83us) write_op.cc:276] Timestamp: P: 1786370040795483 usec, L: 0
0810 13:54:24.207325 (+ 392us) write_op.cc:270] Start()
0810 13:54:24.207395 (+ 70us) write_op.cc:276] Timestamp: P: 1786370040815786 usec, L: 0
0810 13:54:24.207807 (+ 412us) write_op.cc:270] Start()
0810 13:54:24.207877 (+ 70us) write_op.cc:276] Timestamp: P: 1786370040923442 usec, L: 0
0810 13:54:24.208304 (+ 427us) write_op.cc:270] Start()
0810 13:54:24.208429 (+ 125us) write_op.cc:276] Timestamp: P: 1786370040950957 usec, L: 0
0810 13:54:24.268159 (+ 59730us) write_op.cc:270] Start()
0810 13:54:24.268258 (+ 99us) write_op.cc:276] Timestamp: P: 1786370041052373 usec, L: 0
0810 13:54:24.268765 (+ 507us) write_op.cc:270] Start()
0810 13:54:24.268837 (+ 72us) write_op.cc:276] Timestamp: P: 1786370041054502 usec, L: 0
0810 13:54:24.269232 (+ 395us) write_op.cc:270] Start()
0810 13:54:24.269298 (+ 66us) write_op.cc:276] Timestamp: P: 1786370041075502 usec, L: 0
0810 13:54:24.269732 (+ 434us) write_op.cc:270] Start()
0810 13:54:24.269797 (+ 65us) write_op.cc:276] Timestamp: P: 1786370041106496 usec, L: 0
0810 13:54:24.270265 (+ 468us) write_op.cc:270] Start()
0810 13:54:24.270329 (+ 64us) write_op.cc:276] Timestamp: P: 1786370041148137 usec, L: 0
0810 13:54:24.270732 (+ 403us) write_op.cc:270] Start()
0810 13:54:24.270802 (+ 70us) write_op.cc:276] Timestamp: P: 1786370041150773 usec, L: 0
0810 13:54:24.271226 (+ 424us) write_op.cc:270] Start()
0810 13:54:24.271290 (+ 64us) write_op.cc:276] Timestamp: P: 1786370041159178 usec, L: 0
0810 13:54:24.271696 (+ 406us) write_op.cc:270] Start()
0810 13:54:24.271765 (+ 69us) write_op.cc:276] Timestamp: P: 1786370041336577 usec, L: 0
0810 13:54:24.272164 (+ 399us) write_op.cc:270] Start()
0810 13:54:24.272227 (+ 63us) write_op.cc:276] Timestamp: P: 1786370041346741 usec, L: 0
0810 13:54:24.272623 (+ 396us) write_op.cc:270] Start()
0810 13:54:24.309293 (+ 36670us) write_op.cc:276] Timestamp: P: 1786370041466132 usec, L: 0
0810 13:54:24.338275 (+ 28982us) write_op.cc:270] Start()
0810 13:54:24.338363 (+ 88us) write_op.cc:276] Timestamp: P: 1786370041689308 usec, L: 0
0810 13:54:24.338887 (+ 524us) write_op.cc:270] Start()
0810 13:54:24.338986 (+ 99us) write_op.cc:276] Timestamp: P: 1786370041691892 usec, L: 0
0810 13:54:24.339670 (+ 684us) write_op.cc:270] Start()
0810 13:54:24.339735 (+ 65us) write_op.cc:276] Timestamp: P: 1786370041731044 usec, L: 0
0810 13:54:24.340110 (+ 375us) write_op.cc:270] Start()
0810 13:54:24.340185 (+ 75us) write_op.cc:276] Timestamp: P: 1786370041783312 usec, L: 0
0810 13:54:24.340569 (+ 384us) write_op.cc:270] Start()
0810 13:54:24.340631 (+ 62us) write_op.cc:276] Timestamp: P: 1786370041911287 usec, L: 0
0810 13:54:24.341065 (+ 434us) write_op.cc:270] Start()
0810 13:54:24.341128 (+ 63us) write_op.cc:276] Timestamp: P: 1786370041919158 usec, L: 0
0810 13:54:24.341516 (+ 388us) write_op.cc:270] Start()
0810 13:54:24.341577 (+ 61us) write_op.cc:276] Timestamp: P: 1786370042088165 usec, L: 0
0810 13:54:24.342028 (+ 451us) write_op.cc:270] Start()
0810 13:54:24.342096 (+ 68us) write_op.cc:276] Timestamp: P: 1786370042091457 usec, L: 0
0810 13:54:24.342500 (+ 404us) write_op.cc:270] Start()
0810 13:54:24.342568 (+ 68us) write_op.cc:276] Timestamp: P: 1786370042109661 usec, L: 0
0810 13:54:24.342969 (+ 401us) write_op.cc:270] Start()
0810 13:54:24.343034 (+ 65us) write_op.cc:276] Timestamp: P: 1786370042114007 usec, L: 0
0810 13:54:24.343466 (+ 432us) write_op.cc:270] Start()
0810 13:54:24.350122 (+ 6656us) write_op.cc:276] Timestamp: P: 1786370042495826 usec, L: 0
0810 13:54:24.359054 (+ 8932us) write_op.cc:270] Start()
0810 13:54:24.359156 (+ 102us) write_op.cc:276] Timestamp: P: 1786370042525597 usec, L: 0
0810 13:54:24.359675 (+ 519us) write_op.cc:270] Start()
0810 13:54:24.359759 (+ 84us) write_op.cc:276] Timestamp: P: 1786370042537061 usec, L: 0
0810 13:54:24.374160 (+ 14401us) write_op.cc:270] Start()
0810 13:54:24.375147 (+ 987us) write_op.cc:276] Timestamp: P: 1786370042561326 usec, L: 0
0810 13:54:24.380736 (+ 5589us) write_op.cc:270] Start()
0810 13:54:24.381666 (+ 930us) write_op.cc:276] Timestamp: P: 1786370042573450 usec, L: 0
0810 13:54:24.390643 (+ 8977us) write_op.cc:270] Start()
0810 13:54:24.390719 (+ 76us) write_op.cc:276] Timestamp: P: 1786370042605233 usec, L: 0
0810 13:54:24.391149 (+ 430us) write_op.cc:270] Start()
0810 13:54:24.391214 (+ 65us) write_op.cc:276] Timestamp: P: 1786370042621984 usec, L: 0
0810 13:54:24.391628 (+ 414us) write_op.cc:270] Start()
0810 13:54:24.391693 (+ 65us) write_op.cc:276] Timestamp: P: 1786370042654419 usec, L: 0
0810 13:54:24.392081 (+ 388us) write_op.cc:270] Start()
0810 13:54:24.392145 (+ 64us) write_op.cc:276] Timestamp: P: 1786370042699656 usec, L: 0
0810 13:54:24.392533 (+ 388us) write_op.cc:270] Start()
0810 13:54:24.392595 (+ 62us) write_op.cc:276] Timestamp: P: 1786370042732438 usec, L: 0
0810 13:54:24.393001 (+ 406us) write_op.cc:270] Start()
0810 13:54:24.393069 (+ 68us) write_op.cc:276] Timestamp: P: 1786370042774545 usec, L: 0
0810 13:54:24.393503 (+ 434us) write_op.cc:270] Start()
0810 13:54:24.393566 (+ 63us) write_op.cc:276] Timestamp: P: 1786370042776514 usec, L: 0
0810 13:54:24.393961 (+ 395us) write_op.cc:270] Start()
0810 13:54:24.394030 (+ 69us) write_op.cc:276] Timestamp: P: 1786370042886010 usec, L: 0
0810 13:54:24.394452 (+ 422us) write_op.cc:270] Start()
0810 13:54:24.394524 (+ 72us) write_op.cc:276] Timestamp: P: 1786370042923441 usec, L: 0
0810 13:54:24.394916 (+ 392us) write_op.cc:270] Start()
0810 13:54:24.394983 (+ 67us) write_op.cc:276] Timestamp: P: 1786370042975675 usec, L: 0
0810 13:54:24.428927 (+ 33944us) write_op.cc:270] Start()
0810 13:54:24.429024 (+ 97us) write_op.cc:276] Timestamp: P: 1786370043057167 usec, L: 0
0810 13:54:24.429585 (+ 561us) write_op.cc:270] Start()
0810 13:54:24.429658 (+ 73us) write_op.cc:276] Timestamp: P: 1786370043148530 usec, L: 0
0810 13:54:24.430080 (+ 422us) write_op.cc:270] Start()
0810 13:54:24.430146 (+ 66us) write_op.cc:276] Timestamp: P: 1786370043230489 usec, L: 0
0810 13:54:24.440819 (+ 10673us) write_op.cc:270] Start()
0810 13:54:24.440900 (+ 81us) write_op.cc:276] Timestamp: P: 1786370043446310 usec, L: 0
0810 13:54:24.441383 (+ 483us) write_op.cc:270] Start()
0810 13:54:24.441467 (+ 84us) write_op.cc:276] Timestamp: P: 1786370043448278 usec, L: 0
0810 13:54:24.444738 (+ 3271us) write_op.cc:270] Start()
0810 13:54:24.444832 (+ 94us) write_op.cc:276] Timestamp: P: 1786370043529911 usec, L: 0
0810 13:54:24.445263 (+ 431us) write_op.cc:270] Start()
0810 13:54:24.445325 (+ 62us) write_op.cc:276] Timestamp: P: 1786370043531806 usec, L: 0
0810 13:54:24.445740 (+ 415us) write_op.cc:270] Start()
0810 13:54:24.445803 (+ 63us) write_op.cc:276] Timestamp: P: 1786370043677907 usec, L: 0
0810 13:54:24.452846 (+ 7043us) write_op.cc:270] Start()
0810 13:54:24.452918 (+ 72us) write_op.cc:276] Timestamp: P: 1786370043767938 usec, L: 0
0810 13:54:24.453370 (+ 452us) write_op.cc:270] Start()
0810 13:54:24.453454 (+ 84us) write_op.cc:276] Timestamp: P: 1786370043871214 usec, L: 0
0810 13:54:24.453867 (+ 413us) write_op.cc:270] Start()
0810 13:54:24.453936 (+ 69us) write_op.cc:276] Timestamp: P: 1786370043921959 usec, L: 0
0810 13:54:24.460874 (+ 6938us) write_op.cc:270] Start()
0810 13:54:24.460978 (+ 104us) write_op.cc:276] Timestamp: P: 1786370044028307 usec, L: 0
0810 13:54:24.461568 (+ 590us) write_op.cc:270] Start()
0810 13:54:24.461656 (+ 88us) write_op.cc:276] Timestamp: P: 1786370044064287 usec, L: 0
0810 13:54:24.462156 (+ 500us) write_op.cc:270] Start()
0810 13:54:24.462250 (+ 94us) write_op.cc:276] Timestamp: P: 1786370044114094 usec, L: 0
0810 13:54:24.462767 (+ 517us) write_op.cc:270] Start()
0810 13:54:24.462859 (+ 92us) write_op.cc:276] Timestamp: P: 1786370044128946 usec, L: 0
0810 13:54:24.463337 (+ 478us) write_op.cc:270] Start()
0810 13:54:24.463431 (+ 94us) write_op.cc:276] Timestamp: P: 1786370044140625 usec, L: 0
0810 13:54:24.463909 (+ 478us) write_op.cc:270] Start()
0810 13:54:24.463994 (+ 85us) write_op.cc:276] Timestamp: P: 1786370044181540 usec, L: 0
0810 13:54:24.464462 (+ 468us) write_op.cc:270] Start()
0810 13:54:24.464530 (+ 68us) write_op.cc:276] Timestamp: P: 1786370044183594 usec, L: 0
0810 13:54:24.464965 (+ 435us) write_op.cc:270] Start()
0810 13:54:24.465034 (+ 69us) write_op.cc:276] Timestamp: P: 1786370044267082 usec, L: 0
0810 13:54:24.465465 (+ 431us) write_op.cc:270] Start()
0810 13:54:24.465549 (+ 84us) write_op.cc:276] Timestamp: P: 1786370044291709 usec, L: 0
0810 13:54:24.466012 (+ 463us) write_op.cc:270] Start()
0810 13:54:24.466082 (+ 70us) write_op.cc:276] Timestamp: P: 1786370044319286 usec, L: 0
0810 13:54:24.466544 (+ 462us) write_op.cc:270] Start()
0810 13:54:24.466623 (+ 79us) write_op.cc:276] Timestamp: P: 1786370044361638 usec, L: 0
0810 13:54:24.467057 (+ 434us) write_op.cc:270] Start()
0810 13:54:24.467125 (+ 68us) write_op.cc:276] Timestamp: P: 1786370044459892 usec, L: 0
0810 13:54:24.493344 (+ 26219us) write_op.cc:270] Start()
0810 13:54:24.493444 (+ 100us) write_op.cc:276] Timestamp: P: 1786370044498035 usec, L: 0
0810 13:54:24.493976 (+ 532us) write_op.cc:270] Start()
0810 13:54:24.494048 (+ 72us) write_op.cc:276] Timestamp: P: 1786370044500115 usec, L: 0
0810 13:54:24.494506 (+ 458us) write_op.cc:270] Start()
0810 13:54:24.494574 (+ 68us) write_op.cc:276] Timestamp: P: 1786370044731849 usec, L: 0
0810 13:54:24.494996 (+ 422us) write_op.cc:270] Start()
0810 13:54:24.495062 (+ 66us) write_op.cc:276] Timestamp: P: 1786370044796377 usec, L: 0
0810 13:54:24.495467 (+ 405us) write_op.cc:270] Start()
0810 13:54:24.495531 (+ 64us) write_op.cc:276] Timestamp: P: 1786370044842346 usec, L: 0
0810 13:54:24.495903 (+ 372us) write_op.cc:270] Start()
0810 13:54:24.495965 (+ 62us) write_op.cc:276] Timestamp: P: 1786370044890203 usec, L: 0
0810 13:54:24.496371 (+ 406us) write_op.cc:270] Start()
0810 13:54:24.496452 (+ 81us) write_op.cc:276] Timestamp: P: 1786370044998197 usec, L: 0
0810 13:54:24.505516 (+ 9064us) write_op.cc:270] Start()
0810 13:54:24.505586 (+ 70us) write_op.cc:276] Timestamp: P: 1786370045003852 usec, L: 0
0810 13:54:24.506002 (+ 416us) write_op.cc:270] Start()
0810 13:54:24.506068 (+ 66us) write_op.cc:276] Timestamp: P: 1786370045202896 usec, L: 0
0810 13:54:24.506494 (+ 426us) write_op.cc:270] Start()
0810 13:54:24.506555 (+ 61us) write_op.cc:276] Timestamp: P: 1786370045279504 usec, L: 0
0810 13:54:24.507043 (+ 488us) write_op.cc:270] Start()
0810 13:54:24.507107 (+ 64us) write_op.cc:276] Timestamp: P: 1786370045346008 usec, L: 0
0810 13:54:24.507491 (+ 384us) write_op.cc:270] Start()
0810 13:54:24.507551 (+ 60us) write_op.cc:276] Timestamp: P: 1786370045411273 usec, L: 0
0810 13:54:24.507928 (+ 377us) write_op.cc:270] Start()
0810 13:54:24.508038 (+ 110us) write_op.cc:276] Timestamp: P: 1786370045452150 usec, L: 0
0810 13:54:24.508438 (+ 400us) write_op.cc:270] Start()
0810 13:54:24.508499 (+ 61us) write_op.cc:276] Timestamp: P: 1786370045522971 usec, L: 0
0810 13:54:24.529834 (+ 21335us) write_op.cc:270] Start()
0810 13:54:24.529949 (+ 115us) write_op.cc:276] Timestamp: P: 1786370045534290 usec, L: 0
0810 13:54:24.530531 (+ 582us) write_op.cc:270] Start()
0810 13:54:24.530598 (+ 67us) write_op.cc:276] Timestamp: P: 1786370045539623 usec, L: 0
0810 13:54:24.531023 (+ 425us) write_op.cc:270] Start()
0810 13:54:24.531087 (+ 64us) write_op.cc:276] Timestamp: P: 1786370045649079 usec, L: 0
0810 13:54:24.531494 (+ 407us) write_op.cc:270] Start()
0810 13:54:24.531556 (+ 62us) write_op.cc:276] Timestamp: P: 1786370045651232 usec, L: 0
0810 13:54:24.534096 (+ 2540us) write_op.cc:270] Start()
0810 13:54:24.534163 (+ 67us) write_op.cc:276] Timestamp: P: 1786370045707865 usec, L: 0
0810 13:54:24.539672 (+ 5509us) write_op.cc:270] Start()
0810 13:54:24.539742 (+ 70us) write_op.cc:276] Timestamp: P: 1786370045713630 usec, L: 0
0810 13:54:24.540158 (+ 416us) write_op.cc:270] Start()
0810 13:54:24.540225 (+ 67us) write_op.cc:276] Timestamp: P: 1786370045766689 usec, L: 0
0810 13:54:24.542449 (+ 2224us) write_op.cc:270] Start()
0810 13:54:24.542515 (+ 66us) write_op.cc:276] Timestamp: P: 1786370045852109 usec, L: 0
0810 13:54:24.542977 (+ 462us) write_op.cc:270] Start()
0810 13:54:24.543043 (+ 66us) write_op.cc:276] Timestamp: P: 1786370045854153 usec, L: 0
0810 13:54:24.544205 (+ 1162us) write_op.cc:270] Start()
0810 13:54:24.544272 (+ 67us) write_op.cc:276] Timestamp: P: 1786370045963468 usec, L: 0
0810 13:54:24.544744 (+ 472us) write_op.cc:270] Start()
0810 13:54:24.544809 (+ 65us) write_op.cc:276] Timestamp: P: 1786370046010312 usec, L: 0
0810 13:54:24.545204 (+ 395us) write_op.cc:270] Start()
0810 13:54:24.545270 (+ 66us) write_op.cc:276] Timestamp: P: 1786370046056027 usec, L: 0
0810 13:54:24.545673 (+ 403us) write_op.cc:270] Start()
0810 13:54:24.545738 (+ 65us) write_op.cc:276] Timestamp: P: 1786370046151350 usec, L: 0
0810 13:54:24.546155 (+ 417us) write_op.cc:270] Start()
0810 13:54:24.546220 (+ 65us) write_op.cc:276] Timestamp: P: 1786370046243516 usec, L: 0
0810 13:54:24.546615 (+ 395us) write_op.cc:270] Start()
0810 13:54:24.546675 (+ 60us) write_op.cc:276] Timestamp: P: 1786370046307812 usec, L: 0
0810 13:54:24.547053 (+ 378us) write_op.cc:270] Start()
0810 13:54:24.604728 (+ 57675us) write_op.cc:276] Timestamp: P: 1786370046382554 usec, L: 0
0810 13:54:24.606593 (+ 1865us) write_op.cc:270] Start()
0810 13:54:24.606678 (+ 85us) write_op.cc:276] Timestamp: P: 1786370046436486 usec, L: 0
0810 13:54:24.607191 (+ 513us) write_op.cc:270] Start()
0810 13:54:24.607261 (+ 70us) write_op.cc:276] Timestamp: P: 1786370046478300 usec, L: 0
0810 13:54:24.607691 (+ 430us) write_op.cc:270] Start()
0810 13:54:24.607758 (+ 67us) write_op.cc:276] Timestamp: P: 1786370046679148 usec, L: 0
0810 13:54:24.617715 (+ 9957us) write_op.cc:270] Start()
0810 13:54:24.617804 (+ 89us) write_op.cc:276] Timestamp: P: 1786370046775136 usec, L: 0
0810 13:54:24.618364 (+ 560us) write_op.cc:270] Start()
0810 13:54:24.618443 (+ 79us) write_op.cc:276] Timestamp: P: 1786370046777830 usec, L: 0
0810 13:54:24.618951 (+ 508us) write_op.cc:270] Start()
0810 13:54:24.619032 (+ 81us) write_op.cc:276] Timestamp: P: 1786370046982909 usec, L: 0
0810 13:54:24.619497 (+ 465us) write_op.cc:270] Start()
0810 13:54:24.619579 (+ 82us) write_op.cc:276] Timestamp: P: 1786370047231789 usec, L: 0
0810 13:54:24.620072 (+ 493us) write_op.cc:270] Start()
0810 13:54:24.620147 (+ 75us) write_op.cc:276] Timestamp: P: 1786370047246112 usec, L: 0
0810 13:54:24.620630 (+ 483us) write_op.cc:270] Start()
0810 13:54:24.646621 (+ 25991us) write_op.cc:276] Timestamp: P: 1786370047442777 usec, L: 0
0810 13:54:24.647954 (+ 1333us) write_op.cc:270] Start()
0810 13:54:24.648173 (+ 219us) write_op.cc:276] Timestamp: P: 1786370047444987 usec, L: 0
0810 13:54:24.649165 (+ 992us) write_op.cc:270] Start()
0810 13:54:24.649309 (+ 144us) write_op.cc:276] Timestamp: P: 1786370047446917 usec, L: 0
0810 13:54:24.682570 (+ 33261us) write_op.cc:270] Start()
0810 13:54:24.682653 (+ 83us) write_op.cc:276] Timestamp: P: 1786370047449001 usec, L: 0
0810 13:54:24.683160 (+ 507us) write_op.cc:270] Start()
0810 13:54:24.683339 (+ 179us) write_op.cc:276] Timestamp: P: 1786370047450818 usec, L: 0
0810 13:54:24.687331 (+ 3992us) write_op.cc:270] Start()
0810 13:54:24.687771 (+ 440us) write_op.cc:276] Timestamp: P: 1786370047573094 usec, L: 0
0810 13:54:24.690336 (+ 2565us) write_op.cc:270] Start()
0810 13:54:24.690640 (+ 304us) write_op.cc:276] Timestamp: P: 1786370047589710 usec, L: 0
0810 13:54:24.692975 (+ 2335us) write_op.cc:270] Start()
0810 13:54:24.693278 (+ 303us) write_op.cc:276] Timestamp: P: 1786370047628550 usec, L: 0
0810 13:54:24.696110 (+ 2832us) write_op.cc:270] Start()
0810 13:54:24.696430 (+ 320us) write_op.cc:276] Timestamp: P: 1786370047632781 usec, L: 0
0810 13:54:24.698801 (+ 2371us) write_op.cc:270] Start()
0810 13:54:24.699123 (+ 322us) write_op.cc:276] Timestamp: P: 1786370047704463 usec, L: 0
0810 13:54:24.701742 (+ 2619us) write_op.cc:270] Start()
0810 13:54:24.702190 (+ 448us) write_op.cc:276] Timestamp: P: 1786370047706710 usec, L: 0
0810 13:54:24.707501 (+ 5311us) write_op.cc:270] Start()
0810 13:54:24.707963 (+ 462us) write_op.cc:276] Timestamp: P: 1786370047800526 usec, L: 0
0810 13:54:24.711294 (+ 3331us) write_op.cc:270] Start()
0810 13:54:24.711720 (+ 426us) write_op.cc:276] Timestamp: P: 1786370047816356 usec, L: 0
0810 13:54:24.715698 (+ 3978us) write_op.cc:270] Start()
0810 13:54:24.716015 (+ 317us) write_op.cc:276] Timestamp: P: 1786370047838373 usec, L: 0
0810 13:54:24.718812 (+ 2797us) write_op.cc:270] Start()
0810 13:54:24.719280 (+ 468us) write_op.cc:276] Timestamp: P: 1786370047840464 usec, L: 0
0810 13:54:24.721757 (+ 2477us) write_op.cc:270] Start()
0810 13:54:24.722001 (+ 244us) write_op.cc:276] Timestamp: P: 1786370047850433 usec, L: 0
0810 13:54:24.724614 (+ 2613us) write_op.cc:270] Start()
0810 13:54:24.724977 (+ 363us) write_op.cc:276] Timestamp: P: 1786370047902698 usec, L: 0
0810 13:54:24.755567 (+ 30590us) write_op.cc:270] Start()
0810 13:54:24.761863 (+ 6296us) write_op.cc:276] Timestamp: P: 1786370047940767 usec, L: 0
0810 13:54:24.774238 (+ 12375us) write_op.cc:270] Start()
0810 13:54:24.775150 (+ 912us) write_op.cc:276] Timestamp: P: 1786370048034806 usec, L: 0
0810 13:54:24.791257 (+ 16107us) write_op.cc:270] Start()
0810 13:54:24.791588 (+ 331us) write_op.cc:276] Timestamp: P: 1786370048085461 usec, L: 0
0810 13:54:24.793849 (+ 2261us) write_op.cc:270] Start()
0810 13:54:24.794180 (+ 331us) write_op.cc:276] Timestamp: P: 1786370048102721 usec, L: 0
0810 13:54:24.809201 (+ 15021us) write_op.cc:270] Start()
0810 13:54:24.810069 (+ 868us) write_op.cc:276] Timestamp: P: 1786370048164837 usec, L: 0
0810 13:54:24.821702 (+ 11633us) write_op.cc:270] Start()
0810 13:54:24.822578 (+ 876us) write_op.cc:276] Timestamp: P: 1786370048169218 usec, L: 0
0810 13:54:24.838278 (+ 15700us) write_op.cc:270] Start()
0810 13:54:24.841602 (+ 3324us) write_op.cc:276] Timestamp: P: 1786370048177431 usec, L: 0
0810 13:54:24.846718 (+ 5116us) write_op.cc:270] Start()
0810 13:54:24.846822 (+ 104us) write_op.cc:276] Timestamp: P: 1786370048191954 usec, L: 0
0810 13:54:24.847329 (+ 507us) write_op.cc:270] Start()
0810 13:54:24.869205 (+ 21876us) write_op.cc:276] Timestamp: P: 1786370048266384 usec, L: 0
0810 13:54:24.869802 (+ 597us) write_op.cc:270] Start()
0810 13:54:24.869887 (+ 85us) write_op.cc:276] Timestamp: P: 1786370048332966 usec, L: 0
0810 13:54:24.870362 (+ 475us) write_op.cc:270] Start()
0810 13:54:24.870434 (+ 72us) write_op.cc:276] Timestamp: P: 1786370048347448 usec, L: 0
0810 13:54:24.870888 (+ 454us) write_op.cc:270] Start()
0810 13:54:24.870959 (+ 71us) write_op.cc:276] Timestamp: P: 1786370048469976 usec, L: 0
0810 13:54:24.871393 (+ 434us) write_op.cc:270] Start()
0810 13:54:24.871464 (+ 71us) write_op.cc:276] Timestamp: P: 1786370048535438 usec, L: 0
0810 13:54:24.871894 (+ 430us) write_op.cc:270] Start()
0810 13:54:24.871967 (+ 73us) write_op.cc:276] Timestamp: P: 1786370048540862 usec, L: 0
0810 13:54:24.938369 (+ 66402us) write_op.cc:270] Start()
0810 13:54:24.938461 (+ 92us) write_op.cc:276] Timestamp: P: 1786370048580573 usec, L: 0
0810 13:54:24.939227 (+ 766us) write_op.cc:270] Start()
0810 13:54:24.939303 (+ 76us) write_op.cc:276] Timestamp: P: 1786370048583311 usec, L: 0
0810 13:54:24.939828 (+ 525us) write_op.cc:270] Start()
0810 13:54:24.939903 (+ 75us) write_op.cc:276] Timestamp: P: 1786370048595250 usec, L: 0
0810 13:54:24.940353 (+ 450us) write_op.cc:270] Start()
0810 13:54:24.940420 (+ 67us) write_op.cc:276] Timestamp: P: 1786370048634109 usec, L: 0
0810 13:54:24.965451 (+ 25031us) write_op.cc:270] Start()
0810 13:54:24.965548 (+ 97us) write_op.cc:276] Timestamp: P: 1786370048820124 usec, L: 0
0810 13:54:24.970982 (+ 5434us) write_op.cc:270] Start()
0810 13:54:24.971081 (+ 99us) write_op.cc:276] Timestamp: P: 1786370048906504 usec, L: 0
0810 13:54:24.971639 (+ 558us) write_op.cc:270] Start()
0810 13:54:24.971716 (+ 77us) write_op.cc:276] Timestamp: P: 1786370049119593 usec, L: 0
0810 13:54:24.975190 (+ 3474us) write_op.cc:270] Start()
0810 13:54:24.975369 (+ 179us) write_op.cc:276] Timestamp: P: 1786370049134249 usec, L: 0
0810 13:54:24.975834 (+ 465us) write_op.cc:270] Start()
0810 13:54:24.975904 (+ 70us) write_op.cc:276] Timestamp: P: 1786370049173384 usec, L: 0
0810 13:54:24.976331 (+ 427us) write_op.cc:270] Start()
0810 13:54:24.976398 (+ 67us) write_op.cc:276] Timestamp: P: 17863700
I20260810 13:54:36.916733 13639 raft_consensus.cc:359] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.917416 13639 raft_consensus.cc:385] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:36.917706 13639 raft_consensus.cc:740] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:36.918318 13639 consensus_queue.cc:260] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:36.938287 13639 ts_tablet_manager.cc:1434] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.035s user 0.007s sys 0.000s
I20260810 13:54:36.945570 13639 tablet_bootstrap.cc:492] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:36.955551 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:36.955974 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:36.957964 13639 tablet_bootstrap.cc:654] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:36.973428 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 116204us
I20260810 13:54:36.984134 13638 ts_tablet_manager.cc:1434] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.435s user 0.009s sys 0.001s
I20260810 13:54:36.987135 12494 catalog_manager.cc:5719] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:36.997707 12494 catalog_manager.cc:5719] T 6ad53d1da7b34194b4b7a78c52870c6b P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:36.999195 12494 catalog_manager.cc:5719] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:37.000165 12494 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]). Expected version 2 got 0
I20260810 13:54:37.001093 12494 catalog_manager.cc:5719] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:37.014797 13639 tablet_bootstrap.cc:492] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:37.015259 13639 ts_tablet_manager.cc:1403] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.070s user 0.007s sys 0.002s
I20260810 13:54:37.017741 13639 raft_consensus.cc:359] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.018375 13639 raft_consensus.cc:385] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:37.018615 13639 raft_consensus.cc:740] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:37.019169 13639 consensus_queue.cc:260] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.030539 13639 ts_tablet_manager.cc:1434] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260810 13:54:37.031600 13639 tablet_bootstrap.cc:492] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:37.035458 12952 leader_election.cc:343] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:37.056005 17316 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:37.057003 17251 raft_consensus.cc:493] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:37.057497 17251 raft_consensus.cc:515] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.059609 17251 leader_election.cc:290] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.060859 17316 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.062906 13639 tablet_bootstrap.cc:654] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:37.063823 17316 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.070506 12952 leader_election.cc:304] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:37.071681 17251 raft_consensus.cc:2804] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:37.072366 17251 raft_consensus.cc:697] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:37.073385 17251 consensus_queue.cc:237] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.079164 13639 tablet_bootstrap.cc:492] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:37.079594 13639 ts_tablet_manager.cc:1403] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.048s user 0.009s sys 0.000s
I20260810 13:54:37.085475 13639 raft_consensus.cc:359] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.088274 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:37.094380 13639 raft_consensus.cc:385] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:37.094602 13043 raft_consensus.cc:2393] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:37.095059 13639 raft_consensus.cc:740] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:37.096041 13639 consensus_queue.cc:260] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.139957 13638 tablet_bootstrap.cc:492] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:37.141369 17257 raft_consensus.cc:493] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.142019 17257 raft_consensus.cc:515] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.144403 17257 leader_election.cc:290] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.153714 17257 raft_consensus.cc:493] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.153035 17247 raft_consensus.cc:493] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.158174 17247 raft_consensus.cc:515] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.161823 17247 leader_election.cc:290] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.162361 17247 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.163004 17257 raft_consensus.cc:515] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.170548 17257 leader_election.cc:290] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.163700 17247 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.208756 17247 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.181063 17257 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.211295 17257 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.215641 17251 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.225276 17251 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.227419 17251 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:37.216325 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 108936us
I20260810 13:54:37.249008 17257 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.195904 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:37.264287 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:37.263832 13640 raft_consensus.cc:385] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:37.265100 13640 raft_consensus.cc:740] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:37.266662 13640 consensus_queue.cc:260] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.197875 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:37.269088 13465 raft_consensus.cc:2468] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:37.198966 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:36.786722 13468 raft_consensus.cc:2468] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:37.203747 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:37.223039 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:37.272450 13640 ts_tablet_manager.cc:1434] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.457s user 0.006s sys 0.001s
I20260810 13:54:37.281174 17333 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:37.282215 17333 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb [sys.catalog]: This master's current role is: LEADER
I20260810 13:54:37.287333 13639 ts_tablet_manager.cc:1434] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.207s user 0.052s sys 0.047s
I20260810 13:54:37.288429 13639 tablet_bootstrap.cc:492] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:37.299474 13638 tablet_bootstrap.cc:654] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:37.303257 13639 tablet_bootstrap.cc:654] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:37.309293 17251 raft_consensus.cc:493] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.309872 17251 raft_consensus.cc:515] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.312011 17251 leader_election.cc:290] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.313321 17257 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.313807 17257 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.315721 17257 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.320237 13639 tablet_bootstrap.cc:492] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:37.319885 17328 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.320765 13639 ts_tablet_manager.cc:1403] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.033s user 0.014s sys 0.000s
I20260810 13:54:37.320972 17328 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.323247 17328 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.323421 13639 raft_consensus.cc:359] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.324095 17328 raft_consensus.cc:493] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.324119 13639 raft_consensus.cc:385] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:37.389688 13639 raft_consensus.cc:740] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:37.390516 13639 consensus_queue.cc:260] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.398012 13343 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:37.401247 13639 ts_tablet_manager.cc:1434] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.080s user 0.006s sys 0.001s
I20260810 13:54:37.402516 13639 tablet_bootstrap.cc:492] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:37.348891 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:37.349948 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:37.405635 13043 raft_consensus.cc:3060] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:37.350363 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:37.351375 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:37.351595 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:37.408876 17352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:37.409804 17352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:54:37.409644 17345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "d9666026fb7e4c85b46c6aab952932fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } } }
I20260810 13:54:37.410377 17345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [sys.catalog]: This master's current role is: FOLLOWER
I20260810 13:54:37.426105 13043 raft_consensus.cc:2468] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:37.354491 17324 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.427223 17324 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.429740 17324 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.344991 17251 raft_consensus.cc:493] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:37.430701 17251 raft_consensus.cc:515] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.432799 17363 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:37.432879 17251 leader_election.cc:290] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.434432 17363 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:37.438460 15216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:37.457644 17363 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:37.459467 17328 raft_consensus.cc:515] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.527535 13640 tablet_bootstrap.cc:492] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:37.539970 17328 leader_election.cc:290] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.550060 13639 tablet_bootstrap.cc:700] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3: Time spent opening tablet: real 0.114s user 0.003s sys 0.000s
I20260810 13:54:37.551131 13639 tablet_bootstrap.cc:654] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:37.558023 13638 tablet_bootstrap.cc:492] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:37.558702 13638 ts_tablet_manager.cc:1403] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.419s user 0.012s sys 0.000s
I20260810 13:54:37.614691 13638 raft_consensus.cc:359] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.617308 13124 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:37.618732 13638 raft_consensus.cc:385] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:37.623415 13638 raft_consensus.cc:740] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:37.624879 13638 consensus_queue.cc:260] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.626279 17335 raft_consensus.cc:493] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:37.626899 17335 raft_consensus.cc:515] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.629379 17335 leader_election.cc:290] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:37.646843 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:37.657217 12729 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:37.658300 17363 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260810 13:54:37.690240 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 370709us
W20260810 13:54:37.693346 12952 leader_election.cc:343] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:37.728941 12951 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 74113.9us
I20260810 13:54:37.665834 17309 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:37.734246 17309 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:37.744125 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:37.761749 13639 tablet_bootstrap.cc:492] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:37.762261 13639 ts_tablet_manager.cc:1403] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.360s user 0.010s sys 0.000s
I20260810 13:54:37.736665 17309 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:37.769353 13638 ts_tablet_manager.cc:1434] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.210s user 0.007s sys 0.000s
I20260810 13:54:37.771116 13236 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a4fe8abad5649f2a42686c00148d957 with delete_type TABLET_DATA_DELETED (replaced by tablet df3031d8f75d4548b458cee6dd2083d2) from {username='slave'} at 127.0.0.1:55268
I20260810 13:54:37.776468 13638 tablet_bootstrap.cc:492] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:37.777812 13639 raft_consensus.cc:359] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.778498 13639 raft_consensus.cc:385] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:37.778785 13639 raft_consensus.cc:740] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:37.779482 13639 consensus_queue.cc:260] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.782244 13639 ts_tablet_manager.cc:1434] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20260810 13:54:37.784804 13639 tablet_bootstrap.cc:492] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:37.795037 13638 tablet_bootstrap.cc:654] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:37.798472 13639 tablet_bootstrap.cc:654] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:37.815888 13638 tablet_bootstrap.cc:492] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:37.816318 13638 ts_tablet_manager.cc:1403] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.040s user 0.010s sys 0.000s
I20260810 13:54:37.818667 13638 raft_consensus.cc:359] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.819335 13638 raft_consensus.cc:385] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:37.819578 13638 raft_consensus.cc:740] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:37.823714 13639 tablet_bootstrap.cc:492] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:37.824118 13639 ts_tablet_manager.cc:1403] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.040s user 0.011s sys 0.000s
W20260810 13:54:37.825228 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 150809us
I20260810 13:54:37.843108 13639 raft_consensus.cc:359] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.843958 13639 raft_consensus.cc:385] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:37.844200 13639 raft_consensus.cc:740] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:37.845685 13639 consensus_queue.cc:260] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.848400 13639 ts_tablet_manager.cc:1434] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260810 13:54:37.849767 13639 tablet_bootstrap.cc:492] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:37.856419 13639 tablet_bootstrap.cc:654] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:37.820175 13638 consensus_queue.cc:260] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:37.867009 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 07405ca45a9c4575bc653c2dd95fea6b (DEFAULT_TABLE table=default.Table_356ec0418a38420d8a4e18b2f69682c3 [id=f8b08e6c518647d194daba555502622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.867291 13233 tablet_service.cc:1511] Processing CreateTablet for tablet e7b637166ce24e4fa1fd32aaa1ada207 (DEFAULT_TABLE table=default.Table_03b06d24159c4b079c0008aa041c517b [id=af367ad99e9a4fa9907c170b0a5dee49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.868494 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07405ca45a9c4575bc653c2dd95fea6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.869925 13223 tablet_service.cc:1511] Processing CreateTablet for tablet f1c3e25d16f847a9b7f4194b5a0bbe90 (DEFAULT_TABLE table=default.Table_4f9508194c21480d9b603b139bdaf902 [id=98e554f12bf944c98887ed2293df2e26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.871203 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b637166ce24e4fa1fd32aaa1ada207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.871830 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c3e25d16f847a9b7f4194b5a0bbe90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.898976 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 07405ca45a9c4575bc653c2dd95fea6b (DEFAULT_TABLE table=default.Table_356ec0418a38420d8a4e18b2f69682c3 [id=f8b08e6c518647d194daba555502622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.901629 13432 tablet_service.cc:1511] Processing CreateTablet for tablet 7967a22850ae48a58fbcb8cb17f189e9 (DEFAULT_TABLE table=default.Table_d5c509cabbb84883a9a911c2f4e04c88 [id=865c0ec036ca45caaec23fe2cf899d1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.903589 13424 tablet_service.cc:1511] Processing CreateTablet for tablet a46ee6471e914b63afddc7d6dc967b9a (DEFAULT_TABLE table=default.Table_921fde42e0214ef58181c03785687004 [id=828ce62882b949d6887e75923229655e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.905107 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07405ca45a9c4575bc653c2dd95fea6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.905648 13442 tablet_service.cc:1511] Processing CreateTablet for tablet f37d338cf7244b68b6c6e4868113d248 (DEFAULT_TABLE table=default.Table_ee9ef5f74a944eaabe6af879e8ab15a2 [id=7a8f1c3ab411436fa3940b3261d0e05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.907140 13429 tablet_service.cc:1511] Processing CreateTablet for tablet 21e31826c3a94981b6a47bf9feee9f83 (DEFAULT_TABLE table=default.Table_d21ea3e2ede2490b963de16453e2ad9e [id=c34177c45eda4d9e892e77cc723efbf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.908500 13427 tablet_service.cc:1511] Processing CreateTablet for tablet f1c3e25d16f847a9b7f4194b5a0bbe90 (DEFAULT_TABLE table=default.Table_4f9508194c21480d9b603b139bdaf902 [id=98e554f12bf944c98887ed2293df2e26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.913147 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7967a22850ae48a58fbcb8cb17f189e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.920125 13210 tablet_service.cc:1511] Processing CreateTablet for tablet 7967a22850ae48a58fbcb8cb17f189e9 (DEFAULT_TABLE table=default.Table_d5c509cabbb84883a9a911c2f4e04c88 [id=865c0ec036ca45caaec23fe2cf899d1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.921382 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7967a22850ae48a58fbcb8cb17f189e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.922667 13208 tablet_service.cc:1511] Processing CreateTablet for tablet f37d338cf7244b68b6c6e4868113d248 (DEFAULT_TABLE table=default.Table_ee9ef5f74a944eaabe6af879e8ab15a2 [id=7a8f1c3ab411436fa3940b3261d0e05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.924360 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 21e31826c3a94981b6a47bf9feee9f83 (DEFAULT_TABLE table=default.Table_d21ea3e2ede2490b963de16453e2ad9e [id=c34177c45eda4d9e892e77cc723efbf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.926038 13221 tablet_service.cc:1511] Processing CreateTablet for tablet e24ce014b17f418fbea698adb0d7ff60 (DEFAULT_TABLE table=default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.927783 13213 tablet_service.cc:1511] Processing CreateTablet for tablet a46ee6471e914b63afddc7d6dc967b9a (DEFAULT_TABLE table=default.Table_921fde42e0214ef58181c03785687004 [id=828ce62882b949d6887e75923229655e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.931368 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24ce014b17f418fbea698adb0d7ff60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.932747 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f37d338cf7244b68b6c6e4868113d248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.934077 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e31826c3a94981b6a47bf9feee9f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.935344 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46ee6471e914b63afddc7d6dc967b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:37.918332 13448 tablet_service.cc:1511] Processing CreateTablet for tablet e7b637166ce24e4fa1fd32aaa1ada207 (DEFAULT_TABLE table=default.Table_03b06d24159c4b079c0008aa041c517b [id=af367ad99e9a4fa9907c170b0a5dee49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.946941 13638 ts_tablet_manager.cc:1434] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.130s user 0.006s sys 0.009s
I20260810 13:54:37.918363 13419 tablet_service.cc:1511] Processing CreateTablet for tablet e24ce014b17f418fbea698adb0d7ff60 (DEFAULT_TABLE table=default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.951639 13426 tablet_service.cc:1511] Processing CreateTablet for tablet bf9beaff9d5245f8b0e8606ed0d888c6 (DEFAULT_TABLE table=default.Table_b5e6f89f8d854f7e991193036d4d8321 [id=5d59e07d6bc5465eaaf40d68610bc154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.952235 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 6187783a473a42488fabf362f9a156cf (DEFAULT_TABLE table=default.Table_fd80397e5f4247339b3e3d483a671afa [id=3f7a51368fe34ca6b66f5c810e94ae60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.953154 13438 tablet_service.cc:1511] Processing CreateTablet for tablet 15857ead4a9a48c49b4acea92d4bba60 (DEFAULT_TABLE table=default.Table_2da57f87f29a425dbef85d4f4db4bc26 [id=d3522604bed74abf8b357894ca97ddad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.955888 13640 tablet_bootstrap.cc:654] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:37.956346 13425 tablet_service.cc:1511] Processing CreateTablet for tablet 1946995eb9354e19916f31e1f8e46996 (DEFAULT_TABLE table=default.Table_b6a730448efc42958de4f9513cbd365b [id=dbf489131f724a7b85f1bac4f9e3e614]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.961228 13420 tablet_service.cc:1511] Processing CreateTablet for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (DEFAULT_TABLE table=default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.962633 13421 tablet_service.cc:1511] Processing CreateTablet for tablet 14e68b57d7fb40cd8430144733749c21 (DEFAULT_TABLE table=default.Table_40e69780eeb744aa8a192c8623bc7d4b [id=2ef48298f4404224bb44136ff71befd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.964087 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3485a1b77a4b80acbf48de92b5cf33 (DEFAULT_TABLE table=default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 [id=d8943f60b8e3464087c954a42ff795ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.965690 13435 tablet_service.cc:1511] Processing CreateTablet for tablet 146ff83104d247cfa565cec8579ca00f (DEFAULT_TABLE table=default.Table_7cf74351dd314634a7a8ca1b1a24302b [id=884f2bca73394b0b97902104a5b68976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.967690 13428 tablet_service.cc:1511] Processing CreateTablet for tablet d1b2835286e14a8e827f7a61801ffb17 (DEFAULT_TABLE table=default.Table_a3085b5448ff4df8a25c4802ca130085 [id=b3648e88a1fc44808dcf824092d5de35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.971258 13434 tablet_service.cc:1511] Processing CreateTablet for tablet 26ca6ce1b13942f4af59ea1d38fd395c (DEFAULT_TABLE table=default.Table_734de53e103d480c93e2779ef687142e [id=23152d9b944747f89cd06ee3a569b5b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.982916 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]). Expected version 1 got 0
I20260810 13:54:37.986793 13008 tablet_service.cc:1558] Processing DeleteTablet for tablet 674599456f9a49dc98d8d089c166ca89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:00 UTC) from {username='slave'} at 127.0.0.1:55806
I20260810 13:54:37.987466 13022 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a1b35d369474ba9bee379089796bd3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 13:54:01 UTC) from {username='slave'} at 127.0.0.1:55806
I20260810 13:54:37.988657 13004 tablet_service.cc:1511] Processing CreateTablet for tablet e7b637166ce24e4fa1fd32aaa1ada207 (DEFAULT_TABLE table=default.Table_03b06d24159c4b079c0008aa041c517b [id=af367ad99e9a4fa9907c170b0a5dee49]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.989476 13009 tablet_service.cc:1511] Processing CreateTablet for tablet 7967a22850ae48a58fbcb8cb17f189e9 (DEFAULT_TABLE table=default.Table_d5c509cabbb84883a9a911c2f4e04c88 [id=865c0ec036ca45caaec23fe2cf899d1d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.990613 13003 tablet_service.cc:1511] Processing CreateTablet for tablet e24ce014b17f418fbea698adb0d7ff60 (DEFAULT_TABLE table=default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.990792 12998 tablet_service.cc:1511] Processing CreateTablet for tablet a46ee6471e914b63afddc7d6dc967b9a (DEFAULT_TABLE table=default.Table_921fde42e0214ef58181c03785687004 [id=828ce62882b949d6887e75923229655e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.991858 13014 tablet_service.cc:1511] Processing CreateTablet for tablet bf9beaff9d5245f8b0e8606ed0d888c6 (DEFAULT_TABLE table=default.Table_b5e6f89f8d854f7e991193036d4d8321 [id=5d59e07d6bc5465eaaf40d68610bc154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.992161 12999 tablet_service.cc:1511] Processing CreateTablet for tablet f37d338cf7244b68b6c6e4868113d248 (DEFAULT_TABLE table=default.Table_ee9ef5f74a944eaabe6af879e8ab15a2 [id=7a8f1c3ab411436fa3940b3261d0e05f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.993191 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 6187783a473a42488fabf362f9a156cf (DEFAULT_TABLE table=default.Table_fd80397e5f4247339b3e3d483a671afa [id=3f7a51368fe34ca6b66f5c810e94ae60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.993633 13019 tablet_service.cc:1511] Processing CreateTablet for tablet 21e31826c3a94981b6a47bf9feee9f83 (DEFAULT_TABLE table=default.Table_d21ea3e2ede2490b963de16453e2ad9e [id=c34177c45eda4d9e892e77cc723efbf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.994732 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 15857ead4a9a48c49b4acea92d4bba60 (DEFAULT_TABLE table=default.Table_2da57f87f29a425dbef85d4f4db4bc26 [id=d3522604bed74abf8b357894ca97ddad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.995105 13007 tablet_service.cc:1511] Processing CreateTablet for tablet 1946995eb9354e19916f31e1f8e46996 (DEFAULT_TABLE table=default.Table_b6a730448efc42958de4f9513cbd365b [id=dbf489131f724a7b85f1bac4f9e3e614]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.996548 13012 tablet_service.cc:1511] Processing CreateTablet for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (DEFAULT_TABLE table=default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.988668 13021 tablet_service.cc:1511] Processing CreateTablet for tablet 07405ca45a9c4575bc653c2dd95fea6b (DEFAULT_TABLE table=default.Table_356ec0418a38420d8a4e18b2f69682c3 [id=f8b08e6c518647d194daba555502622a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:37.998628 13022 tablet_service.cc:1511] Processing CreateTablet for tablet f1c3e25d16f847a9b7f4194b5a0bbe90 (DEFAULT_TABLE table=default.Table_4f9508194c21480d9b603b139bdaf902 [id=98e554f12bf944c98887ed2293df2e26]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:37.981038 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 119388us
I20260810 13:54:37.983700 12494 catalog_manager.cc:5719] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:38.017535 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d36f17094e504d80a2443dc12855c744 (table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67]). Expected version 1 got 0
I20260810 13:54:38.018528 12494 catalog_manager.cc:5719] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:38.029124 13638 tablet_bootstrap.cc:492] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:38.019853 12494 catalog_manager.cc:5719] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:38.029536 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb]). Expected version 1 got 0
I20260810 13:54:38.030205 12494 catalog_manager.cc:5719] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:38.033272 13004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b637166ce24e4fa1fd32aaa1ada207. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:38.036813 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 172556us
I20260810 13:54:38.037281 13009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7967a22850ae48a58fbcb8cb17f189e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.041291 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24ce014b17f418fbea698adb0d7ff60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.045341 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46ee6471e914b63afddc7d6dc967b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.046809 17317 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:38.049398 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9beaff9d5245f8b0e8606ed0d888c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.053128 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f37d338cf7244b68b6c6e4868113d248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.058495 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6187783a473a42488fabf362f9a156cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.061149 13019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e31826c3a94981b6a47bf9feee9f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.065187 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15857ead4a9a48c49b4acea92d4bba60. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:38.068725 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 145171us
I20260810 13:54:38.069929 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1946995eb9354e19916f31e1f8e46996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.070577 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c3e25d16f847a9b7f4194b5a0bbe90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.071435 12997 tablet_service.cc:1511] Processing CreateTablet for tablet 14e68b57d7fb40cd8430144733749c21 (DEFAULT_TABLE table=default.Table_40e69780eeb744aa8a192c8623bc7d4b [id=2ef48298f4404224bb44136ff71befd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.072562 12997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e68b57d7fb40cd8430144733749c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.073120 13021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07405ca45a9c4575bc653c2dd95fea6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.077029 13012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83239e6cbf1c431fb2fb2a2dae105d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.063529 17198 raft_consensus.cc:493] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:38.094921 13020 tablet_service.cc:1511] Processing CreateTablet for tablet 146ff83104d247cfa565cec8579ca00f (DEFAULT_TABLE table=default.Table_7cf74351dd314634a7a8ca1b1a24302b [id=884f2bca73394b0b97902104a5b68976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.095196 13010 tablet_service.cc:1511] Processing CreateTablet for tablet d1b2835286e14a8e827f7a61801ffb17 (DEFAULT_TABLE table=default.Table_a3085b5448ff4df8a25c4802ca130085 [id=b3648e88a1fc44808dcf824092d5de35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.102953 13006 tablet_service.cc:1511] Processing CreateTablet for tablet 26ca6ce1b13942f4af59ea1d38fd395c (DEFAULT_TABLE table=default.Table_734de53e103d480c93e2779ef687142e [id=23152d9b944747f89cd06ee3a569b5b3]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:38.108278 12494 catalog_manager.cc:5911] Failed to send AlterTable RPC for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d7ffb0f96e744a4bb734aba7f3d82995 consensus state has no leader
W20260810 13:54:38.137235 12476 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7ffb0f96e744a4bb734aba7f3d82995 consensus state has no leader
W20260810 13:54:38.157791 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 120199us
I20260810 13:54:38.047479 17317 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:38.163635 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 93524.7us
I20260810 13:54:38.164498 13164 leader_election.cc:304] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:38.225757 13436 tablet_service.cc:1511] Processing CreateTablet for tablet eb7fe3793da743e293800961b029fc56 (DEFAULT_TABLE table=default.Table_e424bd25638b4b23b721c8529aa42285 [id=126e0229d9904feba5c16222cecf5140]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.236179 13008 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3485a1b77a4b80acbf48de92b5cf33 (DEFAULT_TABLE table=default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 [id=d8943f60b8e3464087c954a42ff795ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.086055 17198 raft_consensus.cc:515] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.279229 17376 tablet_replica.cc:333] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: stopping tablet replica
I20260810 13:54:38.280233 17376 raft_consensus.cc:2243] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 13:54:38.280596 17374 raft_consensus.cc:493] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:38.281075 17374 raft_consensus.cc:515] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.105087 17328 raft_consensus.cc:493] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:38.282948 17374 leader_election.cc:290] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.286001 13638 tablet_bootstrap.cc:654] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:38.173269 17316 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:38.305472 17390 raft_consensus.cc:2749] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:38.306218 17198 leader_election.cc:290] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:38.334144 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:38.268042 17385 tablet_replica.cc:333] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
I20260810 13:54:38.308012 17376 raft_consensus.cc:2272] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:38.350996 17394 raft_consensus.cc:493] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:38.351442 17394 raft_consensus.cc:515] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:38.352737 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 184557us
I20260810 13:54:38.298719 17316 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.366096 17316 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.327335 17372 raft_consensus.cc:493] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:38.371381 17372 raft_consensus.cc:515] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.353545 17394 leader_election.cc:290] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.354127 17380 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:38.375757 17380 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.376866 17317 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.386346 17380 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.378808 17376 ts_tablet_manager.cc:1916] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:38.391036 17374 raft_consensus.cc:493] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:38.391507 17374 raft_consensus.cc:515] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.394275 17374 leader_election.cc:290] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.398339 17394 raft_consensus.cc:493] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:38.398773 17394 raft_consensus.cc:515] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.400591 17394 leader_election.cc:290] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.405377 17372 leader_election.cc:290] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.408839 17398 consensus_queue.cc:1048] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260810 13:54:38.419013 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 15857ead4a9a48c49b4acea92d4bba60 (DEFAULT_TABLE table=default.Table_2da57f87f29a425dbef85d4f4db4bc26 [id=d3522604bed74abf8b357894ca97ddad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.419301 17374 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:38.420046 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15857ead4a9a48c49b4acea92d4bba60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.419727 17374 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.421566 17374 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.422614 13210 tablet_service.cc:1511] Processing CreateTablet for tablet bf9beaff9d5245f8b0e8606ed0d888c6 (DEFAULT_TABLE table=default.Table_b5e6f89f8d854f7e991193036d4d8321 [id=5d59e07d6bc5465eaaf40d68610bc154]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.423571 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9beaff9d5245f8b0e8606ed0d888c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.427932 17395 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:38.429989 13213 tablet_service.cc:1511] Processing CreateTablet for tablet 6187783a473a42488fabf362f9a156cf (DEFAULT_TABLE table=default.Table_fd80397e5f4247339b3e3d483a671afa [id=3f7a51368fe34ca6b66f5c810e94ae60]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.299319 17328 raft_consensus.cc:515] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.431146 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 1946995eb9354e19916f31e1f8e46996 (DEFAULT_TABLE table=default.Table_b6a730448efc42958de4f9513cbd365b [id=dbf489131f724a7b85f1bac4f9e3e614]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.434353 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1946995eb9354e19916f31e1f8e46996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.432648 13233 tablet_service.cc:1511] Processing CreateTablet for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (DEFAULT_TABLE table=default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.436769 13000 tablet_service.cc:1511] Processing CreateTablet for tablet 9467e5c106b14619a7bf1f3e1f4f9c72 (DEFAULT_TABLE table=default.Table_6d071c01702c4d3cb0e693f02ef8a90f [id=20edfa4b7c00446bae121b000f8faf5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.437337 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83239e6cbf1c431fb2fb2a2dae105d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.448634 13221 tablet_service.cc:1511] Processing CreateTablet for tablet 14e68b57d7fb40cd8430144733749c21 (DEFAULT_TABLE table=default.Table_40e69780eeb744aa8a192c8623bc7d4b [id=2ef48298f4404224bb44136ff71befd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.449673 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e68b57d7fb40cd8430144733749c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.450433 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6187783a473a42488fabf362f9a156cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.451553 13236 tablet_service.cc:1511] Processing CreateTablet for tablet 9f3485a1b77a4b80acbf48de92b5cf33 (DEFAULT_TABLE table=default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 [id=d8943f60b8e3464087c954a42ff795ba]), partition=RANGE (key) PARTITION UNBOUNDED
W20260810 13:54:38.467109 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 49975us
I20260810 13:54:38.490250 13640 tablet_bootstrap.cc:492] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:38.491287 13640 ts_tablet_manager.cc:1403] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.964s user 0.011s sys 0.010s
I20260810 13:54:38.493119 13417 tablet_service.cc:1511] Processing CreateTablet for tablet 9467e5c106b14619a7bf1f3e1f4f9c72 (DEFAULT_TABLE table=default.Table_6d071c01702c4d3cb0e693f02ef8a90f [id=20edfa4b7c00446bae121b000f8faf5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.493768 13552 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:38.511852 13424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a46ee6471e914b63afddc7d6dc967b9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.514266 17328 leader_election.cc:290] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.491163 12996 tablet_service.cc:1511] Processing CreateTablet for tablet eb7fe3793da743e293800961b029fc56 (DEFAULT_TABLE table=default.Table_e424bd25638b4b23b721c8529aa42285 [id=126e0229d9904feba5c16222cecf5140]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.514859 13020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146ff83104d247cfa565cec8579ca00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.515395 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9467e5c106b14619a7bf1f3e1f4f9c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.522753 17391 raft_consensus.cc:493] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:38.523288 17391 raft_consensus.cc:515] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.524339 13640 raft_consensus.cc:359] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.525035 13640 raft_consensus.cc:385] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:38.525276 13640 raft_consensus.cc:740] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:38.525341 17391 leader_election.cc:290] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.525835 13640 consensus_queue.cc:260] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.534989 13442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f37d338cf7244b68b6c6e4868113d248. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.536280 13010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b2835286e14a8e827f7a61801ffb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.536767 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf9beaff9d5245f8b0e8606ed0d888c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.541019 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7b637166ce24e4fa1fd32aaa1ada207. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:38.543118 13382 leader_election.cc:343] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:38.544332 13382 leader_election.cc:343] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:38.545101 13438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15857ead4a9a48c49b4acea92d4bba60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.545732 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6187783a473a42488fabf362f9a156cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.546358 13429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21e31826c3a94981b6a47bf9feee9f83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.546929 13427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c3e25d16f847a9b7f4194b5a0bbe90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.550058 13425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1946995eb9354e19916f31e1f8e46996. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.550643 13419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e24ce014b17f418fbea698adb0d7ff60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.558521 13006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ca6ce1b13942f4af59ea1d38fd395c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.558528 13639 tablet_bootstrap.cc:492] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:38.559017 13639 ts_tablet_manager.cc:1403] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.709s user 0.011s sys 0.004s
W20260810 13:54:38.560415 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 74652.7us
I20260810 13:54:38.562008 12998 tablet_service.cc:1511] Processing CreateTablet for tablet 19fe94b1d72b4bb29f0154f58c9fa43f (DEFAULT_TABLE table=default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.563040 12998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fe94b1d72b4bb29f0154f58c9fa43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.561458 13639 raft_consensus.cc:359] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.564525 13639 raft_consensus.cc:385] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:38.564797 13639 raft_consensus.cc:740] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:38.565764 13018 tablet_service.cc:1511] Processing CreateTablet for tablet 9b1cfcc6b1834ebbb0d5cd4a7967e2cd (DEFAULT_TABLE table=default.Table_51d643dcb2a5451e9cff367f2b3649c5 [id=46372d6eedfe4d56b2f2ce9a85f7f1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.566648 13018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b1cfcc6b1834ebbb0d5cd4a7967e2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.566340 13639 consensus_queue.cc:260] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.567801 13639 ts_tablet_manager.cc:1434] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260810 13:54:38.568621 13639 tablet_bootstrap.cc:492] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:38.569674 12999 tablet_service.cc:1511] Processing CreateTablet for tablet b09ec8ef75e94a83a155d901235e7ce0 (DEFAULT_TABLE table=default.Table_699797a1320b40709d0bf25947241900 [id=f656a6598c1145d89230d014ba6873a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.571425 13014 tablet_service.cc:1511] Processing CreateTablet for tablet 27649cff0c5f4e6783e8a2f0a1f847ae (DEFAULT_TABLE table=default.Table_1668535b5107458a842c0def2c55461f [id=0cdd1449d5734d559f49933deef6bb19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.573557 13011 tablet_service.cc:1511] Processing CreateTablet for tablet 7685f9b4b25541d98cfdaba36cd0276c (DEFAULT_TABLE table=default.Table_f0a8373b96114e0c896e54dcb940f74d [id=0c70c375ac604d158df38f374fc3c1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.575645 13022 tablet_service.cc:1511] Processing CreateTablet for tablet 01f616bc07234fa2a454811e75a1aec2 (DEFAULT_TABLE table=default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 [id=7a8b712d0b1a4766ab00cd2c4739c311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.584263 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b2835286e14a8e827f7a61801ffb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.593149 12999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b09ec8ef75e94a83a155d901235e7ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.593955 13014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27649cff0c5f4e6783e8a2f0a1f847ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.594487 13022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f616bc07234fa2a454811e75a1aec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.595024 13011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685f9b4b25541d98cfdaba36cd0276c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.610430 13236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3485a1b77a4b80acbf48de92b5cf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.617566 13206 tablet_service.cc:1511] Processing CreateTablet for tablet 146ff83104d247cfa565cec8579ca00f (DEFAULT_TABLE table=default.Table_7cf74351dd314634a7a8ca1b1a24302b [id=884f2bca73394b0b97902104a5b68976]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.618711 17309 raft_consensus.cc:493] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:38.619222 17309 raft_consensus.cc:515] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.621289 17309 leader_election.cc:290] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.428408 17395 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:38.623474 12951 leader_election.cc:343] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:38.623873 12951 leader_election.cc:304] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:38.624142 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146ff83104d247cfa565cec8579ca00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.624511 17395 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.629398 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:38.632019 13208 tablet_service.cc:1511] Processing CreateTablet for tablet 9467e5c106b14619a7bf1f3e1f4f9c72 (DEFAULT_TABLE table=default.Table_6d071c01702c4d3cb0e693f02ef8a90f [id=20edfa4b7c00446bae121b000f8faf5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.633039 13208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9467e5c106b14619a7bf1f3e1f4f9c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.635630 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:38.637008 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:38.637303 13210 tablet_service.cc:1511] Processing CreateTablet for tablet eb7fe3793da743e293800961b029fc56 (DEFAULT_TABLE table=default.Table_e424bd25638b4b23b721c8529aa42285 [id=126e0229d9904feba5c16222cecf5140]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.638325 13210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7fe3793da743e293800961b029fc56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.642601 13638 tablet_bootstrap.cc:492] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:38.643020 13638 ts_tablet_manager.cc:1403] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.614s user 0.014s sys 0.005s
I20260810 13:54:38.644550 17399 raft_consensus.cc:493] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:38.645057 17399 raft_consensus.cc:515] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.647651 13432 tablet_service.cc:1511] Processing CreateTablet for tablet 9b1cfcc6b1834ebbb0d5cd4a7967e2cd (DEFAULT_TABLE table=default.Table_51d643dcb2a5451e9cff367f2b3649c5 [id=46372d6eedfe4d56b2f2ce9a85f7f1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.653730 13435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146ff83104d247cfa565cec8579ca00f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.624491 17247 raft_consensus.cc:493] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:38.657773 17247 raft_consensus.cc:515] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.659610 17247 leader_election.cc:290] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.669549 13423 tablet_service.cc:1511] Processing CreateTablet for tablet 19fe94b1d72b4bb29f0154f58c9fa43f (DEFAULT_TABLE table=default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.672295 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:38.673452 13434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ca6ce1b13942f4af59ea1d38fd395c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.673568 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:38.675093 13426 tablet_service.cc:1511] Processing CreateTablet for tablet b09ec8ef75e94a83a155d901235e7ce0 (DEFAULT_TABLE table=default.Table_699797a1320b40709d0bf25947241900 [id=f656a6598c1145d89230d014ba6873a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.676038 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b09ec8ef75e94a83a155d901235e7ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.675860 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:38.676965 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:38.677803 13255 raft_consensus.cc:3060] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:38.678642 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 26ca6ce1b13942f4af59ea1d38fd395c (DEFAULT_TABLE table=default.Table_734de53e103d480c93e2779ef687142e [id=23152d9b944747f89cd06ee3a569b5b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.679627 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26ca6ce1b13942f4af59ea1d38fd395c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:38.679771 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 56326.4us
W20260810 13:54:38.680447 12951 leader_election.cc:343] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:38.680832 12951 leader_election.cc:304] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:38.684113 17324 raft_consensus.cc:2749] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:38.684660 17324 raft_consensus.cc:2749] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:38.687847 13209 tablet_service.cc:1511] Processing CreateTablet for tablet 9b1cfcc6b1834ebbb0d5cd4a7967e2cd (DEFAULT_TABLE table=default.Table_51d643dcb2a5451e9cff367f2b3649c5 [id=46372d6eedfe4d56b2f2ce9a85f7f1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.688786 13209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b1cfcc6b1834ebbb0d5cd4a7967e2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.690297 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83239e6cbf1c431fb2fb2a2dae105d61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.692153 17401 raft_consensus.cc:493] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:38.694229 13239 tablet_service.cc:1511] Processing CreateTablet for tablet 19fe94b1d72b4bb29f0154f58c9fa43f (DEFAULT_TABLE table=default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.695132 13239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fe94b1d72b4bb29f0154f58c9fa43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.698238 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 27649cff0c5f4e6783e8a2f0a1f847ae (DEFAULT_TABLE table=default.Table_1668535b5107458a842c0def2c55461f [id=0cdd1449d5734d559f49933deef6bb19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.698518 13227 tablet_service.cc:1511] Processing CreateTablet for tablet 7685f9b4b25541d98cfdaba36cd0276c (DEFAULT_TABLE table=default.Table_f0a8373b96114e0c896e54dcb940f74d [id=0c70c375ac604d158df38f374fc3c1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.698624 17399 leader_election.cc:290] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.699244 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27649cff0c5f4e6783e8a2f0a1f847ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.701335 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685f9b4b25541d98cfdaba36cd0276c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.712990 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3485a1b77a4b80acbf48de92b5cf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.713964 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7fe3793da743e293800961b029fc56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.715283 13639 tablet_bootstrap.cc:654] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:38.716253 13421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e68b57d7fb40cd8430144733749c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.720953 13417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9467e5c106b14619a7bf1f3e1f4f9c72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.726075 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b1cfcc6b1834ebbb0d5cd4a7967e2cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.727587 13640 ts_tablet_manager.cc:1434] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.236s user 0.014s sys 0.004s
W20260810 13:54:38.724830 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 162191us
I20260810 13:54:38.729948 13423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fe94b1d72b4bb29f0154f58c9fa43f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.730365 13382 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:38.734545 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:38.750120 17408 raft_consensus.cc:2804] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:38.762274 17328 raft_consensus.cc:493] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:38.763027 17328 raft_consensus.cc:515] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:38.770402 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:38.768953 13233 tablet_service.cc:1511] Processing CreateTablet for tablet b09ec8ef75e94a83a155d901235e7ce0 (DEFAULT_TABLE table=default.Table_699797a1320b40709d0bf25947241900 [id=f656a6598c1145d89230d014ba6873a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.772720 13233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b09ec8ef75e94a83a155d901235e7ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.777638 17317 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:38.782498 17317 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:38.787989 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 58097.1us
I20260810 13:54:38.791766 13221 tablet_service.cc:1511] Processing CreateTablet for tablet d1b2835286e14a8e827f7a61801ffb17 (DEFAULT_TABLE table=default.Table_a3085b5448ff4df8a25c4802ca130085 [id=b3648e88a1fc44808dcf824092d5de35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.796718 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:38.798972 13231 tablet_service.cc:1511] Processing CreateTablet for tablet 01f616bc07234fa2a454811e75a1aec2 (DEFAULT_TABLE table=default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 [id=7a8b712d0b1a4766ab00cd2c4739c311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.813220 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1b2835286e14a8e827f7a61801ffb17. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:38.827879 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 147445us
I20260810 13:54:38.833740 17392 consensus_queue.cc:1048] T e9840da46a92439f8c96bc3714650f17 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260810 13:54:38.835315 12951 leader_election.cc:343] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:38.835693 12951 leader_election.cc:304] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:38.838305 17400 raft_consensus.cc:2749] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:38.841703 17401 raft_consensus.cc:515] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:38.852912 13382 leader_election.cc:343] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:38.865247 17408 raft_consensus.cc:697] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:38.891076 17328 leader_election.cc:290] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:38.892088 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 56813.7us
I20260810 13:54:38.901654 13007 tablet_service.cc:1511] Processing CreateTablet for tablet e37ff84ae1f84d8ea0e57066273536be (DEFAULT_TABLE table=default.Table_e8a597f1c0ec4cd8878f49046eb45e66 [id=047df8b2dabc4682a2227e841b10a53c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.907284 13000 tablet_service.cc:1511] Processing CreateTablet for tablet ab9d43e8868c420ea0801d395ff9c102 (DEFAULT_TABLE table=default.Table_e317f4e20e124c60bbed5450c6c3ca07 [id=01638b930a5e4b46925cdbfd23f204ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.909092 17408 consensus_queue.cc:237] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:38.917384 13003 tablet_service.cc:1511] Processing CreateTablet for tablet a04498da4fce45bb9a906e75594a023f (DEFAULT_TABLE table=default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.937062 13448 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 2) took 1052 ms. Trace:
I20260810 13:54:38.937456 13448 rpcz_store.cc:276] 0810 13:54:37.884928 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.885425 (+ 497us) service_pool.cc:224] Handling call
0810 13:54:38.520459 (+635034us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.520560 (+ 101us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.666614 (+146054us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.709315 (+ 42701us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.936944 (+227629us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12544}
I20260810 13:54:38.939522 13448 tablet_service.cc:1511] Processing CreateTablet for tablet 7685f9b4b25541d98cfdaba36cd0276c (DEFAULT_TABLE table=default.Table_f0a8373b96114e0c896e54dcb940f74d [id=0c70c375ac604d158df38f374fc3c1d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.940555 13448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7685f9b4b25541d98cfdaba36cd0276c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:38.945921 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 52589.4us
I20260810 13:54:38.951679 13213 tablet_service.cc:1511] Processing CreateTablet for tablet a04498da4fce45bb9a906e75594a023f (DEFAULT_TABLE table=default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.952666 13213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04498da4fce45bb9a906e75594a023f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.942241 13445 tablet_service.cc:1511] Processing CreateTablet for tablet 01f616bc07234fa2a454811e75a1aec2 (DEFAULT_TABLE table=default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 [id=7a8b712d0b1a4766ab00cd2c4739c311]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.953624 13445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f616bc07234fa2a454811e75a1aec2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.943625 13419 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 8) took 1026 ms. Trace:
I20260810 13:54:38.957202 13420 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 13) took 1004 ms. Trace:
I20260810 13:54:38.946024 13436 tablet_service.cc:1511] Processing CreateTablet for tablet e37ff84ae1f84d8ea0e57066273536be (DEFAULT_TABLE table=default.Table_e8a597f1c0ec4cd8878f49046eb45e66 [id=047df8b2dabc4682a2227e841b10a53c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.958462 13436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37ff84ae1f84d8ea0e57066273536be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.957715 13420 rpcz_store.cc:276] 0810 13:54:37.952353 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.957029 (+ 4676us) service_pool.cc:224] Handling call
0810 13:54:38.550944 (+593915us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.551033 (+ 89us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.771901 (+220868us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.881015 (+109114us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.957141 (+ 76126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27918}
I20260810 13:54:38.959940 13420 tablet_service.cc:1511] Processing CreateTablet for tablet ab9d43e8868c420ea0801d395ff9c102 (DEFAULT_TABLE table=default.Table_e317f4e20e124c60bbed5450c6c3ca07 [id=01638b930a5e4b46925cdbfd23f204ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.946712 13427 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 3) took 1049 ms. Trace:
I20260810 13:54:38.957355 13419 rpcz_store.cc:276] 0810 13:54:37.917081 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.917270 (+ 189us) service_pool.cc:224] Handling call
0810 13:54:38.520184 (+602914us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.520282 (+ 98us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.819811 (+299529us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.863340 (+ 43529us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.943574 (+ 80234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:38.962029 13427 rpcz_store.cc:276] 0810 13:54:37.897612 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.900586 (+ 2974us) service_pool.cc:224] Handling call
0810 13:54:38.519903 (+619317us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.520002 (+ 99us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.694037 (+174035us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.861348 (+167311us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.946637 (+ 85289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:38.962779 13438 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 11) took 1011 ms. Trace:
I20260810 13:54:38.963150 13438 rpcz_store.cc:276] 0810 13:54:37.951631 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.952415 (+ 784us) service_pool.cc:224] Handling call
0810 13:54:38.521008 (+568593us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.521106 (+ 98us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.720629 (+199523us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.920670 (+200041us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.962723 (+ 42053us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33521}
I20260810 13:54:38.973291 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:38.936501 13430 tablet_service.cc:1511] Processing CreateTablet for tablet 27649cff0c5f4e6783e8a2f0a1f847ae (DEFAULT_TABLE table=default.Table_1668535b5107458a842c0def2c55461f [id=0cdd1449d5734d559f49933deef6bb19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:38.979583 13264 raft_consensus.cc:2468] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
W20260810 13:54:38.993018 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 81666.5us
I20260810 13:54:38.994671 13428 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 17) took 1028 ms. Trace:
I20260810 13:54:38.995025 13428 rpcz_store.cc:276] 0810 13:54:37.966733 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.966973 (+ 240us) service_pool.cc:224] Handling call
0810 13:54:38.583320 (+616347us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.583874 (+ 554us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.724587 (+140713us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.881176 (+156589us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.994615 (+113439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:38.995647 13421 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 14) took 1043 ms. Trace:
I20260810 13:54:39.008934 13231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f616bc07234fa2a454811e75a1aec2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:39.020031 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 72577.6us
I20260810 13:54:38.993748 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.024873 13638 raft_consensus.cc:359] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.025642 13638 raft_consensus.cc:385] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:39.025925 13638 raft_consensus.cc:740] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:39.026538 13638 consensus_queue.cc:260] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.037592 13216 tablet_service.cc:1511] Processing CreateTablet for tablet e37ff84ae1f84d8ea0e57066273536be (DEFAULT_TABLE table=default.Table_e8a597f1c0ec4cd8878f49046eb45e66 [id=047df8b2dabc4682a2227e841b10a53c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:39.042701 13255 raft_consensus.cc:2468] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:39.044359 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.045542 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.047677 17317 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.048616 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.049103 17376 ts_tablet_manager.cc:1929] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260810 13:54:39.049585 17376 log.cc:1199] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-1/wal/wals/1a4fe8abad5649f2a42686c00148d957
I20260810 13:54:39.053748 17392 raft_consensus.cc:493] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.054927 17376 ts_tablet_manager.cc:1950] T 1a4fe8abad5649f2a42686c00148d957 P 218e946161f64d1d92427684ac15e4fb: Deleting consensus metadata
I20260810 13:54:39.054212 17392 raft_consensus.cc:515] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.055840 17376 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55268 (request call id 0) took 1294 ms. Trace:
I20260810 13:54:39.061777 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.062875 17392 leader_election.cc:290] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.067137 17401 leader_election.cc:290] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.099506 17392 raft_consensus.cc:493] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.100375 17392 raft_consensus.cc:515] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:39.105432 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.106648 13256 raft_consensus.cc:2468] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:39.124858 13639 tablet_bootstrap.cc:492] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:39.125411 13639 ts_tablet_manager.cc:1403] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.557s user 0.013s sys 0.004s
I20260810 13:54:39.125686 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.124920 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.132561 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.133589 17328 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.133703 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.134251 17328 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:39.136976 17328 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.136344 13206 tablet_service.cc:1511] Processing CreateTablet for tablet ab9d43e8868c420ea0801d395ff9c102 (DEFAULT_TABLE table=default.Table_e317f4e20e124c60bbed5450c6c3ca07 [id=01638b930a5e4b46925cdbfd23f204ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:39.164155 17406 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.164822 17406 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.168829 17406 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:38.961781 13420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9d43e8868c420ea0801d395ff9c102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:38.946807 13442 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 6) took 1047 ms. Trace:
I20260810 13:54:38.957175 13424 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 5) took 1057 ms. Trace:
I20260810 13:54:39.190408 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27649cff0c5f4e6783e8a2f0a1f847ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:39.190526 13424 rpcz_store.cc:276] 0810 13:54:37.899363 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.902850 (+ 3487us) service_pool.cc:224] Handling call
0810 13:54:38.511210 (+608360us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.511358 (+ 148us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.702437 (+191079us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.904162 (+201725us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.957102 (+ 52940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27921}
I20260810 13:54:38.970297 13425 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 12) took 1018 ms. Trace:
I20260810 13:54:39.191524 13425 rpcz_store.cc:276] 0810 13:54:37.952013 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.955638 (+ 3625us) service_pool.cc:224] Handling call
0810 13:54:38.549564 (+593926us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.549670 (+ 106us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.828604 (+278934us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.969739 (+141135us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.970236 (+ 497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:38.949404 13426 tablet_service.cc:1511] Processing CreateTablet for tablet a04498da4fce45bb9a906e75594a023f (DEFAULT_TABLE table=default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 13:54:39.071333 13382 leader_election.cc:304] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:39.141228 13434 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 18) took 1171 ms. Trace:
I20260810 13:54:39.141664 13640 tablet_bootstrap.cc:492] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:39.192800 13434 rpcz_store.cc:276] 0810 13:54:37.970299 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.970526 (+ 227us) service_pool.cc:224] Handling call
0810 13:54:38.587363 (+616837us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.587470 (+ 107us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.847786 (+260316us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.907929 (+ 60143us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.141159 (+233230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:39.193782 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 122527us
I20260810 13:54:39.190034 13442 rpcz_store.cc:276] 0810 13:54:37.899847 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.904871 (+ 5024us) service_pool.cc:224] Handling call
0810 13:54:38.519285 (+614414us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.519381 (+ 96us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.721660 (+202279us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.903756 (+182096us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.946759 (+ 43003us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:39.195194 13382 leader_election.cc:343] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:39.195554 13382 leader_election.cc:304] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:39.197094 17437 raft_consensus.cc:2804] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:39.199806 13640 tablet_bootstrap.cc:654] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:39.200663 13216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37ff84ae1f84d8ea0e57066273536be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:39.203042 17415 raft_consensus.cc:2749] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:39.205698 13421 rpcz_store.cc:276] 0810 13:54:37.952725 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.961923 (+ 9198us) service_pool.cc:224] Handling call
0810 13:54:38.551105 (+589182us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.551189 (+ 84us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.767982 (+216793us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.995240 (+227258us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.995598 (+ 358us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:39.028613 13638 ts_tablet_manager.cc:1434] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.385s user 0.002s sys 0.003s
W20260810 13:54:39.209260 13638 ts_tablet_manager.cc:1467] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb: Tablet startup took 566ms
I20260810 13:54:39.186870 17431 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:39.229554 17431 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:39.187947 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:39.239534 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:39.152933 13429 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 7) took 1252 ms. Trace:
I20260810 13:54:39.240335 13429 rpcz_store.cc:276] 0810 13:54:37.900306 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.906384 (+ 6078us) service_pool.cc:224] Handling call
0810 13:54:38.519593 (+613209us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.519701 (+ 108us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.761590 (+241889us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.776657 (+ 15067us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.152874 (+376217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:39.168993 17433 raft_consensus.cc:493] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
W20260810 13:54:39.170905 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 72509.5us
I20260810 13:54:39.253562 12951 leader_election.cc:304] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:39.254959 12951 leader_election.cc:304] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:39.256385 17403 raft_consensus.cc:2804] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:39.257176 17391 raft_consensus.cc:2749] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:39.258471 17403 raft_consensus.cc:697] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:39.259773 17403 consensus_queue.cc:237] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.173652 17401 raft_consensus.cc:493] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:39.265681 17401 raft_consensus.cc:515] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:39.267689 12476 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7ffb0f96e744a4bb734aba7f3d82995 consensus state has no leader
I20260810 13:54:39.181285 17392 leader_election.cc:290] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.285048 17433 raft_consensus.cc:515] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:39.170655 17426 raft_consensus.cc:493] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
W20260810 13:54:39.227311 13638 ts_tablet_manager.cc:1469] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb: Trace:
0810 13:53:52.524155 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:53:52.530433 (+ 6278us) service_pool.cc:224] Handling call
0810 13:53:52.558856 (+ 28423us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:53:52.559050 (+ 194us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:53:52.877665 (+318615us) tablet_metadata.cc:665] Metadata flushed
0810 13:53:52.884166 (+ 6501us) tablet_replica.cc:206] Creating consensus instance
0810 13:53:52.884673 (+ 507us) inbound_call.cc:177] Queueing success response
0810 13:54:38.024733 (+45140060us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0810 13:54:38.643248 (+618515us) ts_tablet_manager.cc:1435] Starting tablet replica
0810 13:54:38.643733 (+ 485us) tablet_replica.cc:261] Starting instrumentation
0810 13:54:38.644208 (+ 475us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":332,"tablet-open.queue_time_us":45063090}
I20260810 13:54:39.142246 13435 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 16) took 1188 ms. Trace:
I20260810 13:54:39.286072 17408 raft_consensus.cc:493] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.307753 13435 rpcz_store.cc:276] 0810 13:54:37.953417 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.964889 (+ 11472us) service_pool.cc:224] Handling call
0810 13:54:38.577835 (+612946us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.583138 (+ 5303us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.915514 (+332376us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.995646 (+ 80132us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.142183 (+146537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:39.308859 17441 raft_consensus.cc:493] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.311141 17441 raft_consensus.cc:515] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.310213 17415 raft_consensus.cc:493] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.310528 17408 raft_consensus.cc:515] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:39.313014 17415 raft_consensus.cc:515] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.322662 17408 leader_election.cc:290] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.323513 17408 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.324008 17407 raft_consensus.cc:493] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.330307 13426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04498da4fce45bb9a906e75594a023f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260810 13:54:39.330624 17440 log.cc:927] Time spent T 452978fbf3b74e3c9b16756b9f394be7 P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.121s user 0.001s sys 0.000s
W20260810 13:54:39.341889 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 85708us
I20260810 13:54:39.309950 17426 raft_consensus.cc:515] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.323000 17415 leader_election.cc:290] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.324229 17408 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:39.361927 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 166748us
I20260810 13:54:39.365607 17437 raft_consensus.cc:697] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:39.369302 13639 raft_consensus.cc:359] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.369999 13639 raft_consensus.cc:385] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:39.383845 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 824 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
W20260810 13:54:39.305073 13258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s user 0.000s sys 0.019s
I20260810 13:54:39.391429 17401 leader_election.cc:290] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.395354 17373 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.398481 17398 raft_consensus.cc:493] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.399004 17398 raft_consensus.cc:515] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:39.406109 13008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f3485a1b77a4b80acbf48de92b5cf33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:39.409376 12996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb7fe3793da743e293800961b029fc56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:39.417657 12997 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 15) took 1425 ms. Trace:
I20260810 13:54:39.418725 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:39.418143 12997 rpcz_store.cc:276] 0810 13:54:37.991895 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.070606 (+ 78711us) service_pool.cc:224] Handling call
0810 13:54:38.072138 (+ 1532us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.072221 (+ 83us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.433294 (+361073us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.522510 (+ 89216us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:38.534945 (+ 12435us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:54:39.417559 (+882614us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23836416}
I20260810 13:54:39.426033 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:39.427129 13027 raft_consensus.cc:2468] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:39.429250 13020 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 17) took 1335 ms. Trace:
I20260810 13:54:39.429704 13020 rpcz_store.cc:276] 0810 13:54:38.094056 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.094193 (+ 137us) service_pool.cc:224] Handling call
0810 13:54:38.514384 (+420191us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.514503 (+ 119us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.539513 (+ 25010us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.547185 (+ 7672us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.429172 (+881987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:39.431077 13012 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 14) took 1439 ms. Trace:
I20260810 13:54:39.431497 13012 rpcz_store.cc:276] 0810 13:54:37.991513 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.995815 (+ 4302us) service_pool.cc:224] Handling call
0810 13:54:38.069616 (+ 73801us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.069704 (+ 88us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.453536 (+383832us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.496246 (+ 42710us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.431005 (+934759us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:39.433391 13000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9d43e8868c420ea0801d395ff9c102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:39.434198 17431 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:39.435371 13007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37ff84ae1f84d8ea0e57066273536be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:39.370255 13639 raft_consensus.cc:740] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:39.444965 17385 raft_consensus.cc:2243] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:39.446200 17385 pending_rounds.cc:70] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:54:39.446557 17385 pending_rounds.cc:77] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971833070551040 op_type: NO_OP noop_request { }
I20260810 13:54:39.446965 17385 raft_consensus.cc:2889] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:39.447378 17385 raft_consensus.cc:2272] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:39.447532 13006 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 19) took 1350 ms. Trace:
I20260810 13:54:39.449152 12999 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 24) took 1345 ms. Trace:
I20260810 13:54:39.449463 12999 rpcz_store.cc:276] 0810 13:54:38.103846 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.569145 (+465299us) service_pool.cc:224] Handling call
0810 13:54:38.570206 (+ 1061us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.570270 (+ 64us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.792872 (+222602us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.955759 (+162887us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.117406 (+161647us) spinlock_profiling.cc:243] Waited 66.9 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:54:39.449101 (+331695us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153912576}
I20260810 13:54:39.450769 13010 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 18) took 1356 ms. Trace:
I20260810 13:54:39.451128 13010 rpcz_store.cc:276] 0810 13:54:38.094378 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.094484 (+ 106us) service_pool.cc:224] Handling call
0810 13:54:38.535814 (+441330us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.535924 (+ 110us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.624066 (+ 88142us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.016841 (+392775us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.118106 (+101265us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:54:39.450703 (+332597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230989184}
I20260810 13:54:39.451608 17385 ts_tablet_manager.cc:1916] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:39.453953 12998 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 23) took 1350 ms. Trace:
I20260810 13:54:39.454428 12998 rpcz_store.cc:276] 0810 13:54:38.103526 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.561419 (+457893us) service_pool.cc:224] Handling call
0810 13:54:38.562617 (+ 1198us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.562707 (+ 90us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.607691 (+ 44984us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.022911 (+415220us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.121298 (+ 98387us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:54:39.453900 (+332602us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158763264}
I20260810 13:54:39.456018 13003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a04498da4fce45bb9a906e75594a023f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:39.461225 13011 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 26) took 1356 ms. Trace:
I20260810 13:54:39.460942 13639 consensus_queue.cc:260] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.461673 13011 rpcz_store.cc:276] 0810 13:54:38.104364 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.572883 (+468519us) service_pool.cc:224] Handling call
0810 13:54:38.574222 (+ 1339us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.574307 (+ 85us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.863153 (+288846us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.980447 (+117294us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.127041 (+146594us) spinlock_profiling.cc:243] Waited 74.4 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:54:39.461150 (+334109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171185536}
I20260810 13:54:39.463579 13022 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 27) took 1359 ms. Trace:
I20260810 13:54:39.463953 13022 rpcz_store.cc:276] 0810 13:54:38.104597 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.575002 (+470405us) service_pool.cc:224] Handling call
0810 13:54:38.576205 (+ 1203us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.576278 (+ 73us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.798765 (+222487us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.050478 (+251713us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.128482 (+ 78004us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:54:39.463510 (+335028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174335872}
I20260810 13:54:39.465512 13014 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 25) took 1361 ms. Trace:
I20260810 13:54:39.465942 13014 rpcz_store.cc:276] 0810 13:54:38.104106 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.570928 (+466822us) service_pool.cc:224] Handling call
0810 13:54:38.572051 (+ 1123us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.572139 (+ 88us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.783622 (+211483us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.987491 (+203869us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.129467 (+141976us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:54:39.465454 (+335987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182213376}
I20260810 13:54:39.465516 13018 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 22) took 1362 ms. Trace:
I20260810 13:54:39.467549 13018 rpcz_store.cc:276] 0810 13:54:38.103164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.565192 (+462028us) service_pool.cc:224] Handling call
0810 13:54:38.566298 (+ 1106us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.566366 (+ 68us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.801325 (+234959us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.938265 (+136940us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.137526 (+199261us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:54:39.465468 (+327942us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456758016}
I20260810 13:54:39.448014 13006 rpcz_store.cc:276] 0810 13:54:38.097042 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.102108 (+ 5066us) service_pool.cc:224] Handling call
0810 13:54:38.558060 (+455952us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.558162 (+ 102us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.869274 (+311112us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:38.875834 (+ 6560us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.116715 (+240881us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd2b52 00007f1929c401d9 00007f1928e584e8 00007f1928f1e783 00007f1928f1a51f 00007f1928f1acdd 00007f1928ec9210 00007f1927455bf4 00007f1927455b82
0810 13:54:39.447454 (+330739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19000064}
I20260810 13:54:39.494772 13639 ts_tablet_manager.cc:1434] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.369s user 0.009s sys 0.000s
I20260810 13:54:39.495972 13639 tablet_bootstrap.cc:492] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:39.233909 17374 raft_consensus.cc:493] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
W20260810 13:54:39.517937 13258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s user 0.001s sys 0.019s
I20260810 13:54:39.401885 17398 leader_election.cc:290] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.529529 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:39.530614 13046 raft_consensus.cc:2468] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:39.526573 17464 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.347097 17426 leader_election.cc:290] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.396098 17373 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.546972 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.056226 17376 rpcz_store.cc:276] 0810 13:54:37.770200 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.770790 (+ 590us) service_pool.cc:224] Handling call
0810 13:54:38.155538 (+384748us) ts_tablet_manager.cc:1151] Deleting tablet 1a4fe8abad5649f2a42686c00148d957
0810 13:54:38.160404 (+ 4866us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:38.482419 (+322015us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.048934 (+566515us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.055746 (+ 6812us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32195,"tablet-delete.queue_time_us":316389,"thread_start_us":298463,"threads_started":1}
I20260810 13:54:39.555945 12472 catalog_manager.cc:5050] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): tablet 1a4fe8abad5649f2a42686c00148d957 (table default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]) successfully deleted
I20260810 13:54:39.532702 17374 raft_consensus.cc:515] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.566471 17374 leader_election.cc:290] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.566687 17394 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.567514 17394 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.571563 17394 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.538911 17464 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.589282 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.589568 17464 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.593341 13382 leader_election.cc:304] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:39.362124 17415 raft_consensus.cc:493] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.367457 17437 consensus_queue.cc:237] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.598762 17373 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.593056 17458 raft_consensus.cc:493] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.599934 17433 leader_election.cc:290] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.333313 17407 raft_consensus.cc:515] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.619210 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.628479 17441 leader_election.cc:290] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.595810 17426 raft_consensus.cc:493] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
W20260810 13:54:39.635864 12952 leader_election.cc:343] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:39.625252 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.621592 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.636797 12952 leader_election.cc:304] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:39.636824 13255 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:39.625765 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.626833 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.627972 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.638187 13261 raft_consensus.cc:2468] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:39.638218 17392 raft_consensus.cc:2804] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:39.638526 17392 raft_consensus.cc:493] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.638849 17392 raft_consensus.cc:3060] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:39.639216 13223 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55268 (request call id 18) took 1011 ms. Trace:
I20260810 13:54:39.639504 13223 rpcz_store.cc:276] 0810 13:54:38.627475 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.627640 (+ 165us) service_pool.cc:224] Handling call
0810 13:54:38.679230 (+ 51590us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.679307 (+ 77us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.955639 (+276332us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.053855 (+ 98216us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.639159 (+585304us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:39.640640 13236 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55268 (request call id 15) took 1207 ms. Trace:
I20260810 13:54:39.640978 13236 rpcz_store.cc:276] 0810 13:54:38.433650 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.450817 (+ 17167us) service_pool.cc:224] Handling call
0810 13:54:38.456477 (+ 5660us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.456567 (+ 90us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.885215 (+428648us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.161160 (+275945us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.640575 (+479415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260810 13:54:39.641996 13210 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55268 (request call id 20) took 1011 ms. Trace:
I20260810 13:54:39.642283 13210 rpcz_store.cc:276] 0810 13:54:38.631068 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.636763 (+ 5695us) service_pool.cc:224] Handling call
0810 13:54:38.637876 (+ 1113us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.637966 (+ 90us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.747765 (+109799us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.015269 (+267504us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.210847 (+195578us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a6b52 00007f91209141d9 00007f911fb2c4e8 00007f911fbf2783 00007f911fbee51f 00007f911fbeecdd 00007f911fb9d210 00007f911e129bf4 00007f911e129b82
0810 13:54:39.641946 (+431099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68327296}
I20260810 13:54:39.643390 13208 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55268 (request call id 19) took 1012 ms. Trace:
I20260810 13:54:39.643673 13208 rpcz_store.cc:276] 0810 13:54:38.630772 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.631416 (+ 644us) service_pool.cc:224] Handling call
0810 13:54:38.632614 (+ 1198us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.632707 (+ 93us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.771813 (+139106us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.021375 (+249562us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.217947 (+196572us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a6b52 00007f91209141d9 00007f911fb2c4e8 00007f911fbf2783 00007f911fbee51f 00007f911fbeecdd 00007f911fb9d210 00007f911e129bf4 00007f911e129b82
0810 13:54:39.643340 (+425393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74633600}
I20260810 13:54:39.638803 13250 raft_consensus.cc:2468] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:39.645300 13221 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55268 (request call id 17) took 1037 ms. Trace:
I20260810 13:54:39.645596 13221 rpcz_store.cc:276] 0810 13:54:38.608219 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.791166 (+182947us) service_pool.cc:224] Handling call
0810 13:54:38.792593 (+ 1427us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:38.812799 (+ 20206us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:38.954515 (+141716us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.295022 (+340507us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.543184 (+248162us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a6b52 00007f91209141d9 00007f911fb2c4e8 00007f911fbf2783 00007f911fbee51f 00007f911fbeecdd 00007f911fb9d210 00007f911e129bf4 00007f911e129b82
0810 13:54:39.645250 (+102066us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296362368}
I20260810 13:54:39.649591 13206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9d43e8868c420ea0801d395ff9c102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 13:54:39.649639 13638 tablet_bootstrap.cc:492] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:39.649729 17317 raft_consensus.cc:493] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.650205 17317 raft_consensus.cc:515] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.652370 17317 leader_election.cc:290] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.652948 17392 raft_consensus.cc:515] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.655140 17392 leader_election.cc:290] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.661566 12952 leader_election.cc:304] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:39.662240 17401 raft_consensus.cc:2804] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:39.662559 17401 raft_consensus.cc:493] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.662905 17401 raft_consensus.cc:3060] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:39.674642 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a4341f5d274a9eb54cb030b47c9a91" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:39.689857 12952 leader_election.cc:343] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:39.696363 13008 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 16) took 1602 ms. Trace:
I20260810 13:54:39.696735 13008 rpcz_store.cc:276] 0810 13:54:38.093691 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.095377 (+ 1686us) service_pool.cc:224] Handling call
0810 13:54:38.514256 (+418879us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd284c 00007f1920cd240b 00007f1929c16fb9 00007f1928e58640 00007f1928f3d641 00007f1928f1a8d3 00007f1928ec9210 00007f1927455bf4 00007f1927455b82 00007f1927455ab1
0810 13:54:39.405438 (+891182us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:39.405575 (+ 137us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:39.585560 (+179985us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.647344 (+ 61784us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.696302 (+ 48958us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66403200}
I20260810 13:54:39.699761 17392 consensus_queue.cc:1048] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:39.702534 17391 raft_consensus.cc:493] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:39.703310 17391 raft_consensus.cc:515] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.708899 17391 leader_election.cc:290] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.718413 13426 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49514 (request call id 28) took 1212 ms. Trace:
I20260810 13:54:39.718880 13426 rpcz_store.cc:276] 0810 13:54:38.506175 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.948611 (+442436us) service_pool.cc:224] Handling call
0810 13:54:39.329714 (+381103us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:39.329840 (+ 126us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:39.375132 (+ 45292us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.717899 (+342767us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.718347 (+ 448us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:39.725454 12952 leader_election.cc:343] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:39.726594 17403 consensus_queue.cc:1048] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:39.731175 13638 tablet_bootstrap.cc:654] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:39.734647 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:39.742774 17457 raft_consensus.cc:493] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.744096 17457 raft_consensus.cc:515] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.746981 17457 leader_election.cc:290] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:39.759068 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 171225us
I20260810 13:54:39.599764 17458 raft_consensus.cc:515] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:39.764779 17458 leader_election.cc:290] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.597653 17415 raft_consensus.cc:515] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.735325 17407 leader_election.cc:290] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.772809 13382 leader_election.cc:304] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:39.709838 17426 raft_consensus.cc:515] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.776757 17408 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.786038 17392 raft_consensus.cc:493] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.786762 17392 raft_consensus.cc:515] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:39.792389 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet f4946f79b54c46b1a59edf169109ab47 (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet f4946f79b54c46b1a59edf169109ab47 consensus state has no leader
I20260810 13:54:39.794515 17457 raft_consensus.cc:493] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.795353 17457 raft_consensus.cc:515] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.797151 17415 leader_election.cc:290] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.798009 17415 raft_consensus.cc:493] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.798688 17426 leader_election.cc:290] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.799435 17426 raft_consensus.cc:493] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.769948 17433 raft_consensus.cc:2749] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:39.801671 17457 leader_election.cc:290] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.801983 17403 raft_consensus.cc:493] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.802815 17403 raft_consensus.cc:515] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.805541 17459 raft_consensus.cc:493] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.805886 13382 leader_election.cc:304] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:39.807184 17406 raft_consensus.cc:493] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.807659 17406 raft_consensus.cc:515] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.811254 17406 leader_election.cc:290] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.811020 17401 raft_consensus.cc:515] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.812011 17406 raft_consensus.cc:493] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.812665 17406 raft_consensus.cc:515] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.820513 17408 raft_consensus.cc:2749] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:39.795261 17471 raft_consensus.cc:493] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.815158 17403 leader_election.cc:290] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.816061 17392 leader_election.cc:290] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.835542 17406 leader_election.cc:290] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:39.850620 17447 log.cc:927] Time spent T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.090s user 0.000s sys 0.000s
W20260810 13:54:39.852313 13382 leader_election.cc:343] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:39.852880 13382 leader_election.cc:304] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:39.834945 17317 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.856489 17317 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.835462 17373 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:39.860917 17373 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.865993 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.868033 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:39.800145 17426 raft_consensus.cc:515] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:39.806344 17459 raft_consensus.cc:515] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:39.909751 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 55227.6us
I20260810 13:54:39.803777 17415 raft_consensus.cc:515] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.890085 17408 raft_consensus.cc:2749] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:39.821593 17471 raft_consensus.cc:515] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.919243 17426 leader_election.cc:290] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:39.924476 13640 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.572s user 0.000s sys 0.016s
W20260810 13:54:39.925282 13640 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.573s user 0.004s sys 0.016s
I20260810 13:54:39.920668 17475 raft_consensus.cc:493] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.928076 17407 raft_consensus.cc:493] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.928522 17460 raft_consensus.cc:2749] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:39.929235 17407 raft_consensus.cc:515] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:39.929944 17475 raft_consensus.cc:515] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.934180 17407 leader_election.cc:290] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.936766 17475 leader_election.cc:290] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.949477 13639 tablet_bootstrap.cc:654] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:39.937567 17415 leader_election.cc:290] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.941268 17459 leader_election.cc:290] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.947221 17471 leader_election.cc:290] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:39.953250 13640 tablet_bootstrap.cc:492] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
W20260810 13:54:39.954761 15130 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.553s (SENT) [suppressed 1 similar messages]
I20260810 13:54:39.954839 13003 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 31) took 1048 ms. Trace:
I20260810 13:54:39.953832 17426 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:39.956981 17463 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:39.957839 17463 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.974880 17373 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.971699 17317 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.968662 17463 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.990644 17406 raft_consensus.cc:493] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.991693 17403 raft_consensus.cc:493] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:39.991497 17406 raft_consensus.cc:515] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:39.992482 17403 raft_consensus.cc:515] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.009832 17317 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.010879 17317 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.016019 17317 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.016902 17317 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.017752 17317 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.030306 17406 leader_election.cc:290] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.993052 17392 raft_consensus.cc:493] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.031534 17403 leader_election.cc:290] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.031855 17392 raft_consensus.cc:515] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.035465 17392 leader_election.cc:290] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:39.955665 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 45182.1us
I20260810 13:54:39.957741 13640 ts_tablet_manager.cc:1403] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.816s user 0.011s sys 0.025s
I20260810 13:54:40.054921 17401 leader_election.cc:290] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:39.955435 13003 rpcz_store.cc:276] 0810 13:54:38.906010 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.906148 (+ 138us) service_pool.cc:224] Handling call
0810 13:54:39.122392 (+216244us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5800000f98. stack: 00007f1920cd7cf3 00007f1920cd7bf0 00007f1920885574 0000000000516de4 0000000000516d79 00007f1920b92981 00007f1920cd2521 00007f1920cd23d2 00007f1929c16fb9 00007f1928e58640 00007f1928f3d641 00007f1928f1a8d3 00007f1928ec9210 00007f1927455bf4 00007f1927455b82 00007f1927455ab1
0810 13:54:39.455524 (+333132us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:39.455633 (+ 109us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:39.488262 (+ 32629us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.954236 (+465974us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:39.954772 (+ 536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460033280}
I20260810 13:54:40.059317 17385 ts_tablet_manager.cc:1929] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:40.060667 17385 log.cc:1199] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/674599456f9a49dc98d8d089c166ca89
I20260810 13:54:40.064188 17385 ts_tablet_manager.cc:1950] T 674599456f9a49dc98d8d089c166ca89 P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:40.066253 13640 raft_consensus.cc:359] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.067317 13640 raft_consensus.cc:385] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:40.061699 17426 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.071640 17426 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.071270 17490 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:40.072818 13382 leader_election.cc:304] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:40.067745 13640 raft_consensus.cc:740] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:40.086542 13206 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55268 (request call id 29) took 1082 ms. Trace:
I20260810 13:54:40.087443 13206 rpcz_store.cc:276] 0810 13:54:39.004164 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:39.135368 (+131204us) service_pool.cc:224] Handling call
0810 13:54:39.253340 (+117972us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a684c 00007f91179a640b 00007f91208eafb9 00007f911fb2c640 00007f911fc11641 00007f911fbee8d3 00007f911fb9d210 00007f911e129bf4 00007f911e129b82 00007f911e129ab1
0810 13:54:39.549967 (+296627us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5800000f98. stack: 00007f91179abcf3 00007f91179abbf0 00007f9117559574 0000000000516de4 0000000000516d79 00007f9117866981 00007f91179a6521 00007f91179a689e 00007f9120ea0179 00007f911fb2c940 00007f911fc1165c 00007f911fbee8d3 00007f911fb9d210 00007f911e129bf4 00007f911e129b82 00007f911e129ab1
0810 13:54:39.649122 (+ 99155us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:39.649211 (+ 89us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:39.681620 (+ 32409us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:39.999602 (+317982us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:40.086457 (+ 86855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300065408}
I20260810 13:54:40.069761 13639 tablet_bootstrap.cc:492] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:40.086799 17401 raft_consensus.cc:493] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.097187 17401 raft_consensus.cc:515] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.074198 13640 consensus_queue.cc:260] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.101275 17401 leader_election.cc:290] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.102298 13639 ts_tablet_manager.cc:1403] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.607s user 0.007s sys 0.013s
I20260810 13:54:40.101415 17490 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:40.106428 13639 raft_consensus.cc:359] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.113598 13639 raft_consensus.cc:385] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:40.114012 13639 raft_consensus.cc:740] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:40.115581 13639 consensus_queue.cc:260] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:40.117894 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 55285.4us
I20260810 13:54:40.118616 13382 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:40.052407 17407 raft_consensus.cc:493] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.119354 17407 raft_consensus.cc:515] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.121421 17407 leader_election.cc:290] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.122701 13640 ts_tablet_manager.cc:1434] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.079s user 0.006s sys 0.001s
I20260810 13:54:40.125059 17426 raft_consensus.cc:2804] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:40.125761 17426 raft_consensus.cc:697] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:40.126263 13638 tablet_bootstrap.cc:492] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:40.126824 13638 ts_tablet_manager.cc:1403] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.477s user 0.009s sys 0.010s
I20260810 13:54:40.131937 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:40.138988 17482 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.140882 17471 raft_consensus.cc:493] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.141570 13638 raft_consensus.cc:359] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.142298 13638 raft_consensus.cc:385] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:40.141763 17471 raft_consensus.cc:515] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.142877 13638 raft_consensus.cc:740] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:40.143532 13638 consensus_queue.cc:260] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.145210 13638 ts_tablet_manager.cc:1434] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.018s user 0.007s sys 0.001s
I20260810 13:54:40.147210 13639 ts_tablet_manager.cc:1434] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.045s user 0.006s sys 0.001s
I20260810 13:54:40.147151 17471 leader_election.cc:290] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.127171 17426 consensus_queue.cc:237] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.164100 17317 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.186455 17485 raft_consensus.cc:493] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:40.187182 17485 raft_consensus.cc:515] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.189637 17490 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:40.189841 17317 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:40.191275 15216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:40.190686 17317 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.193360 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:40.194698 17490 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:40.196034 17489 raft_consensus.cc:493] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:40.197645 12952 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:40.198271 17385 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55806 (request call id 0) took 2211 ms. Trace:
I20260810 13:54:40.198889 12952 leader_election.cc:304] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:40.199893 12952 leader_election.cc:304] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:40.198803 17385 rpcz_store.cc:276] 0810 13:54:37.986344 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.986509 (+ 165us) service_pool.cc:224] Handling call
0810 13:54:38.019812 (+ 33303us) ts_tablet_manager.cc:1151] Deleting tablet 674599456f9a49dc98d8d089c166ca89
0810 13:54:38.095300 (+ 75488us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:39.755521 (+1660221us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:40.058836 (+303315us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:40.198132 (+139296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":962244,"tablet-delete.queue_time_us":31937,"thread_start_us":32598,"threads_started":1}
I20260810 13:54:40.201741 17406 raft_consensus.cc:2804] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:40.202302 17406 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:40.202936 17406 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:40.209319 17317 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:40.210172 12952 leader_election.cc:343] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:40.205839 17485 leader_election.cc:290] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.206632 17489 raft_consensus.cc:515] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.230366 17489 leader_election.cc:290] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.230727 12472 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 674599456f9a49dc98d8d089c166ca89 (table default.Table_8b694afed3584daaa326e8817c01b2da [id=9eb780278810411cab5fa9af8e70e2d1]) successfully deleted
I20260810 13:54:40.233776 17401 raft_consensus.cc:2804] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:40.234340 17401 raft_consensus.cc:493] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:40.235015 17401 raft_consensus.cc:3060] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:40.236845 17392 raft_consensus.cc:2804] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:40.236939 12996 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:55806 (request call id 21) took 2134 ms. Trace:
I20260810 13:54:40.237442 13639 tablet_bootstrap.cc:492] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:40.238179 12952 leader_election.cc:343] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:40.237543 12996 rpcz_store.cc:276] 0810 13:54:38.102805 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.153019 (+ 50214us) service_pool.cc:224] Handling call
0810 13:54:39.408756 (+1255737us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0810 13:54:39.408862 (+ 106us) ts_tablet_manager.cc:682] Creating new metadata...
0810 13:54:39.830149 (+421287us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:40.196973 (+366824us) tablet_replica.cc:206] Creating consensus instance
0810 13:54:40.236759 (+ 39786us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260810 13:54:40.239607 12952 leader_election.cc:343] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:40.240267 12952 leader_election.cc:343] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:40.243613 13638 tablet_bootstrap.cc:492] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:40.237540 17392 raft_consensus.cc:493] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:40.246433 17392 raft_consensus.cc:3060] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:40.248955 17385 tablet_replica.cc:333] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: stopping tablet replica
W20260810 13:54:40.250026 13164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.3:36001 timed out after 3.015s (SENT)
W20260810 13:54:40.273083 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:40.295063 12951 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.000s sys 0.028s
W20260810 13:54:40.295390 12951 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s user 0.000s sys 0.028s
I20260810 13:54:40.296020 17328 raft_consensus.cc:493] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.296924 17328 raft_consensus.cc:515] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.300518 17328 leader_election.cc:290] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.304864 17479 raft_consensus.cc:493] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.305550 17479 raft_consensus.cc:515] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.307365 17403 raft_consensus.cc:493] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.308156 17403 raft_consensus.cc:515] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.309844 17479 leader_election.cc:290] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.312395 17403 leader_election.cc:290] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.313867 17391 raft_consensus.cc:493] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:40.314517 17391 raft_consensus.cc:515] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:40.316336 12476 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7ffb0f96e744a4bb734aba7f3d82995 consensus state has no leader
I20260810 13:54:40.318464 17391 leader_election.cc:290] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.319433 17391 raft_consensus.cc:493] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:40.320365 17391 raft_consensus.cc:515] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.323539 17391 leader_election.cc:290] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.324994 17328 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:40.325776 17328 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.329743 17328 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:40.330456 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 80498.4us
I20260810 13:54:40.331791 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:40.332515 13245 raft_consensus.cc:3060] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:40.342549 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247fb8b09c12407d8535c07c5d0687fe" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.342636 17385 raft_consensus.cc:2243] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Raft consensus shutting down.
I20260810 13:54:40.344233 17385 pending_rounds.cc:70] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: Trying to abort 1 pending ops.
I20260810 13:54:40.344477 17385 pending_rounds.cc:77] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7316971746702573568 op_type: NO_OP noop_request { }
I20260810 13:54:40.344957 17385 raft_consensus.cc:2889] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260810 13:54:40.345422 17385 raft_consensus.cc:2272] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 13:54:40.346577 17403 raft_consensus.cc:493] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.347437 17403 raft_consensus.cc:515] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.351936 17403 leader_election.cc:290] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.140017 17482 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.355818 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.360021 17391 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.362272 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.363422 17391 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.364413 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:40.365401 13260 raft_consensus.cc:3060] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:40.372749 13640 tablet_bootstrap.cc:492] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:40.375190 17328 raft_consensus.cc:493] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.376101 17328 raft_consensus.cc:515] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:40.377074 13638 tablet_bootstrap.cc:654] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:40.377806 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.386138 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.394568 17482 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.396283 17415 raft_consensus.cc:493] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.397251 17415 raft_consensus.cc:515] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.401036 17458 raft_consensus.cc:493] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.401657 17458 raft_consensus.cc:515] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.402987 17408 raft_consensus.cc:493] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.404866 17471 raft_consensus.cc:493] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.405997 17437 raft_consensus.cc:493] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:40.406076 17441 raft_consensus.cc:493] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.406744 17437 raft_consensus.cc:515] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.407042 17441 raft_consensus.cc:515] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:40.409353 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 290775us
W20260810 13:54:40.410555 13382 leader_election.cc:343] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:40.410941 13382 leader_election.cc:304] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:40.286141 17406 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.411204 17437 leader_election.cc:290] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.411707 17437 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.412083 13260 raft_consensus.cc:2468] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:40.412084 13382 leader_election.cc:304] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:40.403748 17408 raft_consensus.cc:515] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.412909 17460 raft_consensus.cc:493] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.413386 17406 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.387854 17506 raft_consensus.cc:493] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.415112 17506 raft_consensus.cc:515] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.420251 13639 tablet_bootstrap.cc:654] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:40.420107 13245 raft_consensus.cc:2468] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:40.413625 17460 raft_consensus.cc:515] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.424309 17480 raft_consensus.cc:493] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.424541 17459 raft_consensus.cc:2749] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:40.424435 17407 raft_consensus.cc:2749] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:40.423786 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.426182 13382 leader_election.cc:304] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:40.428272 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.431041 17385 ts_tablet_manager.cc:1916] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 13:54:40.431257 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.405652 17458 leader_election.cc:290] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.393319 17392 raft_consensus.cc:515] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:40.437520 17392 leader_election.cc:290] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.310660 17479 raft_consensus.cc:493] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.441361 17479 raft_consensus.cc:515] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.451726 17391 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.477035 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.479034 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.479378 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.480021 13046 raft_consensus.cc:2393] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:40.480286 13040 raft_consensus.cc:2393] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 2: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:40.480989 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d9e5103fe644f38d969c64182f7cbb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.481560 13049 raft_consensus.cc:2468] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:40.482417 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.483000 13056 raft_consensus.cc:2468] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.484109 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.484679 13027 raft_consensus.cc:2468] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.485821 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.438460 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.441809 17459 raft_consensus.cc:493] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.425269 17480 raft_consensus.cc:515] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.432534 17403 raft_consensus.cc:493] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.432629 17506 leader_election.cc:290] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.392139 17401 raft_consensus.cc:515] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.490607 17480 leader_election.cc:290] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.424309 17475 raft_consensus.cc:2749] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:40.491829 17401 leader_election.cc:290] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.405627 17471 raft_consensus.cc:515] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:40.493863 17403 raft_consensus.cc:515] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:40.494563 17471 leader_election.cc:290] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.495810 17441 leader_election.cc:290] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.433174 17482 raft_consensus.cc:493] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.498188 17460 leader_election.cc:290] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.412439 17437 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.503906 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.487991 17459 raft_consensus.cc:515] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.506450 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.507866 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.509078 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.511034 13640 tablet_bootstrap.cc:654] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:40.511646 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.514796 17433 raft_consensus.cc:493] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:40.515234 17408 leader_election.cc:290] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.515357 17480 raft_consensus.cc:493] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.515826 17480 raft_consensus.cc:515] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.513809 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.514297 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.516644 17437 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.500927 17415 leader_election.cc:290] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.500313 17458 raft_consensus.cc:2749] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:40.517447 13257 raft_consensus.cc:2468] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:40.514449 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.517673 17480 leader_election.cc:290] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.515244 17433 raft_consensus.cc:515] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.506223 17475 raft_consensus.cc:493] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.515062 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:40.518637 13245 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:40.518518 17475 raft_consensus.cc:515] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:40.519636 17433 leader_election.cc:290] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.520236 17475 leader_election.cc:290] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.496490 17482 raft_consensus.cc:515] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.522025 17482 leader_election.cc:290] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.523680 17459 leader_election.cc:290] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.507328 17407 raft_consensus.cc:493] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.524731 17407 raft_consensus.cc:515] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.526579 17407 leader_election.cc:290] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.416191 17328 leader_election.cc:290] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.531858 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:40.532030 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 105922us
I20260810 13:54:40.532739 13382 leader_election.cc:304] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:40.533327 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.533907 13040 raft_consensus.cc:2468] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:40.533878 13382 leader_election.cc:304] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:40.534546 17426 raft_consensus.cc:2749] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:40.534643 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.553s (SENT)
I20260810 13:54:40.535051 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:40.535178 17426 raft_consensus.cc:2749] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:40.536530 13382 leader_election.cc:343] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:40.539326 13382 leader_election.cc:343] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:40.542529 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:40.543141 13243 raft_consensus.cc:3060] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:40.547993 13638 tablet_bootstrap.cc:492] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:40.548448 13638 ts_tablet_manager.cc:1403] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.305s user 0.012s sys 0.008s
I20260810 13:54:40.551754 13243 raft_consensus.cc:2468] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:40.552232 13640 tablet_bootstrap.cc:492] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:40.552765 13640 ts_tablet_manager.cc:1403] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.180s user 0.014s sys 0.005s
I20260810 13:54:40.553798 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.555569 13640 raft_consensus.cc:359] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.556281 13640 raft_consensus.cc:385] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:40.556905 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.561786 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:40.562382 13243 raft_consensus.cc:3060] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:40.556592 13640 raft_consensus.cc:740] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:40.565215 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.566087 13640 consensus_queue.cc:260] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.566797 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.567354 13245 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:40.567593 13476 raft_consensus.cc:2410] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260810 13:54:40.568657 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.568933 13640 ts_tablet_manager.cc:1434] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260810 13:54:40.569324 13476 raft_consensus.cc:2393] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:40.568984 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.569870 13640 tablet_bootstrap.cc:492] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:40.571452 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.496438 17403 leader_election.cc:290] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.572716 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.574090 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d9e5103fe644f38d969c64182f7cbb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.574749 13476 raft_consensus.cc:2468] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:40.575073 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.577665 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.577844 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.579211 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:40.579821 12952 leader_election.cc:343] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:40.580749 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.582137 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.582631 13468 raft_consensus.cc:2468] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:40.583803 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:40.585119 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 50503.7us
I20260810 13:54:40.584187 17514 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:40.587908 13638 raft_consensus.cc:359] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.589406 13638 raft_consensus.cc:385] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:40.589177 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.589697 13638 raft_consensus.cc:740] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:40.591339 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.591907 13476 raft_consensus.cc:2468] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.593537 17479 leader_election.cc:290] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.593708 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.599131 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.599640 13467 raft_consensus.cc:2468] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:40.620625 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.621204 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.621928 13040 raft_consensus.cc:2393] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 2: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:40.622274 13243 raft_consensus.cc:2468] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:40.623184 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.626456 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.627295 13476 raft_consensus.cc:2468] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.628821 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.629055 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.629499 13476 raft_consensus.cc:2468] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.629657 13638 consensus_queue.cc:260] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.631340 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.632515 17407 raft_consensus.cc:493] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:40.633029 17407 raft_consensus.cc:515] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.634159 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.636059 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.636603 17407 leader_election.cc:290] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.637715 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.637840 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.638644 13040 raft_consensus.cc:2393] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 2: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:40.641098 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.641203 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.641726 13054 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.641822 12952 leader_election.cc:304] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:40.646395 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.646977 13056 raft_consensus.cc:2468] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.646919 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.647403 13476 raft_consensus.cc:2468] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.645712 13638 ts_tablet_manager.cc:1434] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.097s user 0.006s sys 0.000s
I20260810 13:54:40.677753 13638 tablet_bootstrap.cc:492] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:40.677495 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:40.678196 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:40.679276 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.680536 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.681382 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.682418 13461 raft_consensus.cc:2468] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.685537 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.686477 13465 raft_consensus.cc:2468] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.690788 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.691346 13480 raft_consensus.cc:2468] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.693306 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.695535 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.696163 13480 raft_consensus.cc:2468] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.702544 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.704363 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.705404 13480 raft_consensus.cc:2410] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260810 13:54:40.708352 13640 tablet_bootstrap.cc:654] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:40.723930 13638 tablet_bootstrap.cc:654] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:40.724503 13243 raft_consensus.cc:1240] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:40.725766 13245 raft_consensus.cc:1240] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
W20260810 13:54:40.726064 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 84305.8us
I20260810 13:54:40.726816 12952 leader_election.cc:304] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:40.727663 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:40.727993 12954 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:40.728300 13040 raft_consensus.cc:2468] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.727881 17518 tablet.cc:1724] T d36f17094e504d80a2443dc12855c744 P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:40.728922 17403 raft_consensus.cc:2804] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:40.729403 17403 raft_consensus.cc:697] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:40.729488 17401 raft_consensus.cc:493] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.730774 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.731931 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.732952 17406 raft_consensus.cc:493] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.734843 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.737006 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.738466 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.739454 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.740540 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.741670 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.742781 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.761319 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.768518 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.769796 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.771097 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.772308 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.773592 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.774868 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.775425 13049 raft_consensus.cc:2468] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:40.776058 13639 tablet_bootstrap.cc:492] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:40.776546 13639 ts_tablet_manager.cc:1403] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.539s user 0.014s sys 0.010s
I20260810 13:54:40.777069 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.778378 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.781188 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.782491 13244 raft_consensus.cc:1240] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:40.783162 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.640990 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.784916 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.783182 17502 raft_consensus.cc:493] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:40.786861 13639 raft_consensus.cc:359] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.788098 13639 raft_consensus.cc:385] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:40.788444 13639 raft_consensus.cc:740] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:40.788537 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.789194 13639 consensus_queue.cc:260] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.790227 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.791873 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfbb2036c800469f90ad4d5d211ac462" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.792230 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.793445 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.740832 17401 raft_consensus.cc:515] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.795401 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.777246 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.778151 17328 raft_consensus.cc:2804] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:40.799037 17328 raft_consensus.cc:697] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:40.776749 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.800458 17328 consensus_queue.cc:237] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.802376 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.801751 17403 consensus_queue.cc:237] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.801716 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.733423 17406 raft_consensus.cc:515] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:40.805667 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.806902 17406 leader_election.cc:290] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.807106 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.810176 17401 leader_election.cc:290] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:40.811537 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.813462 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.808480 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.809123 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.810104 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.786249 17502 raft_consensus.cc:515] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
W20260810 13:54:40.816105 12796 debug-util.cc:398] Leaking SignalData structure 0x7b08000da880 after lost signal to thread 12681
I20260810 13:54:40.815871 17407 raft_consensus.cc:493] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.816454 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:40.816883 12796 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5940 after lost signal to thread 12801
I20260810 13:54:40.816802 17502 leader_election.cc:290] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.816603 17407 raft_consensus.cc:515] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.822359 17407 leader_election.cc:290] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.817246 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.823040 17407 raft_consensus.cc:493] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.823570 17407 raft_consensus.cc:515] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:40.825519 17407 leader_election.cc:290] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.826508 17509 raft_consensus.cc:493] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.827515 17509 raft_consensus.cc:515] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.830420 17509 leader_election.cc:290] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.831100 17509 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:40.831027 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.831604 17509 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:40.834322 17509 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:40.835124 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:40.835515 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.836975 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.838388 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.840015 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.841367 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.842736 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.844265 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.845784 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.847352 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.849422 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.851104 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.855784 13164 leader_election.cc:304] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:40.860241 17489 raft_consensus.cc:3060] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:40.866236 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 131794us
I20260810 13:54:40.872957 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.875252 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.876221 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.877173 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.877873 13461 raft_consensus.cc:2468] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:40.877389 13480 raft_consensus.cc:2468] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:40.876865 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.879310 13468 raft_consensus.cc:2468] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:40.883219 17489 raft_consensus.cc:2749] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:40.887789 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.888070 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:40.889444 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:40.893679 13164 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:40.898618 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a4341f5d274a9eb54cb030b47c9a91" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.899405 13480 raft_consensus.cc:2468] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:40.900148 13164 leader_election.cc:304] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:40.900849 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.904938 17385 ts_tablet_manager.cc:1929] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260810 13:54:40.916409 13164 leader_election.cc:304] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:40.918195 17489 raft_consensus.cc:2804] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:40.918725 17489 raft_consensus.cc:493] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:40.920382 17489 raft_consensus.cc:3060] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:40.919894 17536 raft_consensus.cc:2804] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:40.905488 17385 log.cc:1199] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: Deleting WAL directory at /tmp/dist-test-taskCfbsfU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786369990459946-12432-0/minicluster-data/ts-0/wal/wals/3a1b35d369474ba9bee379089796bd3c
I20260810 13:54:40.937057 17536 raft_consensus.cc:493] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:40.937739 17385 ts_tablet_manager.cc:1950] T 3a1b35d369474ba9bee379089796bd3c P 88ed04d733ec447583fc897e233dd4b3: Deleting consensus metadata
I20260810 13:54:40.937827 17536 raft_consensus.cc:3060] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:40.943058 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 76155.4us
I20260810 13:54:40.955835 13638 tablet_bootstrap.cc:492] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:40.956385 13638 ts_tablet_manager.cc:1403] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.279s user 0.010s sys 0.005s
I20260810 13:54:40.958585 13640 tablet_bootstrap.cc:492] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:40.959054 13640 ts_tablet_manager.cc:1403] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.389s user 0.009s sys 0.006s
W20260810 13:54:40.968871 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 52530.1us
I20260810 13:54:40.970757 13164 leader_election.cc:304] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:40.974370 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.975342 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.980593 17544 raft_consensus.cc:2804] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:40.981072 17544 raft_consensus.cc:493] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:40.981720 17544 raft_consensus.cc:3060] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:40.982370 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.983075 13474 raft_consensus.cc:2468] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:40.984052 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.985164 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.986562 13164 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:40.984081 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.992038 17547 raft_consensus.cc:2804] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:40.993449 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.994765 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:41.001900 17489 raft_consensus.cc:515] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.003741 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.005159 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.006268 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:40.992565 17547 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
W20260810 13:54:41.012959 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 69278.4us
I20260810 13:54:41.013137 17547 raft_consensus.cc:3060] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:41.004920 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:41.030305 17489 leader_election.cc:290] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.038836 17385 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55806 (request call id 1) took 3052 ms. Trace:
I20260810 13:54:41.012174 17536 raft_consensus.cc:515] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:41.043650 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 57153.8us
I20260810 13:54:41.048003 12952 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:41.058017 17536 leader_election.cc:290] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.031190 13457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.068787 17544 raft_consensus.cc:515] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:41.082619 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:41.073494 13167 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:41.084133 13167 leader_election.cc:304] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.086791 17536 raft_consensus.cc:2749] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.089010 13638 raft_consensus.cc:359] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.089965 13638 raft_consensus.cc:385] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:41.090384 13638 raft_consensus.cc:740] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:41.091248 13638 consensus_queue.cc:260] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.096185 13164 leader_election.cc:304] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:41.097955 13164 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:41.098496 17552 raft_consensus.cc:2804] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.099699 17552 raft_consensus.cc:493] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:41.100217 17552 raft_consensus.cc:3060] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.105495 17544 leader_election.cc:290] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.058657 17406 raft_consensus.cc:2804] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.112056 17406 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:41.112546 17406 raft_consensus.cc:3060] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.106551 17547 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.112975 17550 raft_consensus.cc:2804] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.116515 17550 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:41.042084 17385 rpcz_store.cc:276] 0810 13:54:37.986862 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.987213 (+ 351us) service_pool.cc:224] Handling call
0810 13:54:40.232434 (+2245221us) ts_tablet_manager.cc:1151] Deleting tablet 3a1b35d369474ba9bee379089796bd3c
0810 13:54:40.242795 (+ 10361us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0810 13:54:40.584531 (+341736us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:40.893295 (+308764us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:41.038726 (+145431us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94307,"tablet-delete.queue_time_us":2244539}
I20260810 13:54:41.117089 17550 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.118319 12472 catalog_manager.cc:5050] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): tablet 3a1b35d369474ba9bee379089796bd3c (table default.Table_94f6cc658a01407194e9d5858f48d615 [id=1a0c5b7e411144e186003762b5dc3ace]) successfully deleted
I20260810 13:54:41.115100 13164 leader_election.cc:304] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:41.123597 17560 raft_consensus.cc:2804] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.124313 17560 raft_consensus.cc:493] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:41.124963 17560 raft_consensus.cc:3060] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.137162 12952 leader_election.cc:304] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:41.138718 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.141160 13640 raft_consensus.cc:359] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.141897 13640 raft_consensus.cc:385] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:41.142275 13640 raft_consensus.cc:740] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:41.155457 13164 leader_election.cc:304] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:41.159240 17536 raft_consensus.cc:2804] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.161121 17536 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:41.064874 13639 ts_tablet_manager.cc:1434] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.288s user 0.007s sys 0.007s
I20260810 13:54:41.163836 17536 raft_consensus.cc:3060] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.139930 17407 raft_consensus.cc:493] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.162492 17547 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:41.174968 13164 consensus_peers.cc:597] T a17d73c65f544b7c8566fd874ee87a25 P 218e946161f64d1d92427684ac15e4fb -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a17d73c65f544b7c8566fd874ee87a25. This is attempt 6: this message will repeat every 5th retry.
I20260810 13:54:41.176589 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.177035 17407 raft_consensus.cc:515] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.178062 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.179713 17407 leader_election.cc:290] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:41.180181 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.180972 13164 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:41.169973 13457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.182404 13638 ts_tablet_manager.cc:1434] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.195s user 0.007s sys 0.000s
I20260810 13:54:41.171252 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.172330 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:41.172996 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.174710 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:41.183424 13638 tablet_bootstrap.cc:492] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:41.175384 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.152186 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247fb8b09c12407d8535c07c5d0687fe" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.167660 13454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.191375 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.190891 17550 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.192306 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.194016 17547 raft_consensus.cc:2804] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.194483 17547 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:41.194943 17547 raft_consensus.cc:3060] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.183076 13640 consensus_queue.cc:260] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.198729 13449 raft_consensus.cc:2468] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:41.201339 13164 leader_election.cc:304] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:41.203464 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:41.203166 17552 raft_consensus.cc:515] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:41.205509 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 60476.5us
I20260810 13:54:41.209364 13552 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:41.211093 17560 raft_consensus.cc:515] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.212913 17569 raft_consensus.cc:2804] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.213374 17569 raft_consensus.cc:493] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:41.213977 17569 raft_consensus.cc:3060] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.207945 13164 leader_election.cc:304] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:41.219007 17552 leader_election.cc:290] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:41.216586 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 79490.2us
I20260810 13:54:41.222692 17550 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.223832 13639 tablet_bootstrap.cc:492] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:41.224977 17560 leader_election.cc:290] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.222932 17479 raft_consensus.cc:2804] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:41.226207 17479 raft_consensus.cc:697] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:41.233994 13640 ts_tablet_manager.cc:1434] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.275s user 0.006s sys 0.004s
I20260810 13:54:41.265159 13640 tablet_bootstrap.cc:492] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:41.265750 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 59586.8us
W20260810 13:54:41.268306 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 60462.9us
I20260810 13:54:41.268954 13164 leader_election.cc:304] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.232059 17536 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.312770 13640 tablet_bootstrap.cc:654] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:41.319234 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 143295us
I20260810 13:54:41.322170 13382 leader_election.cc:304] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.322901 17509 raft_consensus.cc:2749] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.330237 13382 leader_election.cc:304] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:41.331149 17509 raft_consensus.cc:2804] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:41.331631 17509 raft_consensus.cc:493] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:41.332180 17509 raft_consensus.cc:3060] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:41.341710 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 2327309017db4094907b3e405988f224 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2327309017db4094907b3e405988f224 consensus state has no leader
I20260810 13:54:41.344637 13640 tablet_bootstrap.cc:492] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
W20260810 13:54:41.344877 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 76011.4us
I20260810 13:54:41.345113 13640 ts_tablet_manager.cc:1403] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.080s user 0.013s sys 0.006s
I20260810 13:54:41.344514 17479 consensus_queue.cc:237] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:41.345789 13164 leader_election.cc:304] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.349001 13640 raft_consensus.cc:359] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.349797 13640 raft_consensus.cc:385] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:41.350083 13640 raft_consensus.cc:740] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:41.350903 13640 consensus_queue.cc:260] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.352614 13640 ts_tablet_manager.cc:1434] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260810 13:54:41.353837 13640 tablet_bootstrap.cc:492] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:41.356127 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 87537.1us
I20260810 13:54:41.356930 13167 leader_election.cc:304] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.361667 13640 tablet_bootstrap.cc:654] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:41.347474 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 119502us
I20260810 13:54:41.377028 12952 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:41.382305 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 52158.3us
I20260810 13:54:41.385751 13382 leader_election.cc:304] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:41.377949 12952 leader_election.cc:304] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:41.386550 17571 raft_consensus.cc:2804] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:41.386922 17571 raft_consensus.cc:493] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:41.387351 17571 raft_consensus.cc:3060] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:41.397460 13124 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:41.400331 13640 tablet_bootstrap.cc:492] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:41.400902 13640 ts_tablet_manager.cc:1403] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.047s user 0.029s sys 0.013s
W20260810 13:54:41.353166 12951 connection.cc:256] RPC call timeout handler was delayed by -1.2568042029161006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.38450000000000006s for a response
W20260810 13:54:41.401748 12951 connection.cc:256] RPC call timeout handler was delayed by -1.1008801851421595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.35000000000000003s for a response
I20260810 13:54:41.403924 13640 raft_consensus.cc:359] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.404659 13640 raft_consensus.cc:385] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:41.404992 13640 raft_consensus.cc:740] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:41.405812 13640 consensus_queue.cc:260] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.407490 13640 ts_tablet_manager.cc:1434] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
W20260810 13:54:41.402275 12951 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.3:36001 timed out after 3.658s (SENT)
I20260810 13:54:41.396416 17328 raft_consensus.cc:2804] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:41.408243 17403 raft_consensus.cc:2804] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:41.337695 17560 raft_consensus.cc:2804] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.432178 13638 tablet_bootstrap.cc:654] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:41.434353 17574 raft_consensus.cc:493] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.435190 17566 raft_consensus.cc:2749] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.435088 17574 raft_consensus.cc:515] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.436594 13343 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:41.441797 17539 raft_consensus.cc:493] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.442369 17539 raft_consensus.cc:515] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.428779 17552 raft_consensus.cc:2749] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.427798 17544 raft_consensus.cc:2749] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.449796 17536 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.431339 17560 raft_consensus.cc:493] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:41.451293 17560 raft_consensus.cc:3060] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.457387 17558 tablet.cc:1724] T 1122dcf7bcea4654bf29ff01fc4a350d P 88ed04d733ec447583fc897e233dd4b3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:41.468353 13640 tablet_bootstrap.cc:492] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:41.473196 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 87505us
I20260810 13:54:41.443054 17518 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55806 (request call id 28) took 2608 ms. Trace:
I20260810 13:54:41.479956 13640 tablet_bootstrap.cc:654] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:41.466440 17403 raft_consensus.cc:697] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:41.488454 17403 consensus_queue.cc:237] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.480237 17518 rpcz_store.cc:276] 0810 13:54:38.809645 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.817030 (+ 7385us) service_pool.cc:224] Handling call
0810 13:54:41.416979 (+2599949us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:38.924948 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:38.925742 (+ 794us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:38.925852 (+ 110us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:38.926200 (+ 348us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:38.926428 (+ 228us) alter_schema_op.cc:128] START. Timestamp: 1786370078926300
0810 13:54:38.926498 (+ 70us) op_driver.cc:348] REPLICATION: starting
0810 13:54:38.927751 (+ 1253us) log.cc:844] Serialized 173 byte log entry
0810 13:54:40.590600 (+1662849us) op_driver.cc:464] REPLICATION: finished
0810 13:54:40.727786 (+137186us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:40.729390 (+ 1604us) log.cc:844] Serialized 5 byte log entry
0810 13:54:41.127485 (+398095us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:41.223958 (+ 96473us) log.cc:844] Serialized 14 byte log entry
0810 13:54:41.389009 (+165051us) alter_schema_op.cc:73] Released schema lock
0810 13:54:41.402723 (+ 13714us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":136911,"prepare.queue_time_us":87638,"prepare.run_cpu_time_us":4171,"prepare.run_wall_time_us":108568,"replication_time_us":1663968,"thread_start_us":519795,"threads_started":4,"wal-append.queue_time_us":250115,"wal-append.run_cpu_time_us":2584,"wal-append.run_wall_time_us":1023066}]]}
I20260810 13:54:41.443403 17328 raft_consensus.cc:697] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:41.491789 17328 consensus_queue.cc:237] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.516016 17406 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:41.518015 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:41.519053 17406 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.520129 17539 leader_election.cc:290] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.529067 17598 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:41.532320 17598 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:41.534968 13640 tablet_bootstrap.cc:492] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:41.535451 13640 ts_tablet_manager.cc:1403] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.067s user 0.005s sys 0.008s
W20260810 13:54:41.544016 12954 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:41.545559 13639 tablet_bootstrap.cc:654] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:41.545272 17571 raft_consensus.cc:515] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.547649 17598 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:41.545360 13640 raft_consensus.cc:359] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.558231 13640 raft_consensus.cc:385] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:41.558593 13640 raft_consensus.cc:740] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:41.559405 13640 consensus_queue.cc:260] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.570025 13640 ts_tablet_manager.cc:1434] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.034s user 0.004s sys 0.004s
I20260810 13:54:41.571261 13640 tablet_bootstrap.cc:492] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:41.574983 17570 raft_consensus.cc:493] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.575497 17570 raft_consensus.cc:515] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.577296 17574 leader_election.cc:290] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.577553 17570 leader_election.cc:290] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:41.553462 17569 raft_consensus.cc:515] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.581665 17569 leader_election.cc:290] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.460459 17547 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.584754 17547 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.573105 17544 raft_consensus.cc:493] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.586714 17544 raft_consensus.cc:515] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.573403 17552 raft_consensus.cc:493] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.589103 17552 raft_consensus.cc:515] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.590859 17552 leader_election.cc:290] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:41.603636 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 201411us
W20260810 13:54:41.604673 12951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:41.609144 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 252295us
I20260810 13:54:41.609876 13167 leader_election.cc:304] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.620385 13167 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:41.624369 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 824 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:41.621587 17552 raft_consensus.cc:2749] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:41.628041 17544 leader_election.cc:290] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.632553 17560 raft_consensus.cc:515] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.635219 17560 leader_election.cc:290] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.647928 13638 tablet_bootstrap.cc:492] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:41.648466 13638 ts_tablet_manager.cc:1403] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.465s user 0.015s sys 0.007s
I20260810 13:54:41.650012 17509 raft_consensus.cc:515] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.651878 13638 raft_consensus.cc:359] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.657124 17582 raft_consensus.cc:2804] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.657593 17582 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:41.658144 17582 raft_consensus.cc:3060] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.647605 12495 catalog_manager.cc:5719] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.661391 13167 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:41.664431 13167 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.665542 17583 raft_consensus.cc:2804] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.666082 17583 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:41.666626 17583 raft_consensus.cc:3060] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.673770 13167 leader_election.cc:304] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.674966 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:41.676236 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:41.678987 13252 raft_consensus.cc:1240] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:41.680892 17560 raft_consensus.cc:2749] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.681236 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.674906 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:41.685552 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:41.686082 13264 raft_consensus.cc:2468] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
W20260810 13:54:41.687568 17558 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.229s user 0.001s sys 0.006s
I20260810 13:54:41.652460 13638 raft_consensus.cc:385] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:41.689975 13638 raft_consensus.cc:740] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:41.690714 13638 consensus_queue.cc:260] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.693384 13638 ts_tablet_manager.cc:1434] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.044s user 0.007s sys 0.000s
I20260810 13:54:41.673759 12495 catalog_manager.cc:5719] T aa0567b908974da5817ed62aafecee35 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.697629 17544 raft_consensus.cc:2749] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.698279 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]). Expected version 1 got 0
I20260810 13:54:41.706593 13167 leader_election.cc:304] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.707579 17560 raft_consensus.cc:2749] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.712342 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]). Expected version 1 got 0
I20260810 13:54:41.713299 12495 catalog_manager.cc:5719] T 094a3448b54c409281c31813e60dcb7f P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.715083 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]). Expected version 1 got 0
I20260810 13:54:41.715147 17582 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:41.715831 12495 catalog_manager.cc:5719] T dfbb2036c800469f90ad4d5d211ac462 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.717547 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]). Expected version 1 got 0
I20260810 13:54:41.718302 12495 catalog_manager.cc:5719] T f764e91bb2c94bc3be425b65323764cb P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.719538 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]). Expected version 1 got 0
I20260810 13:54:41.722586 13638 tablet_bootstrap.cc:492] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:41.727679 17544 raft_consensus.cc:493] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.728304 17544 raft_consensus.cc:515] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.731578 17544 leader_election.cc:290] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.741803 13167 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.747996 17582 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.749321 17544 raft_consensus.cc:2749] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:41.750168 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 74932us
I20260810 13:54:41.752559 13244 raft_consensus.cc:1240] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:41.754580 13243 raft_consensus.cc:1240] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:41.749639 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.758369 17524 raft_consensus.cc:493] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.758931 17524 raft_consensus.cc:515] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.720075 17583 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.770713 17583 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.771828 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]). Expected version 1 got 0
I20260810 13:54:41.772531 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb]). Expected version 1 got 0
I20260810 13:54:41.767719 13167 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.773226 12495 catalog_manager.cc:5719] T 1c6686175347496093cb22ce8a3d4176 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.774571 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]). Expected version 1 got 0
I20260810 13:54:41.775466 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]). Expected version 2 got 0
I20260810 13:54:41.780460 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]). Expected version 1 got 0
I20260810 13:54:41.781605 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]). Expected version 1 got 0
I20260810 13:54:41.782335 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]). Expected version 2 got 0
I20260810 13:54:41.782910 12495 catalog_manager.cc:5719] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.783936 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]). Expected version 1 got 0
I20260810 13:54:41.784543 17509 leader_election.cc:290] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:41.785096 12495 catalog_manager.cc:5719] T ff1229ebe9304f19ab84d5a172aba937 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.774430 17582 raft_consensus.cc:2749] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.779789 13167 leader_election.cc:304] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.789827 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:41.795866 13167 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:41.797260 17524 leader_election.cc:290] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.801373 13640 tablet_bootstrap.cc:654] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:41.785162 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5ad84fe2604dd2959768db31f66e7c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:41.784852 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:41.809489 17560 raft_consensus.cc:2749] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.810124 17560 raft_consensus.cc:2804] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.810484 17560 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:41.810840 17560 raft_consensus.cc:3060] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.809494 17610 tablet.cc:1724] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:41.821720 17571 leader_election.cc:290] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:41.823518 13167 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:41.825618 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]). Expected version 2 got 0
I20260810 13:54:41.826468 12495 catalog_manager.cc:5719] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 1 to 2, leader changed from 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3) to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 2 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.828188 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]). Expected version 1 got 0
I20260810 13:54:41.823871 13264 raft_consensus.cc:1240] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:41.828863 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]). Expected version 1 got 0
I20260810 13:54:41.829861 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]). Expected version 1 got 0
I20260810 13:54:41.830771 12495 catalog_manager.cc:5719] T bc5b9e218c1f4f4083acc59a651f0cb6 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.831986 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:41.837486 13640 tablet_bootstrap.cc:492] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:41.839184 13640 ts_tablet_manager.cc:1403] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.268s user 0.015s sys 0.005s
I20260810 13:54:41.845942 13167 leader_election.cc:304] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:41.846335 17571 raft_consensus.cc:493] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.846801 17571 raft_consensus.cc:515] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.846695 12495 catalog_manager.cc:5719] T 6d2d209f801b4aa0aff3137a51fc7556 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.847864 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:41.848959 17571 leader_election.cc:290] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:41.851670 17544 raft_consensus.cc:2804] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.852017 17544 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:41.852347 17544 raft_consensus.cc:3060] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.848675 12495 catalog_manager.cc:5719] T 953f83dab3ca406f8638e446911614b0 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.857378 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:41.858259 12495 catalog_manager.cc:5719] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.859385 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:41.860139 12495 catalog_manager.cc:5719] T 51813605283e43f2b4efe6fb2fab652c P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.866055 13167 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:41.888427 17574 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:41.889848 13167 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:41.857342 17582 raft_consensus.cc:2804] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.897500 12495 catalog_manager.cc:5719] T d321f9c075554ffcb299d02792a0662d P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:41.899037 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]). Expected version 1 got 0
I20260810 13:54:41.892766 17582 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:41.900117 12495 catalog_manager.cc:5719] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.901094 17582 raft_consensus.cc:3060] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.901516 12495 catalog_manager.cc:5719] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.902467 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]). Expected version 1 got 0
I20260810 13:54:41.902518 13243 raft_consensus.cc:1240] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:41.903065 12495 catalog_manager.cc:5719] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.903942 17544 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.904812 17547 raft_consensus.cc:2804] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:41.905195 17547 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:41.905488 17547 raft_consensus.cc:3060] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:41.909788 17560 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.911125 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.912067 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.912636 17544 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.914021 17558 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:55806 (request call id 29) took 3087 ms. Trace:
I20260810 13:54:41.914654 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.912360 13033 raft_consensus.cc:1240] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:41.918443 17547 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.914533 17558 rpcz_store.cc:276] 0810 13:54:38.826107 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:38.826257 (+ 150us) service_pool.cc:224] Handling call
0810 13:54:41.913669 (+3087412us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:39.014830 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:39.015187 (+ 357us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:39.015220 (+ 33us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:39.015289 (+ 69us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:39.015416 (+ 127us) alter_schema_op.cc:128] START. Timestamp: 1786370079010286
0810 13:54:39.015438 (+ 22us) op_driver.cc:348] REPLICATION: starting
0810 13:54:39.051059 (+ 35621us) log.cc:844] Serialized 173 byte log entry
0810 13:54:41.047057 (+1995998us) op_driver.cc:464] REPLICATION: finished
0810 13:54:41.419291 (+372234us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0810 13:54:41.465601 (+ 46310us) log.cc:844] Serialized 5 byte log entry
0810 13:54:41.804542 (+338941us) tablet_metadata.cc:665] Metadata flushed
0810 13:54:41.805444 (+ 902us) log.cc:844] Serialized 14 byte log entry
0810 13:54:41.913289 (+107845us) alter_schema_op.cc:73] Released schema lock
0810 13:54:41.913365 (+ 76us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":371910,"prepare.queue_time_us":127914,"prepare.run_cpu_time_us":5972,"prepare.run_wall_time_us":207186,"replication_time_us":2031364,"thread_start_us":602943,"threads_started":4,"wal-append.queue_time_us":380866,"wal-append.run_cpu_time_us":3115,"wal-append.run_wall_time_us":1146539}]]}
I20260810 13:54:41.919601 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.920598 17479 raft_consensus.cc:493] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.921655 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.921537 17479 raft_consensus.cc:515] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.926751 17547 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.926792 17560 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.927485 13638 tablet_bootstrap.cc:654] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:41.904414 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]). Expected version 1 got 0
I20260810 13:54:41.896582 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.932499 12495 catalog_manager.cc:5719] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.933636 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]). Expected version 1 got 0
I20260810 13:54:41.934510 12495 catalog_manager.cc:5719] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.936987 13640 raft_consensus.cc:359] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.937691 13640 raft_consensus.cc:385] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:41.937969 13640 raft_consensus.cc:740] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:41.940778 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]). Expected version 1 got 0
I20260810 13:54:41.943305 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:41.943763 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:41.945362 17619 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:41.944552 13245 raft_consensus.cc:2393] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:41.944800 13640 consensus_queue.cc:260] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:41.949280 13640 ts_tablet_manager.cc:1434] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.109s user 0.006s sys 0.000s
I20260810 13:54:41.924503 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.960448 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.960614 13028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:41.967980 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:41.968850 17619 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:41.969228 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.978868 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.979967 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.980767 17479 leader_election.cc:290] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:41.981695 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.982065 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.983561 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.983749 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.984511 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.985455 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.943302 12495 catalog_manager.cc:5719] T bd127b3e02b54ba2a802877233c18247 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:41.980376 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.970564 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.990079 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:41.996822 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:41.996944 13257 raft_consensus.cc:1240] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:41.998027 15216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:42.000404 12729 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:42.001067 13257 raft_consensus.cc:1275] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:42.002936 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d9e5103fe644f38d969c64182f7cbb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:42.003443 13476 raft_consensus.cc:3060] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:42.003768 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:42.004333 13462 raft_consensus.cc:3060] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:42.005003 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:42.005517 13456 raft_consensus.cc:3060] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.005692 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:42.006700 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:42.007150 13480 raft_consensus.cc:3060] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:42.008119 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:42.008366 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:41.993389 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]). Expected version 1 got 0
I20260810 13:54:42.008944 13461 raft_consensus.cc:3060] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.010422 17610 tablet.cc:1724] T 1122dcf7bcea4654bf29ff01fc4a350d P 218e946161f64d1d92427684ac15e4fb: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:42.014189 17571 raft_consensus.cc:493] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:42.014647 17571 raft_consensus.cc:515] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.016749 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:42.017529 12495 catalog_manager.cc:5719] T 3b7b408a9ad34ea39c912b33e26b49b6 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:42.016515 17571 leader_election.cc:290] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:42.018776 13462 raft_consensus.cc:2468] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:42.019055 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]). Expected version 1 got 0
I20260810 13:54:42.019658 12495 catalog_manager.cc:5719] T 0be536894b164edfb4310ff521e2fb42 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:42.025835 13476 raft_consensus.cc:2468] T 30d9e5103fe644f38d969c64182f7cbb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:42.026193 13461 raft_consensus.cc:2468] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:42.027580 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:42.027988 13480 raft_consensus.cc:2468] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:42.021095 17582 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.029843 17582 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.030254 13454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:42.032717 17509 consensus_queue.cc:1059] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:42.036800 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]). Expected version 2 got 0
I20260810 13:54:42.039069 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]). Expected version 1 got 0
I20260810 13:54:42.040128 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]). Expected version 1 got 0
I20260810 13:54:42.041816 12495 catalog_manager.cc:5719] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:42.042834 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]). Expected version 1 got 0
I20260810 13:54:42.043143 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:42.043735 13257 raft_consensus.cc:2468] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:41.990301 13025 raft_consensus.cc:2468] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:42.062351 13639 tablet_bootstrap.cc:492] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:42.063423 13639 ts_tablet_manager.cc:1403] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.840s user 0.012s sys 0.012s
I20260810 13:54:42.033447 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:42.066938 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.068981 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfbb2036c800469f90ad4d5d211ac462" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.073990 13040 raft_consensus.cc:1240] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260810 13:54:42.074651 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.074004 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.076444 13054 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.077181 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.077996 13054 raft_consensus.cc:1240] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:42.078948 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.080638 13028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.075901 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.082409 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.082854 13048 raft_consensus.cc:2468] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:42.075871 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.086404 17619 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:42.089464 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.089859 13639 raft_consensus.cc:359] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.090749 13639 raft_consensus.cc:385] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.091053 13639 raft_consensus.cc:740] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.091387 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.091856 13639 consensus_queue.cc:260] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.096392 17619 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:42.093626 13454 raft_consensus.cc:2468] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:42.098596 13453 raft_consensus.cc:3060] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.105221 17509 raft_consensus.cc:3055] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:42.105031 17570 consensus_queue.cc:1059] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:42.105609 17509 raft_consensus.cc:740] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
W20260810 13:54:42.106602 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 73914.9us
I20260810 13:54:42.113600 13638 tablet_bootstrap.cc:492] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:42.114087 13638 ts_tablet_manager.cc:1403] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.392s user 0.011s sys 0.007s
W20260810 13:54:42.108541 12729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.62:33317, user_credentials={real_user=slave}} blocked reactor thread for 108292us
I20260810 13:54:42.043563 12495 catalog_manager.cc:5719] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:42.124439 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]). Expected version 1 got 0
I20260810 13:54:42.125087 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]). Expected version 1 got 0
I20260810 13:54:42.126055 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]). Expected version 1 got 0
I20260810 13:54:42.126739 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d36f17094e504d80a2443dc12855c744 (table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67]). Expected version 1 got 0
I20260810 13:54:42.127303 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]). Expected version 1 got 0
I20260810 13:54:42.106345 13456 raft_consensus.cc:2468] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:42.133183 17571 raft_consensus.cc:3055] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:42.133705 17571 raft_consensus.cc:740] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:42.106429 17509 consensus_queue.cc:260] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.135118 17571 consensus_queue.cc:260] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.136140 17509 raft_consensus.cc:3060] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.136353 17571 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.137624 13638 raft_consensus.cc:359] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.138285 13638 raft_consensus.cc:385] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.138556 13638 raft_consensus.cc:740] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.139154 13638 consensus_queue.cc:260] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.134443 13453 raft_consensus.cc:2468] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:42.147567 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:42.140625 13638 ts_tablet_manager.cc:1434] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.026s user 0.004s sys 0.000s
I20260810 13:54:42.161672 13640 tablet_bootstrap.cc:492] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:42.163488 13638 tablet_bootstrap.cc:492] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:42.166846 17570 consensus_queue.cc:1059] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260810 13:54:42.167811 17570 consensus_queue.cc:1048] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:42.170822 17571 raft_consensus.cc:3055] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:42.170977 13640 tablet_bootstrap.cc:654] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.171247 17571 raft_consensus.cc:740] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:42.172115 17571 consensus_queue.cc:260] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:42.173368 17571 raft_consensus.cc:3060] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.175592 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:42.092576 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.189651 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.192435 13039 raft_consensus.cc:1240] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:42.193571 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.194991 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.195271 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.196635 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.198792 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.200201 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:42.213033 17406 consensus_queue.cc:1059] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:42.214661 13640 tablet_bootstrap.cc:492] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:42.215111 13640 ts_tablet_manager.cc:1403] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.054s user 0.011s sys 0.000s
W20260810 13:54:42.214511 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 140646us
I20260810 13:54:42.217573 17579 raft_consensus.cc:3055] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:42.218816 12951 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.220088 17599 raft_consensus.cc:2749] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.217949 17579 raft_consensus.cc:740] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:42.213065 17403 consensus_queue.cc:1059] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260810 13:54:42.221472 17403 raft_consensus.cc:3055] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:42.221804 17403 raft_consensus.cc:740] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:42.221616 13640 raft_consensus.cc:359] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.221562 17579 consensus_queue.cc:260] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.222229 13640 raft_consensus.cc:385] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.222460 13640 raft_consensus.cc:740] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.222975 17579 raft_consensus.cc:3060] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.222844 17403 consensus_queue.cc:260] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.223192 13640 consensus_queue.cc:260] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.224285 17403 raft_consensus.cc:3060] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:42.225473 13640 ts_tablet_manager.cc:1434] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260810 13:54:42.225636 13638 tablet_bootstrap.cc:654] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.220439 12951 leader_election.cc:304] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:42.228828 17328 raft_consensus.cc:2804] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:42.229179 17328 raft_consensus.cc:493] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:42.229512 17328 raft_consensus.cc:3060] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:42.232064 12951 leader_election.cc:343] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:42.230619 17539 consensus_queue.cc:1059] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260810 13:54:42.232671 12951 leader_election.cc:304] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.233764 17599 raft_consensus.cc:3055] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:42.233862 17539 raft_consensus.cc:2749] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:42.234129 17599 raft_consensus.cc:740] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:42.235028 17599 consensus_queue.cc:260] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.236289 17599 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.251161 12951 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.252099 17406 raft_consensus.cc:2749] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.254418 17539 consensus_queue.cc:1059] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:42.256052 12951 leader_election.cc:304] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.256824 13640 tablet_bootstrap.cc:492] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:42.257172 17539 raft_consensus.cc:3055] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:42.257555 17539 raft_consensus.cc:740] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
W20260810 13:54:42.259212 12952 leader_election.cc:343] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:42.258665 17539 consensus_queue.cc:260] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:42.261508 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 95276us
I20260810 13:54:42.266394 17582 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:42.266876 17582 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:42.271376 13382 leader_election.cc:343] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:42.268676 17582 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.128603 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]). Expected version 1 got 0
I20260810 13:54:42.281872 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]). Expected version 1 got 0
W20260810 13:54:42.283164 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 93855.8us
I20260810 13:54:42.283429 12495 catalog_manager.cc:5719] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:42.306185 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]). Expected version 1 got 0
I20260810 13:54:42.293540 13640 tablet_bootstrap.cc:654] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.344358 13638 tablet_bootstrap.cc:492] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:42.344830 13638 ts_tablet_manager.cc:1403] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.183s user 0.012s sys 0.003s
I20260810 13:54:42.352870 17479 raft_consensus.cc:2749] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:42.353068 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 97144.9us
I20260810 13:54:42.350696 13638 raft_consensus.cc:359] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.331559 17406 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:42.353693 13638 raft_consensus.cc:385] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.353940 13638 raft_consensus.cc:740] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.353964 17406 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.354481 12951 leader_election.cc:304] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.355677 12951 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.356022 17406 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.356696 17479 raft_consensus.cc:2749] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.357311 17479 raft_consensus.cc:2749] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.357226 12951 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.357877 17479 raft_consensus.cc:493] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:42.358299 17479 raft_consensus.cc:515] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.359076 13638 consensus_queue.cc:260] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.360080 17479 leader_election.cc:290] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.361415 13639 ts_tablet_manager.cc:1434] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.297s user 0.004s sys 0.004s
I20260810 13:54:42.362844 13639 tablet_bootstrap.cc:492] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:42.363420 13638 ts_tablet_manager.cc:1434] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260810 13:54:42.365180 17539 raft_consensus.cc:3060] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.370970 17328 raft_consensus.cc:515] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.372960 13638 tablet_bootstrap.cc:492] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:42.373075 17328 leader_election.cc:290] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.382100 13638 tablet_bootstrap.cc:654] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.385272 12951 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.414435 17642 raft_consensus.cc:2749] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:42.387729 12476 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7ffb0f96e744a4bb734aba7f3d82995 consensus state has no leader
I20260810 13:54:42.426024 13640 tablet_bootstrap.cc:492] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:42.426467 13640 ts_tablet_manager.cc:1403] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.181s user 0.032s sys 0.020s
I20260810 13:54:42.425930 12495 catalog_manager.cc:5719] T a4b1451bb8254fcb8c507a837d6b2fa4 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:42.427947 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]). Expected version 1 got 0
I20260810 13:54:42.431178 13640 raft_consensus.cc:359] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.431859 13640 raft_consensus.cc:385] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.432120 13640 raft_consensus.cc:740] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.433720 17632 consensus_queue.cc:1059] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 13:54:42.435038 17509 raft_consensus.cc:3055] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:42.435396 17509 raft_consensus.cc:740] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:42.436271 17509 consensus_queue.cc:260] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.438102 13640 consensus_queue.cc:260] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.439947 13640 ts_tablet_manager.cc:1434] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.013s user 0.006s sys 0.001s
I20260810 13:54:42.440884 13640 tablet_bootstrap.cc:492] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:42.448781 17509 raft_consensus.cc:3060] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.450489 13640 tablet_bootstrap.cc:654] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.473366 13638 tablet_bootstrap.cc:492] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:42.473932 13638 ts_tablet_manager.cc:1403] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.110s user 0.006s sys 0.013s
W20260810 13:54:42.475597 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:42.477186 13638 raft_consensus.cc:359] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.478003 13638 raft_consensus.cc:385] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.478317 13638 raft_consensus.cc:740] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.415268 12951 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.385864 17403 raft_consensus.cc:2749] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.480805 17570 raft_consensus.cc:493] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:42.481256 17570 raft_consensus.cc:515] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.481689 17403 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:42.417434 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 156736us
I20260810 13:54:42.483438 17570 leader_election.cc:290] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:42.484807 17328 consensus_queue.cc:1059] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:42.485776 17524 consensus_queue.cc:1048] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:42.487042 17328 raft_consensus.cc:3055] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:42.487614 17328 raft_consensus.cc:740] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:42.487179 13638 consensus_queue.cc:260] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.492100 13638 ts_tablet_manager.cc:1434] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260810 13:54:42.495651 13639 tablet_bootstrap.cc:654] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.495718 17582 raft_consensus.cc:493] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:42.496145 17582 raft_consensus.cc:515] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.497431 13382 leader_election.cc:304] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:42.498092 17582 leader_election.cc:290] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.498178 17570 raft_consensus.cc:2804] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:42.498498 17570 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:42.498805 17570 raft_consensus.cc:3060] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:42.500483 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:42.502022 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 86842.7us
I20260810 13:54:42.502806 12951 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.503594 17403 raft_consensus.cc:2749] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.504837 12951 leader_election.cc:304] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.505757 17403 raft_consensus.cc:2749] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.488481 17328 consensus_queue.cc:260] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.507357 17328 raft_consensus.cc:3060] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:42.511973 17640 consensus_queue.cc:1048] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:42.513216 17570 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:42.518873 12952 leader_election.cc:343] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:42.523470 12952 leader_election.cc:304] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:42.524129 17524 raft_consensus.cc:2804] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:42.524459 17524 raft_consensus.cc:493] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:42.524804 17524 raft_consensus.cc:3060] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:42.493281 13638 tablet_bootstrap.cc:492] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:42.527803 17570 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:42.533872 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b8030450554de3b97266f348329ea6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:42.534471 13245 raft_consensus.cc:2468] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:42.535643 13260 raft_consensus.cc:1275] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260810 13:54:42.536477 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:42.539211 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:42.539831 13264 raft_consensus.cc:2393] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:42.539786 17524 raft_consensus.cc:515] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:42.547685 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:42.550243 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]). Expected version 1 got 0
I20260810 13:54:42.550880 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]). Expected version 2 got 0
I20260810 13:54:42.551033 13638 tablet_bootstrap.cc:654] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.551438 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]). Expected version 3 got 0
W20260810 13:54:42.541304 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:42.554265 13640 tablet_bootstrap.cc:492] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:42.556217 13640 ts_tablet_manager.cc:1403] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.116s user 0.021s sys 0.016s
I20260810 13:54:42.558878 13640 raft_consensus.cc:359] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.571290 13638 tablet_bootstrap.cc:492] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:42.573817 13638 ts_tablet_manager.cc:1403] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.081s user 0.011s sys 0.001s
W20260810 13:54:42.576996 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 72283.5us
W20260810 13:54:42.572197 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:42.578064 13640 raft_consensus.cc:385] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.577903 12951 leader_election.cc:304] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.578459 13640 raft_consensus.cc:740] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:42.579133 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 80891.4us
I20260810 13:54:42.579259 13640 consensus_queue.cc:260] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.581137 13638 raft_consensus.cc:359] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:42.579793 13382 leader_election.cc:343] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:42.583197 13382 consensus_peers.cc:597] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a4fe8abad5649f2a42686c00148d957. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:42.584483 17571 raft_consensus.cc:493] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:42.584533 17570 consensus_queue.cc:1048] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:42.584997 17571 raft_consensus.cc:515] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.586798 13639 tablet_bootstrap.cc:492] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:42.586900 17571 leader_election.cc:290] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:42.587322 13639 ts_tablet_manager.cc:1403] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.225s user 0.009s sys 0.003s
I20260810 13:54:42.583648 13638 raft_consensus.cc:385] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.589885 13640 ts_tablet_manager.cc:1434] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.033s user 0.001s sys 0.005s
I20260810 13:54:42.552551 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]). Expected version 1 got 0
I20260810 13:54:42.588891 13638 raft_consensus.cc:740] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.593698 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]). Expected version 1 got 0
I20260810 13:54:42.593762 13638 consensus_queue.cc:260] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.595062 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]). Expected version 3 got 0
I20260810 13:54:42.595611 13638 ts_tablet_manager.cc:1434] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
I20260810 13:54:42.595826 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]). Expected version 1 got 0
I20260810 13:54:42.598713 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:42.596640 13638 tablet_bootstrap.cc:492] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:42.599318 13462 raft_consensus.cc:3060] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:42.607740 13638 tablet_bootstrap.cc:654] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.607583 13462 raft_consensus.cc:2468] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:42.626338 13453 raft_consensus.cc:1240] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:42.627116 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:42.627380 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0bfa7b61a334886b0bc1583c7d7fee9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:42.626209 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:42.638270 17524 leader_election.cc:290] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.650010 13638 tablet_bootstrap.cc:492] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:42.650477 13638 ts_tablet_manager.cc:1403] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.054s user 0.029s sys 0.010s
I20260810 13:54:42.652843 17646 raft_consensus.cc:493] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:42.653019 13638 raft_consensus.cc:359] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.653702 13638 raft_consensus.cc:385] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.653366 17646 raft_consensus.cc:515] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.653976 13638 raft_consensus.cc:740] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.654624 13638 consensus_queue.cc:260] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.655488 17646 leader_election.cc:290] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:42.657140 13638 ts_tablet_manager.cc:1434] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260810 13:54:42.658090 13638 tablet_bootstrap.cc:492] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:42.660112 12495 catalog_manager.cc:5719] T 1ee6e694366543328526313d7018b5db P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:42.663355 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5ad84fe2604dd2959768db31f66e7c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:42.666460 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:42.667062 13245 raft_consensus.cc:2468] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:42.668732 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:42.669324 13252 raft_consensus.cc:3060] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:42.671581 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 93781.7us
I20260810 13:54:42.672293 17539 raft_consensus.cc:2749] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.672995 12951 leader_election.cc:304] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:42.674113 12951 leader_election.cc:343] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:42.674522 12951 leader_election.cc:304] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.674315 13639 raft_consensus.cc:359] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.674633 17642 raft_consensus.cc:2749] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.674957 13639 raft_consensus.cc:385] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.675307 17539 raft_consensus.cc:2749] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:42.675850 13639 raft_consensus.cc:740] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.676470 13639 consensus_queue.cc:260] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.678121 13639 ts_tablet_manager.cc:1434] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.091s user 0.005s sys 0.001s
I20260810 13:54:42.681382 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:42.681959 13245 raft_consensus.cc:3060] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:42.683538 13252 raft_consensus.cc:2468] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:42.684522 13638 tablet_bootstrap.cc:654] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.690527 13245 raft_consensus.cc:2468] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:42.675750 12951 leader_election.cc:304] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:54:42.706966 12954 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:42.707176 13639 tablet_bootstrap.cc:492] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:42.707752 17524 raft_consensus.cc:2804] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:42.708194 17524 raft_consensus.cc:493] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:42.708596 17524 raft_consensus.cc:3060] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:42.712532 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:42.713893 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:42.714536 13252 raft_consensus.cc:2468] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:42.722445 12952 leader_election.cc:304] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:42.661564 12495 catalog_manager.cc:5719] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:42.724154 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]). Expected version 1 got 0
I20260810 13:54:42.724815 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]). Expected version 1 got 0
I20260810 13:54:42.725574 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]). Expected version 1 got 0
I20260810 13:54:42.726821 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]). Expected version 1 got 0
I20260810 13:54:42.728120 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]). Expected version 2 got 0
I20260810 13:54:42.745999 13638 tablet_bootstrap.cc:492] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:42.746443 13638 ts_tablet_manager.cc:1403] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.089s user 0.031s sys 0.022s
I20260810 13:54:42.755986 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:42.756065 13164 leader_election.cc:304] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:42.756582 13252 raft_consensus.cc:2468] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:42.756907 17582 raft_consensus.cc:2804] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
W20260810 13:54:42.762312 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 86718.7us
I20260810 13:54:42.763124 12951 leader_election.cc:304] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:42.763923 17539 raft_consensus.cc:2804] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:42.764288 17539 raft_consensus.cc:493] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:42.764628 17539 raft_consensus.cc:3060] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:42.764636 13638 raft_consensus.cc:359] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.765334 13638 raft_consensus.cc:385] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.765615 13638 raft_consensus.cc:740] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.766419 13638 consensus_queue.cc:260] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.773804 12951 leader_election.cc:304] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:42.773577 17642 consensus_queue.cc:1048] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:42.778204 17539 raft_consensus.cc:515] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.782922 17328 raft_consensus.cc:2804] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:42.783347 17328 raft_consensus.cc:493] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:42.783757 17328 raft_consensus.cc:3060] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:42.787240 17642 raft_consensus.cc:2804] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:42.787587 17642 raft_consensus.cc:493] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:42.787921 17642 raft_consensus.cc:3060] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:42.789134 13638 ts_tablet_manager.cc:1434] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.042s user 0.004s sys 0.010s
I20260810 13:54:42.790798 13640 tablet_bootstrap.cc:492] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:42.796268 13640 tablet_bootstrap.cc:654] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:42.788939 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 66579.8us
W20260810 13:54:42.797781 12952 leader_election.cc:343] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:42.798738 17640 consensus_queue.cc:1048] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260810 13:54:42.790037 13638 tablet_bootstrap.cc:492] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:42.809737 17656 raft_consensus.cc:493] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:42.814834 17656 raft_consensus.cc:515] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.822418 17656 leader_election.cc:290] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.827780 13638 tablet_bootstrap.cc:654] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.780457 17539 leader_election.cc:290] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.852964 17582 raft_consensus.cc:697] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:42.854085 17582 consensus_queue.cc:237] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.862629 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]). Expected version 2 got 0
I20260810 13:54:42.882345 13638 tablet_bootstrap.cc:492] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:42.882851 13638 ts_tablet_manager.cc:1403] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.093s user 0.004s sys 0.009s
I20260810 13:54:42.890246 13640 tablet_bootstrap.cc:492] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:42.890722 13640 ts_tablet_manager.cc:1403] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.100s user 0.022s sys 0.003s
I20260810 13:54:42.893579 13640 raft_consensus.cc:359] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.899773 13640 raft_consensus.cc:385] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.900076 13640 raft_consensus.cc:740] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:42.902725 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 129040us
I20260810 13:54:42.904090 12951 leader_election.cc:304] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:42.896006 13638 raft_consensus.cc:359] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.905445 13638 raft_consensus.cc:385] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.905440 12951 leader_election.cc:304] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:42.905767 13638 raft_consensus.cc:740] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.906286 17640 raft_consensus.cc:2804] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:42.906646 17640 raft_consensus.cc:493] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:42.906487 13638 consensus_queue.cc:260] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.907016 17640 raft_consensus.cc:3060] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:42.908457 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:42.908285 13640 consensus_queue.cc:260] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.912578 17539 raft_consensus.cc:2749] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:42.916018 17640 raft_consensus.cc:515] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.916883 13640 ts_tablet_manager.cc:1434] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.026s user 0.009s sys 0.000s
I20260810 13:54:42.917822 13640 tablet_bootstrap.cc:492] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:42.925925 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.641s (SENT)
I20260810 13:54:42.926393 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:42.926050 13638 ts_tablet_manager.cc:1434] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.043s user 0.004s sys 0.003s
I20260810 13:54:42.931936 13638 tablet_bootstrap.cc:492] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:42.941532 17667 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:42.958716 13638 tablet_bootstrap.cc:654] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.962478 13640 tablet_bootstrap.cc:654] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:42.919498 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:42.929021 13639 tablet_bootstrap.cc:654] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:42.943591 17328 raft_consensus.cc:515] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.992871 13640 tablet_bootstrap.cc:492] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:42.993265 13640 ts_tablet_manager.cc:1403] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.076s user 0.010s sys 0.001s
I20260810 13:54:42.994423 17328 leader_election.cc:290] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.995604 13640 raft_consensus.cc:359] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.950783 17642 raft_consensus.cc:515] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:42.996201 13640 raft_consensus.cc:385] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:42.996433 13640 raft_consensus.cc:740] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:42.997874 17642 leader_election.cc:290] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:42.954792 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 49284.2us
I20260810 13:54:43.000208 12951 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:42.967005 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 46077.5us
I20260810 13:54:43.003068 12952 leader_election.cc:304] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:43.003472 13638 tablet_bootstrap.cc:492] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:43.003885 13638 ts_tablet_manager.cc:1403] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.072s user 0.009s sys 0.001s
I20260810 13:54:43.003872 17328 raft_consensus.cc:2804] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:43.017967 13638 raft_consensus.cc:359] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.018690 13638 raft_consensus.cc:385] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.018954 13638 raft_consensus.cc:740] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.021361 13640 consensus_queue.cc:260] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.022112 12495 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]). Expected version 1 got 0
I20260810 13:54:43.025643 13639 tablet_bootstrap.cc:492] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:43.026268 13639 ts_tablet_manager.cc:1403] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.319s user 0.011s sys 0.007s
I20260810 13:54:43.031203 17655 raft_consensus.cc:493] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.031706 17655 raft_consensus.cc:515] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.034430 17655 leader_election.cc:290] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.034890 17655 raft_consensus.cc:493] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.035287 17655 raft_consensus.cc:515] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.038657 17655 leader_election.cc:290] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.043074 13252 raft_consensus.cc:1240] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:43.043249 17640 leader_election.cc:290] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.043430 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:43.044262 13245 raft_consensus.cc:1240] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:43.044605 13164 leader_election.cc:304] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.045410 13265 raft_consensus.cc:1240] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:43.047967 17655 raft_consensus.cc:2804] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:43.049261 17655 raft_consensus.cc:697] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:43.050618 17655 consensus_queue.cc:237] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.026631 13638 consensus_queue.cc:260] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.046181 13640 ts_tablet_manager.cc:1434] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.053s user 0.006s sys 0.000s
I20260810 13:54:43.056036 13164 leader_election.cc:304] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.060772 13640 tablet_bootstrap.cc:492] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:43.062075 17328 raft_consensus.cc:697] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:43.062228 17656 raft_consensus.cc:2804] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
W20260810 13:54:43.062929 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 58982.7us
I20260810 13:54:43.063068 17328 consensus_queue.cc:237] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.067123 13639 raft_consensus.cc:359] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.067793 13639 raft_consensus.cc:385] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.068075 13639 raft_consensus.cc:740] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.069726 13639 consensus_queue.cc:260] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.072449 13638 ts_tablet_manager.cc:1434] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.068s user 0.005s sys 0.003s
I20260810 13:54:43.073530 13639 ts_tablet_manager.cc:1434] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.047s user 0.005s sys 0.000s
I20260810 13:54:43.074424 13639 tablet_bootstrap.cc:492] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:43.090106 13638 tablet_bootstrap.cc:492] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:43.092883 17656 raft_consensus.cc:697] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:43.094178 17599 raft_consensus.cc:2749] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:43.095362 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 95262.1us
I20260810 13:54:43.095019 17656 consensus_queue.cc:237] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.101688 13164 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.103629 17646 raft_consensus.cc:493] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.104125 17646 raft_consensus.cc:515] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.106146 17646 leader_election.cc:290] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:43.107131 17582 raft_consensus.cc:2804] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:43.107614 17582 raft_consensus.cc:697] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:43.109997 17582 consensus_queue.cc:237] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:43.112030 13382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:43.126719 13638 tablet_bootstrap.cc:654] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.088627 13640 tablet_bootstrap.cc:654] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.130456 13164 leader_election.cc:304] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.131456 17655 raft_consensus.cc:2804] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:43.131795 17655 raft_consensus.cc:493] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:43.132236 17655 raft_consensus.cc:3060] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:43.135202 12951 leader_election.cc:304] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:43.136521 12951 consensus_peers.cc:597] T 9453eab70fa04df8b0c89e6caf54c894 P 88ed04d733ec447583fc897e233dd4b3 -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9453eab70fa04df8b0c89e6caf54c894. This is attempt 6: this message will repeat every 5th retry.
I20260810 13:54:43.137040 17640 raft_consensus.cc:2749] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.138317 12951 leader_election.cc:304] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.139889 13639 tablet_bootstrap.cc:654] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.141799 13164 leader_election.cc:304] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.141297 17656 raft_consensus.cc:493] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.144677 17690 raft_consensus.cc:2804] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:43.144515 17656 raft_consensus.cc:515] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.144527 13164 leader_election.cc:304] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.146265 17685 raft_consensus.cc:2804] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:43.146763 17685 raft_consensus.cc:697] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:43.145139 17690 raft_consensus.cc:697] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:43.147560 17685 consensus_queue.cc:237] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.153373 17683 raft_consensus.cc:493] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.153833 17683 raft_consensus.cc:515] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.156104 17683 leader_election.cc:290] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.148357 17656 leader_election.cc:290] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:42.971681 17524 raft_consensus.cc:515] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.165045 17690 consensus_queue.cc:237] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.171298 17655 raft_consensus.cc:515] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.177908 17524 leader_election.cc:290] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.190593 13640 tablet_bootstrap.cc:492] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:43.191010 13640 ts_tablet_manager.cc:1403] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.130s user 0.010s sys 0.000s
I20260810 13:54:43.199411 13638 tablet_bootstrap.cc:492] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:43.199870 13638 ts_tablet_manager.cc:1403] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.110s user 0.006s sys 0.003s
I20260810 13:54:43.202602 17655 leader_election.cc:290] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.204648 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:43.205404 13245 raft_consensus.cc:2393] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:43.207186 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a4341f5d274a9eb54cb030b47c9a91" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:43.207716 13252 raft_consensus.cc:3060] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:43.207863 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:43.210278 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:43.210574 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:43.211241 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:43.211908 13244 raft_consensus.cc:2393] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:43.212239 13640 raft_consensus.cc:359] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.212908 13640 raft_consensus.cc:385] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.213157 13640 raft_consensus.cc:740] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.213761 13640 consensus_queue.cc:260] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.215981 13640 ts_tablet_manager.cc:1434] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260810 13:54:43.217164 13638 raft_consensus.cc:359] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.217957 13638 raft_consensus.cc:385] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.218245 13638 raft_consensus.cc:740] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.220461 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
W20260810 13:54:43.228530 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:43.229014 17599 raft_consensus.cc:2749] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:43.230571 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 91201.3us
I20260810 13:54:43.246389 13639 tablet_bootstrap.cc:492] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:43.246326 12951 leader_election.cc:304] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.247511 17642 raft_consensus.cc:2749] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.255235 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b8030450554de3b97266f348329ea6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.255805 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:43.255940 13461 raft_consensus.cc:2468] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:43.256335 13456 raft_consensus.cc:3060] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:43.255304 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.257323 13449 raft_consensus.cc:2393] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:43.246814 13639 ts_tablet_manager.cc:1403] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.173s user 0.004s sys 0.006s
I20260810 13:54:43.263634 13640 tablet_bootstrap.cc:492] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:43.268477 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.269518 13462 raft_consensus.cc:2468] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:43.275347 13456 raft_consensus.cc:2468] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:43.280728 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:43.218880 13638 consensus_queue.cc:260] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.291004 13638 ts_tablet_manager.cc:1434] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.091s user 0.006s sys 0.000s
I20260810 13:54:43.218827 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b8030450554de3b97266f348329ea6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:43.292114 13245 raft_consensus.cc:3060] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:43.228169 13252 raft_consensus.cc:2468] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:43.295456 13638 tablet_bootstrap.cc:492] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:43.295691 17646 raft_consensus.cc:493] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.296249 17646 raft_consensus.cc:515] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.298545 17646 leader_election.cc:290] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:43.304457 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:43.240065 13244 raft_consensus.cc:1240] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:43.305105 13264 raft_consensus.cc:3060] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:43.309981 13638 tablet_bootstrap.cc:654] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:43.312530 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 69580.8us
I20260810 13:54:43.303685 13245 raft_consensus.cc:2468] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
W20260810 13:54:43.337239 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:43.338379 13264 raft_consensus.cc:2468] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:43.334671 12951 leader_election.cc:304] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.344503 17599 raft_consensus.cc:493] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.345120 17599 raft_consensus.cc:515] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.347258 13639 raft_consensus.cc:359] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.360975 13639 raft_consensus.cc:385] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.361884 13639 raft_consensus.cc:740] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.364383 13639 consensus_queue.cc:260] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.363353 17599 leader_election.cc:290] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.378582 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:43.378839 17655 raft_consensus.cc:493] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:43.379340 17655 raft_consensus.cc:515] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.380559 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:43.381361 17655 leader_election.cc:290] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.382222 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:43.388005 13343 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:43.389618 17524 raft_consensus.cc:493] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:43.390161 17524 raft_consensus.cc:515] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.392203 17524 leader_election.cc:290] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.392967 17579 raft_consensus.cc:2749] T 094a3448b54c409281c31813e60dcb7f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:43.393846 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 69026.2us
I20260810 13:54:43.396572 13638 tablet_bootstrap.cc:492] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:43.397023 13638 ts_tablet_manager.cc:1403] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.102s user 0.012s sys 0.009s
I20260810 13:54:43.397233 12951 leader_election.cc:304] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.398865 13639 ts_tablet_manager.cc:1434] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.138s user 0.005s sys 0.001s
I20260810 13:54:43.399389 13638 raft_consensus.cc:359] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.400002 13638 raft_consensus.cc:385] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.400250 13638 raft_consensus.cc:740] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.400943 13638 consensus_queue.cc:260] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.417415 13638 ts_tablet_manager.cc:1434] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.020s user 0.005s sys 0.001s
I20260810 13:54:43.421845 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:43.424870 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:43.424947 17579 raft_consensus.cc:2749] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.425369 13638 tablet_bootstrap.cc:492] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:43.427460 12951 leader_election.cc:304] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.428728 17579 raft_consensus.cc:2749] T f764e91bb2c94bc3be425b65323764cb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.442725 13638 tablet_bootstrap.cc:654] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.443276 13639 tablet_bootstrap.cc:492] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:43.445803 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:43.463498 13640 tablet_bootstrap.cc:700] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent opening tablet: real 0.126s user 0.000s sys 0.000s
I20260810 13:54:43.464258 13640 tablet_bootstrap.cc:654] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.467880 13639 tablet_bootstrap.cc:654] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.487290 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.488076 13638 tablet_bootstrap.cc:492] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:43.488507 13638 ts_tablet_manager.cc:1403] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.063s user 0.009s sys 0.000s
I20260810 13:54:43.489967 17717 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:43.490603 17717 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:43.491113 13638 raft_consensus.cc:359] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.491724 13638 raft_consensus.cc:385] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.491539 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.491998 13638 raft_consensus.cc:740] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.492172 13449 raft_consensus.cc:2468] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:43.494731 17717 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:43.498454 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:43.478456 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 144560us
W20260810 13:54:43.497699 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:43.504179 13638 consensus_queue.cc:260] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.506269 13638 ts_tablet_manager.cc:1434] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.017s user 0.000s sys 0.004s
I20260810 13:54:43.509449 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 824 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:43.508205 13638 tablet_bootstrap.cc:492] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:43.522816 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.523474 13461 raft_consensus.cc:2468] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:43.529284 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a4341f5d274a9eb54cb030b47c9a91" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.529898 13461 raft_consensus.cc:2468] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:43.530915 13638 tablet_bootstrap.cc:654] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.538741 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.539422 13461 raft_consensus.cc:2468] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:43.543227 12952 leader_election.cc:304] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:43.544122 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247fb8b09c12407d8535c07c5d0687fe" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.544806 13461 raft_consensus.cc:2468] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:43.549134 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:43.550084 13461 raft_consensus.cc:3060] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:43.560969 13638 tablet_bootstrap.cc:492] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:43.561414 13638 ts_tablet_manager.cc:1403] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.053s user 0.013s sys 0.006s
I20260810 13:54:43.563638 17712 raft_consensus.cc:2804] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:43.564226 17712 raft_consensus.cc:697] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:43.564280 13638 raft_consensus.cc:359] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.564962 13638 raft_consensus.cc:385] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.565222 13638 raft_consensus.cc:740] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.565726 17712 consensus_queue.cc:237] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.569993 13638 consensus_queue.cc:260] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.570808 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:43.572625 13638 ts_tablet_manager.cc:1434] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260810 13:54:43.579342 12951 leader_election.cc:304] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.580524 13638 tablet_bootstrap.cc:492] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:43.594797 12952 consensus_peers.cc:597] T 65c3b03d5f1543b28ea6c439c3cfb07e P 88ed04d733ec447583fc897e233dd4b3 -> Peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Couldn't send request to peer 218e946161f64d1d92427684ac15e4fb. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65c3b03d5f1543b28ea6c439c3cfb07e. This is attempt 11: this message will repeat every 5th retry.
I20260810 13:54:43.597259 17708 raft_consensus.cc:2749] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:43.598210 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:43.600411 12951 leader_election.cc:343] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:43.600911 12951 leader_election.cc:304] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.602551 17708 raft_consensus.cc:2749] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:43.605039 13639 tablet_bootstrap.cc:492] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:43.605535 13639 ts_tablet_manager.cc:1403] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.162s user 0.008s sys 0.004s
I20260810 13:54:43.611694 13461 raft_consensus.cc:2468] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:43.621531 12952 leader_election.cc:304] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:43.622364 17708 raft_consensus.cc:2804] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:43.622843 17708 raft_consensus.cc:697] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:43.623653 17708 consensus_queue.cc:237] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.645264 13638 tablet_bootstrap.cc:654] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:43.648262 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47897us
I20260810 13:54:43.650645 12952 leader_election.cc:304] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:43.651576 17710 raft_consensus.cc:2804] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:43.652067 17710 raft_consensus.cc:697] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:43.652874 17710 consensus_queue.cc:237] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.665313 12951 leader_election.cc:304] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.627009 13640 tablet_bootstrap.cc:492] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:43.676043 13640 ts_tablet_manager.cc:1403] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.418s user 0.012s sys 0.000s
W20260810 13:54:43.679483 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:43.683842 17582 raft_consensus.cc:493] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.684334 17582 raft_consensus.cc:515] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.686350 17582 leader_election.cc:290] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.689224 12951 leader_election.cc:304] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:43.667253 17728 log.cc:927] Time spent T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
I20260810 13:54:43.694964 13640 raft_consensus.cc:359] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.695736 13640 raft_consensus.cc:385] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.696056 13640 raft_consensus.cc:740] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.698266 13244 raft_consensus.cc:1240] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:43.699746 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:43.608469 13639 raft_consensus.cc:359] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.703598 13639 raft_consensus.cc:385] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.703912 13639 raft_consensus.cc:740] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.704520 13639 consensus_queue.cc:260] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.714908 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:43.716450 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350b68f6c1cf48ff8e5f8521e5a4dad6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:43.720783 13638 tablet_bootstrap.cc:492] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:43.721197 13638 ts_tablet_manager.cc:1403] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.141s user 0.009s sys 0.003s
I20260810 13:54:43.723522 13638 raft_consensus.cc:359] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.724123 13638 raft_consensus.cc:385] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.724356 13638 raft_consensus.cc:740] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.733891 17403 raft_consensus.cc:2749] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.734808 17403 raft_consensus.cc:2749] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.736383 17710 raft_consensus.cc:493] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.736927 17710 raft_consensus.cc:515] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:43.737577 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 48441.3us
I20260810 13:54:43.738420 12951 leader_election.cc:304] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.739143 17403 raft_consensus.cc:2749] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.746488 13252 raft_consensus.cc:1240] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:43.740554 17710 leader_election.cc:290] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.696748 13640 consensus_queue.cc:260] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.754740 13640 ts_tablet_manager.cc:1434] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.078s user 0.005s sys 0.000s
W20260810 13:54:43.758280 17735 log.cc:927] Time spent T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.085s user 0.001s sys 0.000s
I20260810 13:54:43.750137 13639 ts_tablet_manager.cc:1434] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.144s user 0.006s sys 0.000s
I20260810 13:54:43.760550 13639 tablet_bootstrap.cc:492] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:43.743248 17732 log.cc:927] Time spent T 00000000000000000000000000000000 P d9666026fb7e4c85b46c6aab952932fb: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20260810 13:54:43.768883 17403 raft_consensus.cc:493] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:43.769516 17403 raft_consensus.cc:515] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.771251 13164 leader_election.cc:304] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.771582 17403 leader_election.cc:290] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.772626 17712 raft_consensus.cc:493] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:43.773329 12951 leader_election.cc:304] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.773109 17712 raft_consensus.cc:515] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.775589 17712 leader_election.cc:290] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.785027 17646 raft_consensus.cc:493] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.785447 17646 raft_consensus.cc:515] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.787225 17646 leader_election.cc:290] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:43.789266 17582 raft_consensus.cc:2764] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:43.797345 13640 tablet_bootstrap.cc:492] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:43.801821 17599 raft_consensus.cc:2749] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.802311 12951 leader_election.cc:304] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.803025 17524 raft_consensus.cc:2749] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.802198 13638 consensus_queue.cc:260] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.804877 13638 ts_tablet_manager.cc:1434] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.083s user 0.005s sys 0.001s
I20260810 13:54:43.804823 12951 leader_election.cc:304] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.808925 17712 raft_consensus.cc:2749] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.812359 17712 consensus_queue.cc:1048] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:43.822567 13640 tablet_bootstrap.cc:654] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.824278 17403 consensus_queue.cc:1048] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:43.825511 12951 leader_election.cc:304] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.826342 13164 leader_election.cc:304] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.827158 17582 raft_consensus.cc:2764] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:43.828092 13164 leader_election.cc:304] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.829424 17712 raft_consensus.cc:2749] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.833178 12951 leader_election.cc:304] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.837965 13639 tablet_bootstrap.cc:654] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.839005 17582 raft_consensus.cc:2804] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:43.839473 17582 raft_consensus.cc:697] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:43.840265 17582 consensus_queue.cc:237] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.845175 17708 raft_consensus.cc:493] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:43.845757 17708 raft_consensus.cc:515] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.848016 17708 leader_election.cc:290] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.851752 12951 leader_election.cc:304] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:43.853168 17403 raft_consensus.cc:2749] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.853854 17403 raft_consensus.cc:2804] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:43.854167 17403 raft_consensus.cc:493] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:43.854490 17403 raft_consensus.cc:3060] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:43.857268 13638 tablet_bootstrap.cc:492] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:43.866160 13382 leader_election.cc:304] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.866941 17646 raft_consensus.cc:2804] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:43.867293 17646 raft_consensus.cc:493] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:43.867202 13382 leader_election.cc:304] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.867668 17646 raft_consensus.cc:3060] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:43.868157 12951 leader_election.cc:304] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.870510 12951 leader_election.cc:304] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.874233 17403 raft_consensus.cc:515] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.876540 17712 raft_consensus.cc:2749] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.876368 17646 raft_consensus.cc:515] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.877208 17712 raft_consensus.cc:2749] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.878818 17646 leader_election.cc:290] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:43.890322 12951 leader_election.cc:343] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: a17d73c65f544b7c8566fd874ee87a25
I20260810 13:54:43.890695 12951 leader_election.cc:304] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.895079 17712 raft_consensus.cc:2749] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.903788 12951 leader_election.cc:304] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.905786 17403 leader_election.cc:290] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.914705 17708 raft_consensus.cc:2749] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.916061 12951 leader_election.cc:304] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.917116 12951 leader_election.cc:304] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.934942 17708 raft_consensus.cc:2749] T a0bfa7b61a334886b0bc1583c7d7fee9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.935596 17708 raft_consensus.cc:2749] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:43.936277 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 80018.2us
I20260810 13:54:43.936419 17403 raft_consensus.cc:493] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.936836 17403 raft_consensus.cc:515] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.939304 17403 leader_election.cc:290] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:43.940080 13164 consensus_peers.cc:597] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 218e946161f64d1d92427684ac15e4fb -> Peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Couldn't send request to peer 6f30dc72e9364eed80645b57ac7f0cb6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 350b68f6c1cf48ff8e5f8521e5a4dad6. This is attempt 6: this message will repeat every 5th retry.
I20260810 13:54:43.940557 12951 leader_election.cc:304] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:43.898916 13552 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:43.907642 17744 raft_consensus.cc:2804] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:43.922441 13640 tablet_bootstrap.cc:492] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:43.953213 13640 ts_tablet_manager.cc:1403] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.156s user 0.022s sys 0.003s
I20260810 13:54:43.955744 13640 raft_consensus.cc:359] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.956409 13640 raft_consensus.cc:385] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.956665 13640 raft_consensus.cc:740] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:43.957265 17646 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:43.957513 13640 consensus_queue.cc:260] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.957793 17646 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.959234 13640 ts_tablet_manager.cc:1434] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20260810 13:54:43.959110 17708 raft_consensus.cc:2749] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.960180 13640 tablet_bootstrap.cc:492] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:43.970978 13638 tablet_bootstrap.cc:654] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:43.973419 17655 raft_consensus.cc:493] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.973877 17655 raft_consensus.cc:515] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.975744 17655 leader_election.cc:290] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.979266 13167 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:43.980288 17582 raft_consensus.cc:2749] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:43.985998 13164 leader_election.cc:304] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.990839 13639 tablet_bootstrap.cc:492] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:43.991271 13639 ts_tablet_manager.cc:1403] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.231s user 0.018s sys 0.000s
W20260810 13:54:43.992779 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:43.994853 13639 raft_consensus.cc:359] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.995474 13639 raft_consensus.cc:385] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:43.995718 13639 raft_consensus.cc:740] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:44.013375 17702 raft_consensus.cc:2804] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:44.013743 17702 raft_consensus.cc:493] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:44.014032 17702 raft_consensus.cc:3060] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:44.019426 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:44.024852 17702 raft_consensus.cc:515] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.027209 17702 leader_election.cc:290] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:43.996335 13639 consensus_queue.cc:260] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:43.983451 17646 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.028988 13639 ts_tablet_manager.cc:1434] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.037s user 0.006s sys 0.001s
I20260810 13:54:44.029928 13639 tablet_bootstrap.cc:492] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:43.988873 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 121728us
W20260810 13:54:44.033630 13382 leader_election.cc:343] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:44.034243 13382 leader_election.cc:304] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:44.035017 13382 leader_election.cc:304] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
W20260810 13:54:44.035293 13164 leader_election.cc:343] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:44.035986 13164 leader_election.cc:304] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:43.997227 17744 raft_consensus.cc:697] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:44.036566 17753 raft_consensus.cc:493] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:43.986163 13640 tablet_bootstrap.cc:654] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:44.037041 17753 raft_consensus.cc:515] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.037210 17744 consensus_queue.cc:237] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.040482 17753 leader_election.cc:290] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.041042 17753 raft_consensus.cc:2804] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:44.041904 17753 raft_consensus.cc:493] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:44.041522 17749 raft_consensus.cc:2804] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:44.042393 17749 raft_consensus.cc:493] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:44.042877 17749 raft_consensus.cc:3060] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:44.052167 13382 leader_election.cc:343] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:44.054381 17646 consensus_queue.cc:1059] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:44.055133 17646 raft_consensus.cc:3055] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:44.055557 17646 raft_consensus.cc:740] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:44.056299 17646 consensus_queue.cc:260] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.058269 17646 raft_consensus.cc:3060] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:44.056468 17655 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:44.062743 17655 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.065466 17655 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:44.066314 17655 raft_consensus.cc:2804] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:44.066708 17655 raft_consensus.cc:493] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:44.067119 17655 raft_consensus.cc:3060] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.076897 13640 tablet_bootstrap.cc:492] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:44.077418 13640 ts_tablet_manager.cc:1403] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.117s user 0.014s sys 0.000s
I20260810 13:54:44.077428 13164 leader_election.cc:304] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:44.078888 17582 raft_consensus.cc:2764] T 00a4341f5d274a9eb54cb030b47c9a91 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:44.079543 17753 raft_consensus.cc:3060] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.085115 17744 consensus_queue.cc:1059] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:44.080348 13640 raft_consensus.cc:359] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.086622 13640 raft_consensus.cc:385] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:44.086985 13640 raft_consensus.cc:740] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:44.090296 13640 consensus_queue.cc:260] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.092581 13640 ts_tablet_manager.cc:1434] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260810 13:54:44.093250 13164 leader_election.cc:304] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:44.094064 13164 leader_election.cc:304] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:44.095050 17702 raft_consensus.cc:2764] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:44.100466 13639 tablet_bootstrap.cc:654] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:44.086302 17744 consensus_queue.cc:1059] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:44.105074 13638 tablet_bootstrap.cc:492] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:44.105432 17758 raft_consensus.cc:3055] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:44.105551 13638 ts_tablet_manager.cc:1403] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.249s user 0.007s sys 0.004s
I20260810 13:54:44.105825 17758 raft_consensus.cc:740] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:44.106685 17758 consensus_queue.cc:260] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.108384 13638 raft_consensus.cc:359] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.109064 13638 raft_consensus.cc:385] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:44.109357 13638 raft_consensus.cc:740] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:44.110002 13638 consensus_queue.cc:260] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.121102 17758 raft_consensus.cc:3060] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:44.129424 13640 tablet_bootstrap.cc:492] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:44.135363 13640 tablet_bootstrap.cc:654] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:44.075050 17655 raft_consensus.cc:515] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.086985 17765 raft_consensus.cc:3055] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
W20260810 13:54:44.108824 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 51757us
W20260810 13:54:44.143287 13382 leader_election.cc:343] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:44.143851 17655 leader_election.cc:290] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:44.143944 13382 leader_election.cc:343] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:44.146255 17765 raft_consensus.cc:740] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:44.147078 17765 consensus_queue.cc:260] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.148202 17765 raft_consensus.cc:3060] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:44.151482 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:44.162418 17769 consensus_queue.cc:1059] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260810 13:54:44.163394 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 50989us
W20260810 13:54:44.176255 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 82249.3us
I20260810 13:54:44.179523 13638 ts_tablet_manager.cc:1434] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.074s user 0.006s sys 0.000s
W20260810 13:54:44.185757 12728 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet ef59f7013ab4489dadd9084d065533a8 (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ef59f7013ab4489dadd9084d065533a8 consensus state has no leader
I20260810 13:54:44.189016 17772 consensus_queue.cc:1059] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:44.199622 13639 tablet_bootstrap.cc:492] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:44.200143 13639 ts_tablet_manager.cc:1403] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.170s user 0.008s sys 0.003s
I20260810 13:54:44.180600 13638 tablet_bootstrap.cc:492] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:44.236037 13639 raft_consensus.cc:359] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.236265 17655 raft_consensus.cc:2804] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:44.236779 17655 raft_consensus.cc:493] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:44.236871 13639 raft_consensus.cc:385] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:44.237180 17655 raft_consensus.cc:3060] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.249244 17772 raft_consensus.cc:3055] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
W20260810 13:54:44.209784 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:44.249806 17772 raft_consensus.cc:740] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:44.154023 17749 raft_consensus.cc:515] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.251839 17772 consensus_queue.cc:260] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.239018 17712 raft_consensus.cc:493] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:44.262769 17712 raft_consensus.cc:515] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.221608 17753 raft_consensus.cc:515] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:44.226347 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 44193.2us
W20260810 13:54:44.264439 13382 leader_election.cc:343] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:44.264918 17712 leader_election.cc:290] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:44.242534 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:44.191705 17744 raft_consensus.cc:3055] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:44.239465 17708 raft_consensus.cc:493] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:44.239995 17403 raft_consensus.cc:493] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:44.266355 17403 raft_consensus.cc:515] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.268309 17403 leader_election.cc:290] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:44.269266 17708 raft_consensus.cc:515] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.271567 17708 leader_election.cc:290] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:44.272135 13639 raft_consensus.cc:740] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:44.280782 13639 consensus_queue.cc:260] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.282399 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d9e5103fe644f38d969c64182f7cbb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.282805 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.284439 13041 raft_consensus.cc:3060] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.284739 13037 raft_consensus.cc:2393] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:44.285316 13639 ts_tablet_manager.cc:1434] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.085s user 0.002s sys 0.003s
I20260810 13:54:44.283277 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.286808 13639 tablet_bootstrap.cc:492] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:44.289975 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.290573 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.291461 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.298069 13056 raft_consensus.cc:2468] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:44.298146 13041 raft_consensus.cc:2468] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:44.299844 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.300549 13037 raft_consensus.cc:2393] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:44.300482 13035 raft_consensus.cc:2468] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:44.300678 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.301436 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.301627 17744 raft_consensus.cc:740] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:44.302534 17744 consensus_queue.cc:260] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:44.303591 17744 raft_consensus.cc:3060] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:44.307585 13042 raft_consensus.cc:2468] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
W20260810 13:54:44.310925 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 119834us
I20260810 13:54:44.306208 17773 consensus_queue.cc:1059] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:44.313537 17770 raft_consensus.cc:493] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:44.314056 17770 raft_consensus.cc:515] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.315209 17753 leader_election.cc:290] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.316051 17770 leader_election.cc:290] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.319537 17773 raft_consensus.cc:3055] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:44.319865 17773 raft_consensus.cc:740] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:44.320662 17773 consensus_queue.cc:260] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.321795 17773 raft_consensus.cc:3060] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:44.262050 17772 raft_consensus.cc:3060] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:44.318472 13638 tablet_bootstrap.cc:654] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:44.336246 13164 leader_election.cc:304] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:44.340900 17582 raft_consensus.cc:2804] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:44.341405 17582 raft_consensus.cc:697] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:44.342516 17582 consensus_queue.cc:237] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.343636 13041 raft_consensus.cc:2468] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
W20260810 13:54:44.325932 13382 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.1:35237 timed out after 3.039s (SENT)
I20260810 13:54:44.348207 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.353468 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.354199 13245 raft_consensus.cc:2468] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:44.323592 17655 raft_consensus.cc:515] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.357134 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.358347 17655 leader_election.cc:290] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:44.358817 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b8030450554de3b97266f348329ea6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.360652 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.361454 13027 raft_consensus.cc:2393] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:44.336966 17749 leader_election.cc:290] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.370406 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.382229 13027 raft_consensus.cc:2468] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:44.383836 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.384733 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.385619 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.386955 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.387202 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.387634 13050 raft_consensus.cc:2393] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 2: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:44.389225 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:54:44.392117 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:44.392247 13639 tablet_bootstrap.cc:654] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:44.377069 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:44.378724 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.393292 13244 raft_consensus.cc:2393] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:44.394276 13245 raft_consensus.cc:3060] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.394719 13640 tablet_bootstrap.cc:492] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:44.395315 13640 ts_tablet_manager.cc:1403] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.266s user 0.009s sys 0.001s
W20260810 13:54:44.395460 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:44.401069 17655 raft_consensus.cc:493] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:44.403371 13640 raft_consensus.cc:359] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.404028 13640 raft_consensus.cc:385] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:44.404274 13640 raft_consensus.cc:740] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:44.405831 17773 raft_consensus.cc:493] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:44.406288 17773 raft_consensus.cc:515] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:44.411011 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 141303us
I20260810 13:54:44.414072 13382 leader_election.cc:304] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.414898 17749 raft_consensus.cc:2749] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:44.426955 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:44.409107 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.432791 13265 raft_consensus.cc:2468] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:44.433837 17655 raft_consensus.cc:515] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.440562 13382 leader_election.cc:304] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.441776 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.417181 13638 tablet_bootstrap.cc:492] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:44.451020 13638 ts_tablet_manager.cc:1403] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.271s user 0.012s sys 0.001s
I20260810 13:54:44.454154 13638 raft_consensus.cc:359] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.454973 13638 raft_consensus.cc:385] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:44.455269 13638 raft_consensus.cc:740] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:54:44.439899 17787 log.cc:927] Time spent T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20260810 13:54:44.464327 17773 leader_election.cc:290] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.471094 13640 consensus_queue.cc:260] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.474983 17749 raft_consensus.cc:2749] T a0bfa7b61a334886b0bc1583c7d7fee9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.479916 13382 leader_election.cc:304] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.480773 17749 raft_consensus.cc:2749] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.486235 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.487072 13056 raft_consensus.cc:2468] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
W20260810 13:54:44.492477 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 45978.4us
I20260810 13:54:44.494169 13640 ts_tablet_manager.cc:1434] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.099s user 0.001s sys 0.008s
I20260810 13:54:44.495221 13640 tablet_bootstrap.cc:492] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:44.497637 17655 leader_election.cc:290] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:44.498558 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b82b59b066c4240a387e7de48de9c70" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.517314 13382 leader_election.cc:304] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.519106 13382 leader_election.cc:304] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.519693 17773 raft_consensus.cc:2749] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.520375 13343 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:44.532830 17773 raft_consensus.cc:493] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:44.533898 17773 raft_consensus.cc:515] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.539031 17773 leader_election.cc:290] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.553037 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.553690 13056 raft_consensus.cc:2468] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:44.556674 13382 leader_election.cc:304] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.561239 17772 raft_consensus.cc:2749] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.562233 17772 raft_consensus.cc:2749] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.565191 13639 tablet_bootstrap.cc:492] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:44.565671 13639 ts_tablet_manager.cc:1403] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.279s user 0.008s sys 0.006s
I20260810 13:54:44.578857 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a4341f5d274a9eb54cb030b47c9a91" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.579173 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.580243 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.580569 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.581070 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.583403 13056 raft_consensus.cc:2468] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:44.585229 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.586033 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.587055 13382 leader_election.cc:304] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.587749 17772 raft_consensus.cc:2749] T 0be536894b164edfb4310ff521e2fb42 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.587927 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247fb8b09c12407d8535c07c5d0687fe" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.588634 13050 raft_consensus.cc:2393] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:44.588967 13382 leader_election.cc:304] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.589677 17772 raft_consensus.cc:2749] T bc5b9e218c1f4f4083acc59a651f0cb6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.589902 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.591418 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.592046 13042 raft_consensus.cc:2468] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:44.456063 13638 consensus_queue.cc:260] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.581938 13037 raft_consensus.cc:2393] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:44.597525 13639 raft_consensus.cc:359] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.598181 13639 raft_consensus.cc:385] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:44.598445 13639 raft_consensus.cc:740] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:44.599275 13639 consensus_queue.cc:260] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.601275 13639 ts_tablet_manager.cc:1434] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.035s user 0.006s sys 0.000s
I20260810 13:54:44.602049 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.472676 13245 raft_consensus.cc:2468] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:44.609771 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.611931 13265 raft_consensus.cc:2468] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:44.591063 13382 leader_election.cc:304] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.613485 17773 raft_consensus.cc:2749] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.614960 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247fb8b09c12407d8535c07c5d0687fe" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:44.615970 13245 raft_consensus.cc:2393] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:44.621301 13382 leader_election.cc:304] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.621989 17773 raft_consensus.cc:2749] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.627301 13382 leader_election.cc:304] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.628540 17773 raft_consensus.cc:2749] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.632287 13252 raft_consensus.cc:1240] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
W20260810 13:54:44.633119 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:44.633888 13245 raft_consensus.cc:1240] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:44.635591 13382 leader_election.cc:304] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.636615 13264 raft_consensus.cc:1240] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:44.636638 17772 raft_consensus.cc:2749] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 13:54:44.638283 13382 leader_election.cc:304] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.638944 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.643862 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.644240 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.644989 13041 raft_consensus.cc:3055] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:44.645143 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.645359 13041 raft_consensus.cc:740] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:44.645635 13056 raft_consensus.cc:2468] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:44.645030 13027 raft_consensus.cc:3060] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.646059 13041 consensus_queue.cc:260] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.646987 13041 raft_consensus.cc:3060] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:44.647060 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:44.648313 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.649003 13046 raft_consensus.cc:1275] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260810 13:54:44.651146 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247fb8b09c12407d8535c07c5d0687fe" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.652266 13026 raft_consensus.cc:2393] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:44.653683 13639 tablet_bootstrap.cc:492] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:44.654390 13638 ts_tablet_manager.cc:1434] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.203s user 0.007s sys 0.000s
I20260810 13:54:44.655509 13638 tablet_bootstrap.cc:492] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:44.656153 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.656793 13049 raft_consensus.cc:2468] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:44.657713 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.658659 13037 raft_consensus.cc:2376] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2. Re-sending same reply.
I20260810 13:54:44.660393 13042 raft_consensus.cc:1275] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:44.649011 13035 raft_consensus.cc:3060] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.667557 13041 raft_consensus.cc:1275] T a2a2e00edb244e54b04a511dd0e76c9f P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:44.607141 13640 tablet_bootstrap.cc:654] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:44.673993 13035 raft_consensus.cc:2468] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:44.678738 13243 raft_consensus.cc:1275] T 3066b475871c45fdbe585947fd6800c9 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260810 13:54:44.682410 17773 raft_consensus.cc:2749] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:44.684188 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 45966.8us
I20260810 13:54:44.687201 13382 leader_election.cc:304] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.694798 17773 raft_consensus.cc:2749] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.707283 17773 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:44.711272 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.711608 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.711915 13042 raft_consensus.cc:2468] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:44.712177 13043 raft_consensus.cc:2468] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:44.712896 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.708591 17773 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.713860 13041 raft_consensus.cc:1240] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:44.713977 13037 raft_consensus.cc:2393] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:44.717502 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.717549 17773 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.718178 13050 raft_consensus.cc:2468] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:44.715072 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.719249 13049 raft_consensus.cc:3060] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.719941 13382 leader_election.cc:304] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.728904 13049 raft_consensus.cc:2468] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:44.710569 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d9e5103fe644f38d969c64182f7cbb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.729604 13382 leader_election.cc:304] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.730027 13035 raft_consensus.cc:2376] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1. Re-sending same reply.
I20260810 13:54:44.730625 17772 raft_consensus.cc:2749] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.731463 17772 raft_consensus.cc:2749] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.695623 13027 raft_consensus.cc:2468] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:44.744288 13124 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:44.750712 13382 leader_election.cc:304] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:44.756767 17773 raft_consensus.cc:2804] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:44.757369 17773 raft_consensus.cc:493] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:44.757436 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.758153 13027 raft_consensus.cc:2393] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:44.758049 17773 raft_consensus.cc:3060] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.758929 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.759469 13035 raft_consensus.cc:2468] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:44.760254 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.762269 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.762910 13050 raft_consensus.cc:2468] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:44.772923 13640 tablet_bootstrap.cc:492] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:44.773430 13640 ts_tablet_manager.cc:1403] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.278s user 0.015s sys 0.002s
I20260810 13:54:44.773883 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.775010 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.768427 13382 leader_election.cc:304] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.782795 17772 raft_consensus.cc:2749] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:44.782859 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.617s (SENT)
I20260810 13:54:44.783390 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:44.784507 13382 leader_election.cc:304] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.781826 13640 raft_consensus.cc:359] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.790081 13640 raft_consensus.cc:385] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:44.790750 13640 raft_consensus.cc:740] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:44.791386 17772 raft_consensus.cc:2749] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.794903 13640 consensus_queue.cc:260] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.797957 13639 tablet_bootstrap.cc:654] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:44.819674 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.820353 13041 raft_consensus.cc:2468] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:44.792306 13382 leader_election.cc:304] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.824586 17772 raft_consensus.cc:2749] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.825892 13382 leader_election.cc:304] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.826767 17772 raft_consensus.cc:2749] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.828372 17772 consensus_queue.cc:1048] T 1a4fe8abad5649f2a42686c00148d957 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:44.830102 13382 leader_election.cc:304] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.830760 17772 raft_consensus.cc:2749] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.834873 17773 raft_consensus.cc:515] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.836764 17773 leader_election.cc:290] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.848038 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.848765 13041 raft_consensus.cc:2468] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:44.811193 17806 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:44.850932 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:44.851476 13041 raft_consensus.cc:3060] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.853107 13640 ts_tablet_manager.cc:1434] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.079s user 0.004s sys 0.002s
I20260810 13:54:44.854055 13640 tablet_bootstrap.cc:492] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:44.858193 13041 raft_consensus.cc:2468] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:44.869647 13382 leader_election.cc:304] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.870775 13382 leader_election.cc:304] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.871459 17772 raft_consensus.cc:2749] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.872100 17772 raft_consensus.cc:2749] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.884755 13382 leader_election.cc:304] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:44.863010 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.885692 13057 raft_consensus.cc:2393] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:44.885828 13382 leader_election.cc:304] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.863837 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:44.886456 17772 raft_consensus.cc:2804] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:44.886546 13035 raft_consensus.cc:2468] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:44.886783 17772 raft_consensus.cc:493] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:44.887099 17772 raft_consensus.cc:3060] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:44.895712 17772 raft_consensus.cc:515] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.896934 17773 raft_consensus.cc:2749] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.897531 13639 tablet_bootstrap.cc:492] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:44.897958 13639 ts_tablet_manager.cc:1403] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.245s user 0.012s sys 0.012s
I20260810 13:54:44.905709 17772 leader_election.cc:290] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:44.912746 13640 tablet_bootstrap.cc:654] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:44.900343 13639 raft_consensus.cc:359] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.917145 13639 raft_consensus.cc:385] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:44.917433 13639 raft_consensus.cc:740] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:44.918174 13382 leader_election.cc:304] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.918210 13639 consensus_queue.cc:260] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.920861 13639 ts_tablet_manager.cc:1434] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.023s user 0.007s sys 0.000s
I20260810 13:54:44.921738 13639 tablet_bootstrap.cc:492] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:44.936894 17772 raft_consensus.cc:2749] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.937733 13167 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:44.941079 13167 leader_election.cc:304] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.943238 13382 leader_election.cc:304] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.945015 13382 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.945844 17773 raft_consensus.cc:2749] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.946720 17773 raft_consensus.cc:2749] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.951623 13382 leader_election.cc:304] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.966876 13640 tablet_bootstrap.cc:492] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:44.970211 13640 ts_tablet_manager.cc:1403] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.116s user 0.009s sys 0.001s
I20260810 13:54:44.976089 17582 raft_consensus.cc:493] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:44.977150 17582 raft_consensus.cc:515] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:44.981977 13638 tablet_bootstrap.cc:654] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:44.982652 17655 raft_consensus.cc:2804] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:44.987622 17772 raft_consensus.cc:2749] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.989482 13382 leader_election.cc:304] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.990257 17749 raft_consensus.cc:2749] T dfbb2036c800469f90ad4d5d211ac462 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.992004 13382 leader_election.cc:304] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.992661 17772 raft_consensus.cc:2749] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:44.993793 13382 leader_election.cc:304] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:44.994388 17772 raft_consensus.cc:2749] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.001876 13640 raft_consensus.cc:359] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.002605 13640 raft_consensus.cc:385] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.002866 13640 raft_consensus.cc:740] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:45.003314 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:45.003480 13640 consensus_queue.cc:260] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:44.980290 13167 leader_election.cc:343] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 674599456f9a49dc98d8d089c166ca89
I20260810 13:54:45.020828 17781 raft_consensus.cc:493] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.021569 17582 leader_election.cc:290] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.021404 17781 raft_consensus.cc:515] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.022492 17811 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:45.023138 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:45.023097 17811 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.023648 17781 leader_election.cc:290] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.025606 17811 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:44.983341 17655 raft_consensus.cc:697] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:45.029791 17702 raft_consensus.cc:2749] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.030889 13382 leader_election.cc:304] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.031875 17749 raft_consensus.cc:2749] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.031905 17655 consensus_queue.cc:237] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.032495 13382 leader_election.cc:304] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.033341 17749 raft_consensus.cc:2749] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.034212 13640 ts_tablet_manager.cc:1434] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.064s user 0.005s sys 0.002s
W20260810 13:54:45.040021 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:45.043648 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 63436.9us
I20260810 13:54:45.046859 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]). Expected version 1 got 0
I20260810 13:54:45.046808 13167 leader_election.cc:304] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:45.047851 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]). Expected version 1 got 0
I20260810 13:54:45.047955 17702 raft_consensus.cc:2804] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:45.048641 17702 raft_consensus.cc:697] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:45.050310 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]). Expected version 1 got 0
I20260810 13:54:45.050968 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]). Expected version 1 got 0
I20260810 13:54:45.050248 17702 consensus_queue.cc:237] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.052984 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb]). Expected version 1 got 0
I20260810 13:54:45.053642 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]). Expected version 1 got 0
I20260810 13:54:45.054370 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]). Expected version 2 got 0
I20260810 13:54:45.055270 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]). Expected version 1 got 0
I20260810 13:54:45.057067 13640 tablet_bootstrap.cc:492] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:45.061695 12952 leader_election.cc:343] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Not found: Tablet not found: 1a4fe8abad5649f2a42686c00148d957
I20260810 13:54:45.062757 13640 tablet_bootstrap.cc:654] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.056147 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]). Expected version 1 got 0
I20260810 13:54:45.067117 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]). Expected version 1 got 0
I20260810 13:54:45.068037 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]). Expected version 2 got 0
I20260810 13:54:45.069023 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]). Expected version 1 got 0
I20260810 13:54:45.071429 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]). Expected version 2 got 0
I20260810 13:54:45.073419 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]). Expected version 1 got 0
I20260810 13:54:45.074301 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:45.075045 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]). Expected version 1 got 0
I20260810 13:54:45.075739 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:45.080236 17712 raft_consensus.cc:493] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.080732 17712 raft_consensus.cc:515] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.081038 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.081903 13461 raft_consensus.cc:2410] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260810 13:54:45.082120 13640 tablet_bootstrap.cc:492] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:45.082943 17712 leader_election.cc:290] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.083375 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.083863 13640 ts_tablet_manager.cc:1403] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.005s
I20260810 13:54:45.084076 13461 raft_consensus.cc:2393] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:45.086567 13640 raft_consensus.cc:359] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.087165 13640 raft_consensus.cc:385] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.087745 13640 raft_consensus.cc:740] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:45.088459 13640 consensus_queue.cc:260] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.076567 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:45.091310 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]). Expected version 1 got 0
I20260810 13:54:45.091998 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:45.092556 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]). Expected version 1 got 0
I20260810 13:54:45.093905 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]). Expected version 1 got 0
I20260810 13:54:45.094623 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]). Expected version 1 got 0
I20260810 13:54:45.095405 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]). Expected version 1 got 0
I20260810 13:54:45.097381 13640 ts_tablet_manager.cc:1434] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.013s user 0.003s sys 0.003s
I20260810 13:54:45.098409 13638 tablet_bootstrap.cc:492] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:45.098464 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]). Expected version 1 got 0
I20260810 13:54:45.098943 13638 ts_tablet_manager.cc:1403] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.444s user 0.012s sys 0.009s
I20260810 13:54:45.099715 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]). Expected version 1 got 0
I20260810 13:54:45.099633 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.100395 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]). Expected version 1 got 0
I20260810 13:54:45.101370 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]). Expected version 1 got 0
I20260810 13:54:45.103338 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]). Expected version 2 got 0
I20260810 13:54:45.104172 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]). Expected version 1 got 0
I20260810 13:54:45.104812 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:45.105327 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.105866 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]). Expected version 1 got 0
I20260810 13:54:45.106122 13461 raft_consensus.cc:2393] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:45.109704 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.110512 13461 raft_consensus.cc:2393] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:45.106932 12488 catalog_manager.cc:5719] T 4687f8fd44034ce28727c3b7e58e7fe9 P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:45.112387 13449 raft_consensus.cc:1240] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:45.111877 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]). Expected version 1 got 0
I20260810 13:54:45.053159 13167 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.113870 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.113991 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]). Expected version 1 got 0
I20260810 13:54:45.114406 13449 raft_consensus.cc:2468] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:45.114614 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]). Expected version 1 got 0
W20260810 13:54:45.114847 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 61893.3us
I20260810 13:54:45.115728 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b8030450554de3b97266f348329ea6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.116320 13449 raft_consensus.cc:2468] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:45.117564 13461 raft_consensus.cc:1275] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:45.116386 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]). Expected version 1 got 0
I20260810 13:54:45.117848 13167 leader_election.cc:304] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.118659 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]). Expected version 1 got 0
I20260810 13:54:45.119443 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet d36f17094e504d80a2443dc12855c744 (table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67]). Expected version 1 got 0
I20260810 13:54:45.120035 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]). Expected version 1 got 0
I20260810 13:54:45.120500 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.120776 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]). Expected version 1 got 0
I20260810 13:54:45.121366 13461 raft_consensus.cc:2393] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:45.122416 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]). Expected version 1 got 0
I20260810 13:54:45.123215 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]). Expected version 1 got 0
I20260810 13:54:45.126310 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]). Expected version 1 got 0
I20260810 13:54:45.126886 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]). Expected version 2 got 0
I20260810 13:54:45.127452 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]). Expected version 3 got 0
I20260810 13:54:45.128813 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]). Expected version 1 got 0
I20260810 13:54:45.131642 12952 leader_election.cc:304] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:45.132138 13640 tablet_bootstrap.cc:492] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:45.132488 17826 raft_consensus.cc:2804] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:45.132884 17826 raft_consensus.cc:493] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:45.133235 17826 raft_consensus.cc:3060] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.136778 13449 raft_consensus.cc:1275] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260810 13:54:45.137217 13449 pending_rounds.cc:85] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting all ops after (but not including) 1
I20260810 13:54:45.137498 13449 pending_rounds.cc:107] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting uncommitted ALTER_SCHEMA_OP operation due to leader change: 1.2
I20260810 13:54:45.137887 13640 tablet_bootstrap.cc:654] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:45.138237 13449 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Aborted: Op aborted by new leader
I20260810 13:54:45.138880 13449 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49514 (request call id 0) took 7566 ms. Trace:
I20260810 13:54:45.131196 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]). Expected version 1 got 0
I20260810 13:54:45.139261 13449 rpcz_store.cc:276] 0810 13:54:37.572433 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:37.572738 (+ 305us) service_pool.cc:224] Handling call
0810 13:54:45.138780 (+7566042us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0810 13:54:37.951235 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0810 13:54:37.963376 (+ 12141us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0810 13:54:37.963428 (+ 52us) alter_schema_op.cc:66] Acquired schema lock
0810 13:54:37.963504 (+ 76us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0810 13:54:37.963619 (+ 115us) alter_schema_op.cc:128] START. Timestamp: 1786370077963554
0810 13:54:37.963663 (+ 44us) op_driver.cc:348] REPLICATION: starting
0810 13:54:37.964472 (+ 809us) log.cc:844] Serialized 173 byte log entry
0810 13:54:38.509490 (+545018us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b180013c180. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb883d79c01 00007fb883d86581 00007fb87ae84d33 00007fb87ae87121 00007fb87ae870d9 00007fb87ae87069 00007fb87ae87031 00007fb87ae8632d 00000000005bd8c4 00000000005bd6f9 00007fb87ae681ea
0810 13:54:45.137996 (+6628506us) op_driver.cc:464] REPLICATION: finished
0810 13:54:45.138051 (+ 55us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
0810 13:54:45.138159 (+ 108us) alter_schema_op.cc:171] AlterSchemaCommitCallback: op aborted
Metrics: {"child_traces":[["op",{"prepare.queue_time_us":377194,"prepare.run_cpu_time_us":11847,"prepare.run_wall_time_us":272769,"replication_time_us":7174181,"spinlock_wait_cycles":4725120,"thread_start_us":445345,"threads_started":2,"wal-append.queue_time_us":519282,"wal-append.run_cpu_time_us":1426,"wal-append.run_wall_time_us":1026109}]]}
I20260810 13:54:45.141422 17826 raft_consensus.cc:515] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.143023 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]). Expected version 1 got 0
W20260810 13:54:45.143321 12471 catalog_manager.cc:5129] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): alter failed for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]): Aborted: Op aborted by new leader
I20260810 13:54:45.143649 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]). Expected version 1 got 0
I20260810 13:54:45.144265 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]). Expected version 1 got 0
I20260810 13:54:45.144287 17826 leader_election.cc:290] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.145267 13639 tablet_bootstrap.cc:654] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.145500 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]). Expected version 1 got 0
I20260810 13:54:45.146653 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]). Expected version 2 got 0
I20260810 13:54:45.147634 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]). Expected version 3 got 0
I20260810 13:54:45.153493 13640 tablet_bootstrap.cc:492] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:45.153909 13640 ts_tablet_manager.cc:1403] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.000s
I20260810 13:54:45.156507 13640 raft_consensus.cc:359] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.157217 13640 raft_consensus.cc:385] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.157478 13640 raft_consensus.cc:740] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:45.157976 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.158105 13640 consensus_queue.cc:260] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.158830 13461 raft_consensus.cc:2393] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:45.159250 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]). Expected version 1 got 0
I20260810 13:54:45.160063 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]). Expected version 2 got 0
I20260810 13:54:45.162127 12488 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]). Expected version 1 got 0
I20260810 13:54:45.162469 17814 raft_consensus.cc:2749] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.163252 17814 raft_consensus.cc:2749] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:45.166348 13640 ts_tablet_manager.cc:1434] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260810 13:54:45.167227 13640 tablet_bootstrap.cc:492] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:45.171283 17749 raft_consensus.cc:493] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.171778 17749 raft_consensus.cc:515] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.173923 17749 leader_election.cc:290] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:45.190074 13638 raft_consensus.cc:359] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.190858 13638 raft_consensus.cc:385] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.191175 13638 raft_consensus.cc:740] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:45.191027 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.191679 13480 raft_consensus.cc:3060] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.192035 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.193842 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a4341f5d274a9eb54cb030b47c9a91" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.194358 13464 raft_consensus.cc:3060] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.194845 13638 consensus_queue.cc:260] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.194491 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.196822 13454 raft_consensus.cc:1240] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:45.197033 13453 raft_consensus.cc:2393] T 288debea4aa045d1898483cde1d4d3b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:45.197974 13640 tablet_bootstrap.cc:654] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.204910 13457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.205056 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b8030450554de3b97266f348329ea6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.205395 13465 raft_consensus.cc:1275] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260810 13:54:45.205545 13476 raft_consensus.cc:3060] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.206120 13480 raft_consensus.cc:2468] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
W20260810 13:54:45.208814 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:45.213624 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b82b59b066c4240a387e7de48de9c70" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:45.214165 13426 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:45.215930 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.216665 13452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a4fe8abad5649f2a42686c00148d957" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:45.221516 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 103776us
I20260810 13:54:45.223709 13167 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.224481 17655 raft_consensus.cc:2749] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.225912 13465 raft_consensus.cc:1240] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:45.226042 13167 leader_election.cc:304] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.228852 13476 raft_consensus.cc:2468] T 75b8030450554de3b97266f348329ea6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:45.234975 17655 raft_consensus.cc:2749] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.242908 13638 ts_tablet_manager.cc:1434] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.144s user 0.007s sys 0.001s
I20260810 13:54:45.232213 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.232944 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247fb8b09c12407d8535c07c5d0687fe" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.246820 13480 raft_consensus.cc:3060] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.247337 13464 raft_consensus.cc:2468] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:45.243284 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.248447 13461 raft_consensus.cc:2468] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:45.254305 13480 raft_consensus.cc:2468] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:45.256320 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.257388 13465 raft_consensus.cc:1275] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260810 13:54:45.258188 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.266537 17838 tablet.cc:1724] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:45.269320 17835 tablet.cc:1724] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260810 13:54:45.279533 13167 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.280313 13639 tablet_bootstrap.cc:492] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:45.280841 13639 ts_tablet_manager.cc:1403] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.359s user 0.011s sys 0.003s
I20260810 13:54:45.280841 17702 raft_consensus.cc:2749] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.282078 13167 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.283538 13639 raft_consensus.cc:359] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.286500 13640 tablet_bootstrap.cc:492] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:45.286939 13640 ts_tablet_manager.cc:1403] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.120s user 0.015s sys 0.001s
W20260810 13:54:45.288213 13426 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:45.295292 13638 tablet_bootstrap.cc:492] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:45.308895 13640 raft_consensus.cc:359] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.309671 13640 raft_consensus.cc:385] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.309959 13640 raft_consensus.cc:740] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:45.310652 13640 consensus_queue.cc:260] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.312251 13640 ts_tablet_manager.cc:1434] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.025s user 0.004s sys 0.000s
I20260810 13:54:45.316947 13639 raft_consensus.cc:385] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.317322 13639 raft_consensus.cc:740] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:45.317998 13639 consensus_queue.cc:260] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.319989 13639 ts_tablet_manager.cc:1434] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.039s user 0.004s sys 0.001s
I20260810 13:54:45.324894 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.328020 13452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.328641 13452 raft_consensus.cc:2468] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:45.328830 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.329406 13465 raft_consensus.cc:3060] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.337080 13639 tablet_bootstrap.cc:492] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:45.348853 13639 tablet_bootstrap.cc:654] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.359862 17702 raft_consensus.cc:2749] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.363013 17749 raft_consensus.cc:493] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.363567 17749 raft_consensus.cc:515] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:45.372797 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 114850us
I20260810 13:54:45.374740 13454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.375378 13454 raft_consensus.cc:2468] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:45.374807 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.376370 13449 raft_consensus.cc:2468] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:45.377532 13640 tablet_bootstrap.cc:492] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:45.386297 17712 consensus_queue.cc:1059] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:45.387251 17712 consensus_queue.cc:1059] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:45.388242 17712 raft_consensus.cc:3055] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:45.388581 17712 raft_consensus.cc:740] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:45.389650 17712 consensus_queue.cc:260] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.390813 17712 raft_consensus.cc:3060] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:45.379621 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.387423 17708 raft_consensus.cc:3055] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:45.400854 17708 raft_consensus.cc:740] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:45.401618 17708 consensus_queue.cc:260] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.406389 17708 raft_consensus.cc:3060] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:45.409502 17814 raft_consensus.cc:493] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.410028 17814 raft_consensus.cc:515] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:45.413039 12951 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 97127.9us
I20260810 13:54:45.412557 17814 leader_election.cc:290] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:45.415253 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 133273us
I20260810 13:54:45.421933 17826 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:45.422382 17826 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.422607 13167 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.424273 17826 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.424803 17655 raft_consensus.cc:2749] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.429361 17814 raft_consensus.cc:493] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:45.430007 17814 raft_consensus.cc:515] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.432713 17814 leader_election.cc:290] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.442211 13639 tablet_bootstrap.cc:492] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:45.442656 13639 ts_tablet_manager.cc:1403] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.106s user 0.007s sys 0.006s
I20260810 13:54:45.445106 13639 raft_consensus.cc:359] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.445852 13639 raft_consensus.cc:385] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.446100 13639 raft_consensus.cc:740] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:45.446666 13639 consensus_queue.cc:260] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.448586 13639 ts_tablet_manager.cc:1434] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260810 13:54:45.397852 13449 raft_consensus.cc:2393] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:45.383100 13465 raft_consensus.cc:2468] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:45.459132 13464 raft_consensus.cc:1275] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260810 13:54:45.459456 13426 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:45.460259 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.460192 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.469708 17708 consensus_queue.cc:1048] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260810 13:54:45.455116 17749 leader_election.cc:290] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:45.479267 17655 raft_consensus.cc:493] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.481690 17655 raft_consensus.cc:515] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.482210 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247fb8b09c12407d8535c07c5d0687fe" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:45.482980 13465 raft_consensus.cc:2393] T 247fb8b09c12407d8535c07c5d0687fe P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:45.475674 17749 raft_consensus.cc:493] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.483707 17749 raft_consensus.cc:515] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.484141 17655 leader_election.cc:290] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.486765 13457 raft_consensus.cc:1275] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260810 13:54:45.473042 13461 raft_consensus.cc:2468] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:45.487419 13167 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.476367 13453 raft_consensus.cc:2393] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:45.488927 17702 raft_consensus.cc:2749] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.497478 17749 leader_election.cc:290] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:45.503161 13638 tablet_bootstrap.cc:654] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.503443 13457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.504175 13457 raft_consensus.cc:2393] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:45.511140 13457 raft_consensus.cc:1275] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:45.511381 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.512053 13476 raft_consensus.cc:2468] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:45.515055 17841 consensus_queue.cc:1048] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:45.515885 17851 raft_consensus.cc:493] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.516386 17851 raft_consensus.cc:515] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.518287 17851 leader_election.cc:290] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:45.517956 17841 consensus_queue.cc:1048] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:45.528889 17712 consensus_queue.cc:1048] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:45.529279 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:45.529865 13041 raft_consensus.cc:3060] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.533041 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.533624 13035 raft_consensus.cc:2468] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
W20260810 13:54:45.537822 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:45.542193 13041 raft_consensus.cc:2468] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:45.519717 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.543601 13476 raft_consensus.cc:2468] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:45.520784 13457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.544459 13457 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:45.522702 13464 raft_consensus.cc:1275] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:45.545426 13639 tablet_bootstrap.cc:492] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:45.545516 13167 leader_election.cc:304] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:45.549700 17814 raft_consensus.cc:2804] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:45.525244 17749 raft_consensus.cc:493] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.550168 17814 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:45.550398 17749 raft_consensus.cc:515] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.550736 17814 raft_consensus.cc:3060] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:45.552349 17749 leader_election.cc:290] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:45.554471 13639 tablet_bootstrap.cc:654] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.526472 13640 tablet_bootstrap.cc:654] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.527884 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:45.557796 13456 raft_consensus.cc:2468] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:45.537376 13480 raft_consensus.cc:1275] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:45.561494 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:45.562184 13041 raft_consensus.cc:2393] T 6406062bb0934eadae901502806178b5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:45.563037 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.564255 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.572233 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.574079 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:45.574553 13240 raft_consensus.cc:1275] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:45.599090 13638 tablet_bootstrap.cc:492] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:45.599612 13638 ts_tablet_manager.cc:1403] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.305s user 0.007s sys 0.007s
I20260810 13:54:45.599975 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.601128 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.602360 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.603626 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.604178 13041 raft_consensus.cc:2468] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 2.
I20260810 13:54:45.605195 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.605898 13057 raft_consensus.cc:2468] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:45.607059 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.619017 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:45.619728 13240 raft_consensus.cc:3060] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.626343 13639 tablet_bootstrap.cc:492] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:45.627004 13639 ts_tablet_manager.cc:1403] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.082s user 0.011s sys 0.002s
I20260810 13:54:45.627895 13240 raft_consensus.cc:2468] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:45.632854 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bf6a1f14bb4513b1addc4141b71373" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.633494 13035 raft_consensus.cc:2468] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:45.634362 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.634960 13027 raft_consensus.cc:2468] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:45.641819 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:45.642705 13265 raft_consensus.cc:2393] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
W20260810 13:54:45.649183 13426 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
W20260810 13:54:45.655483 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 107298us
I20260810 13:54:45.656527 12951 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:45.663239 13640 tablet_bootstrap.cc:492] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:45.663805 13640 ts_tablet_manager.cc:1403] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.287s user 0.009s sys 0.005s
I20260810 13:54:45.664919 13167 leader_election.cc:304] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:45.665639 17776 raft_consensus.cc:2749] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:45.666682 13167 leader_election.cc:343] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 674599456f9a49dc98d8d089c166ca89
I20260810 13:54:45.667615 13167 leader_election.cc:304] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:45.690428 17841 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:45.691023 17841 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.692899 17712 raft_consensus.cc:493] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.693384 17712 raft_consensus.cc:515] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.695371 17712 leader_election.cc:290] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.695868 17712 raft_consensus.cc:2749] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.697031 12951 leader_election.cc:304] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:45.698455 17826 raft_consensus.cc:2749] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:45.699990 12951 leader_election.cc:304] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:45.700786 17826 raft_consensus.cc:2749] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:45.701891 12951 leader_election.cc:304] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:45.703032 17841 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.703580 17826 raft_consensus.cc:2749] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:45.705545 12951 leader_election.cc:304] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:45.630158 13639 raft_consensus.cc:359] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.706570 13639 raft_consensus.cc:385] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.706911 13639 raft_consensus.cc:740] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:45.668361 13640 raft_consensus.cc:359] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.708909 17708 raft_consensus.cc:2804] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:45.709196 13640 raft_consensus.cc:385] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.709391 17708 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:45.709576 13640 raft_consensus.cc:740] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:45.709769 17708 raft_consensus.cc:3060] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.710606 13640 consensus_queue.cc:260] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.713140 13640 ts_tablet_manager.cc:1434] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.049s user 0.006s sys 0.000s
I20260810 13:54:45.725171 17814 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.727183 17814 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:45.727692 12729 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0be536894b164edfb4310ff521e2fb42 consensus state has no leader
I20260810 13:54:45.736763 13639 consensus_queue.cc:260] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.739382 13639 ts_tablet_manager.cc:1434] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.112s user 0.006s sys 0.000s
I20260810 13:54:45.773146 13640 tablet_bootstrap.cc:492] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:45.755851 17841 raft_consensus.cc:493] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.776974 17841 raft_consensus.cc:515] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.780475 17841 leader_election.cc:290] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.733029 17776 raft_consensus.cc:2764] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260810 13:54:45.779666 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 74192.2us
I20260810 13:54:45.803238 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:45.804638 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:45.806576 13057 raft_consensus.cc:2393] T d891e763a1854b6a8bda1071448fd8e0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
W20260810 13:54:45.811327 12954 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:45.815975 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c57ca566cfe47f6a331bbbe5c344a89" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:45.821791 17841 consensus_queue.cc:1048] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260810 13:54:45.733686 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 66164.3us
I20260810 13:54:45.749707 13638 raft_consensus.cc:359] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.751148 17702 raft_consensus.cc:493] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:45.826910 17702 raft_consensus.cc:515] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.828058 13638 raft_consensus.cc:385] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:45.828461 13638 raft_consensus.cc:740] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
W20260810 13:54:45.833009 12952 leader_election.cc:343] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:45.833988 17712 consensus_queue.cc:1048] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260810 13:54:45.834619 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:45.835441 13639 tablet_bootstrap.cc:492] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:45.836548 12952 leader_election.cc:304] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:45.837729 17712 raft_consensus.cc:2804] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:45.838157 17712 raft_consensus.cc:697] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:45.839215 13640 tablet_bootstrap.cc:654] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.838928 17712 consensus_queue.cc:237] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.842844 13639 tablet_bootstrap.cc:654] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.843082 17826 consensus_queue.cc:1048] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:45.849704 13638 consensus_queue.cc:260] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.850420 17702 leader_election.cc:290] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.859416 13167 leader_election.cc:304] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:45.860219 17702 raft_consensus.cc:2804] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:45.860559 17702 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:45.860901 17702 raft_consensus.cc:3060] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.861074 13638 ts_tablet_manager.cc:1434] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.261s user 0.008s sys 0.000s
I20260810 13:54:45.862080 13638 tablet_bootstrap.cc:492] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:45.872952 13167 consensus_peers.cc:597] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb -> Peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Couldn't send request to peer 88ed04d733ec447583fc897e233dd4b3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 674599456f9a49dc98d8d089c166ca89. This is attempt 1: this message will repeat every 5th retry.
I20260810 13:54:45.874402 17776 consensus_queue.cc:1048] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 13:54:45.875834 17776 consensus_queue.cc:1048] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:45.877718 17776 consensus_queue.cc:1048] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:45.879319 13167 leader_election.cc:304] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:45.901768 17702 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.903806 17702 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:45.904088 17708 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.907709 17814 raft_consensus.cc:2804] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:45.908126 17814 raft_consensus.cc:493] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:45.908476 17814 raft_consensus.cc:3060] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:45.925249 13426 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
W20260810 13:54:45.920835 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 71847.8us
W20260810 13:54:45.936218 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 114722us
I20260810 13:54:45.946759 13639 tablet_bootstrap.cc:492] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:45.947431 13639 ts_tablet_manager.cc:1403] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.112s user 0.012s sys 0.000s
I20260810 13:54:45.968852 13640 tablet_bootstrap.cc:492] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:45.969340 13640 ts_tablet_manager.cc:1403] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.196s user 0.010s sys 0.001s
I20260810 13:54:45.980484 17811 consensus_queue.cc:1048] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:45.982111 17811 consensus_queue.cc:1048] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:45.989300 13638 tablet_bootstrap.cc:654] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:45.991679 13167 leader_election.cc:304] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:45.992635 13167 leader_election.cc:304] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:45.993407 17811 raft_consensus.cc:2804] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:45.993893 17811 raft_consensus.cc:697] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:45.994037 17776 raft_consensus.cc:2804] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:45.994423 17776 raft_consensus.cc:493] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:45.994745 17776 raft_consensus.cc:3060] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:45.994823 17811 consensus_queue.cc:237] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.002894 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 65937.5us
W20260810 13:54:46.003633 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:46.003796 12951 leader_election.cc:304] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:45.906252 17708 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.005126 17712 raft_consensus.cc:2749] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260810 13:54:46.009883 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 69125.2us
I20260810 13:54:46.011360 13552 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:45.972445 13640 raft_consensus.cc:359] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.014355 13640 raft_consensus.cc:385] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:46.014710 13640 raft_consensus.cc:740] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:46.015556 13640 consensus_queue.cc:260] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.020012 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:46.022456 13640 ts_tablet_manager.cc:1434] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.053s user 0.007s sys 0.000s
I20260810 13:54:46.023540 13640 tablet_bootstrap.cc:492] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:46.026394 17776 raft_consensus.cc:515] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:45.982106 13639 raft_consensus.cc:359] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.033178 13639 raft_consensus.cc:385] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:46.033564 13639 raft_consensus.cc:740] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:46.034844 13639 consensus_queue.cc:260] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.040838 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.041082 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bf6a1f14bb4513b1addc4141b71373" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.041725 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.041911 13243 raft_consensus.cc:2468] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:46.043689 13264 raft_consensus.cc:1240] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:46.048225 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c57ca566cfe47f6a331bbbe5c344a89" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.049662 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.050313 13257 raft_consensus.cc:2393] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:46.053066 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.053831 13252 raft_consensus.cc:2393] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:46.057461 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.058115 13240 raft_consensus.cc:3060] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.028445 17776 leader_election.cc:290] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.066700 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.067414 13265 raft_consensus.cc:2468] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:46.069000 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.069849 13260 raft_consensus.cc:2393] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
W20260810 13:54:46.070747 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 60164.9us
I20260810 13:54:46.073596 13167 leader_election.cc:304] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:46.078526 17702 raft_consensus.cc:2804] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:46.080354 17702 raft_consensus.cc:697] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:46.081703 17702 consensus_queue.cc:237] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.089238 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 82807.2us
I20260810 13:54:46.092671 17814 raft_consensus.cc:515] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.094738 17814 leader_election.cc:290] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.096366 17826 consensus_queue.cc:1048] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:46.107168 17749 raft_consensus.cc:493] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:46.108383 17749 raft_consensus.cc:515] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.110500 17749 leader_election.cc:290] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:46.122920 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.124558 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.126257 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008d393fcdf441eb17dbe0c1fa2393f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.139120 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.140749 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.141475 13253 raft_consensus.cc:2393] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:46.142655 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330bcef6f234943b6b935b54aa3edfd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.146049 13640 tablet_bootstrap.cc:654] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:46.150076 13638 tablet_bootstrap.cc:492] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:46.150570 13638 ts_tablet_manager.cc:1403] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.289s user 0.012s sys 0.000s
I20260810 13:54:46.156982 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.157713 13265 raft_consensus.cc:2393] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:46.171743 13240 raft_consensus.cc:2468] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:46.192186 17898 raft_consensus.cc:493] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:46.192827 17898 raft_consensus.cc:515] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.195770 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 105754us
I20260810 13:54:46.197136 12951 leader_election.cc:304] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.199172 17898 leader_election.cc:290] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.209198 13639 ts_tablet_manager.cc:1434] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.261s user 0.009s sys 0.009s
I20260810 13:54:46.210264 17826 raft_consensus.cc:2749] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:46.212931 17910 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:46.218238 13638 raft_consensus.cc:359] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.218968 13638 raft_consensus.cc:385] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:46.211288 12951 leader_election.cc:304] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.219218 13638 raft_consensus.cc:740] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:46.219770 13638 consensus_queue.cc:260] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.220614 12951 leader_election.cc:343] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: 350b68f6c1cf48ff8e5f8521e5a4dad6
I20260810 13:54:46.221237 12951 leader_election.cc:304] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.221999 17826 raft_consensus.cc:2749] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:46.222653 17826 raft_consensus.cc:2749] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.224998 17910 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:46.227476 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008d393fcdf441eb17dbe0c1fa2393f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.228626 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 827 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:46.227837 17910 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:46.240885 13639 tablet_bootstrap.cc:492] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:46.231863 17899 raft_consensus.cc:493] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:46.255399 17899 raft_consensus.cc:515] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.256661 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:46.257675 17899 leader_election.cc:290] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:46.237313 17749 raft_consensus.cc:493] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:46.258376 17749 raft_consensus.cc:515] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.260346 17749 leader_election.cc:290] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.237744 17851 raft_consensus.cc:493] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:46.246598 13382 leader_election.cc:343] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:46.261348 17851 raft_consensus.cc:515] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:46.262105 13382 leader_election.cc:304] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:46.263316 17851 leader_election.cc:290] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.265874 17851 raft_consensus.cc:2804] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.266309 17851 raft_consensus.cc:493] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.266722 17851 raft_consensus.cc:3060] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.263229 13382 leader_election.cc:304] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:46.269129 17899 raft_consensus.cc:2804] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.269239 13382 leader_election.cc:304] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:46.269563 17899 raft_consensus.cc:493] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.270996 17899 raft_consensus.cc:3060] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.271934 17749 raft_consensus.cc:2804] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:46.277048 17914 consensus_queue.cc:1048] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:46.279534 13638 ts_tablet_manager.cc:1434] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.129s user 0.005s sys 0.000s
I20260810 13:54:46.280561 13638 tablet_bootstrap.cc:492] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:46.293329 17896 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:46.293920 17896 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.296792 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47535.2us
I20260810 13:54:46.308854 17914 raft_consensus.cc:493] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:46.309401 17914 raft_consensus.cc:515] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.310515 12951 leader_election.cc:304] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.318810 17914 leader_election.cc:290] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:46.322940 13638 tablet_bootstrap.cc:654] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:46.324853 17851 raft_consensus.cc:515] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.325984 17826 raft_consensus.cc:2749] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.311755 17896 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:46.332450 12952 leader_election.cc:343] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:46.333485 12952 leader_election.cc:343] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:46.363040 17826 consensus_queue.cc:1048] T b54b73458a4c4201bc3b44259bc12436 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260810 13:54:46.375242 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 46776.4us
I20260810 13:54:46.377902 12951 leader_election.cc:304] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.331283 17917 raft_consensus.cc:493] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:46.383909 17917 raft_consensus.cc:515] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.385730 17851 leader_election.cc:290] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.383360 13639 tablet_bootstrap.cc:654] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:46.391047 17883 raft_consensus.cc:2749] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:46.393181 12952 leader_election.cc:343] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:46.398079 17811 consensus_queue.cc:1048] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:46.399796 13164 leader_election.cc:304] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.336855 13382 leader_election.cc:304] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:46.398319 17841 raft_consensus.cc:493] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:46.400776 17811 raft_consensus.cc:2804] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:46.401163 17811 raft_consensus.cc:493] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:46.401532 17811 raft_consensus.cc:3060] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:46.401100 17841 raft_consensus.cc:515] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.358027 13640 tablet_bootstrap.cc:492] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:46.403640 17841 leader_election.cc:290] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.407634 17851 raft_consensus.cc:2804] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:46.400101 12951 leader_election.cc:304] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.332266 17749 raft_consensus.cc:697] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:46.386169 17917 leader_election.cc:290] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.412400 17749 consensus_queue.cc:237] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.407769 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 71003.9us
I20260810 13:54:46.414812 13382 leader_election.cc:304] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:46.415539 17917 raft_consensus.cc:2804] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.415930 17917 raft_consensus.cc:493] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.416293 17917 raft_consensus.cc:3060] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.419224 17896 raft_consensus.cc:2749] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.420972 12951 leader_election.cc:304] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.421355 13382 leader_election.cc:304] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.422185 17918 raft_consensus.cc:2749] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.421965 17851 raft_consensus.cc:697] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:46.423947 17811 raft_consensus.cc:515] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.425494 17702 consensus_queue.cc:1048] T 674599456f9a49dc98d8d089c166ca89 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:46.358273 17899 raft_consensus.cc:515] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.429559 13638 tablet_bootstrap.cc:492] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:46.429999 13638 ts_tablet_manager.cc:1403] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.150s user 0.011s sys 0.000s
I20260810 13:54:46.430828 17899 leader_election.cc:290] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.426192 17917 raft_consensus.cc:515] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.408226 13640 ts_tablet_manager.cc:1403] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.385s user 0.008s sys 0.006s
I20260810 13:54:46.437911 17851 consensus_queue.cc:237] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.445379 17702 consensus_queue.cc:1048] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:46.447631 13638 raft_consensus.cc:359] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.448453 13638 raft_consensus.cc:385] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:46.448808 13638 raft_consensus.cc:740] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:46.449682 13638 consensus_queue.cc:260] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.449874 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]). Expected version 2 got 0
I20260810 13:54:46.452625 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]). Expected version 1 got 0
I20260810 13:54:46.453219 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]). Expected version 1 got 0
I20260810 13:54:46.455483 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]). Expected version 1 got 0
I20260810 13:54:46.456224 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]). Expected version 1 got 0
I20260810 13:54:46.468890 17702 consensus_queue.cc:1048] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 13:54:46.474560 13639 tablet_bootstrap.cc:492] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:46.475169 13639 ts_tablet_manager.cc:1403] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.235s user 0.007s sys 0.005s
I20260810 13:54:46.477429 13638 ts_tablet_manager.cc:1434] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.047s user 0.007s sys 0.001s
I20260810 13:54:46.439450 13640 raft_consensus.cc:359] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.481796 13640 raft_consensus.cc:385] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:46.482111 13640 raft_consensus.cc:740] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:46.482795 13640 consensus_queue.cc:260] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.474423 13164 leader_election.cc:304] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.484134 17814 raft_consensus.cc:2749] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:46.441598 17917 leader_election.cc:290] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.427178 13382 leader_election.cc:304] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:54:46.462776 13426 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
W20260810 13:54:46.485270 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 58162.4us
I20260810 13:54:46.484752 17841 raft_consensus.cc:2749] T 1a4fe8abad5649f2a42686c00148d957 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.481463 17811 leader_election.cc:290] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:46.486660 13382 leader_election.cc:343] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:46.487119 13382 leader_election.cc:304] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.487547 17918 raft_consensus.cc:2804] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.488000 17918 raft_consensus.cc:493] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.488420 17918 raft_consensus.cc:3060] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.490235 17914 raft_consensus.cc:2749] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:46.491237 13382 leader_election.cc:343] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:46.491642 13382 leader_election.cc:304] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:46.488476 12471 catalog_manager.cc:5129] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): alter failed for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]): Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:46.493016 17897 raft_consensus.cc:2749] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:46.494136 13638 tablet_bootstrap.cc:492] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:46.495085 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 55340.5us
I20260810 13:54:46.497364 13640 ts_tablet_manager.cc:1434] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.060s user 0.005s sys 0.002s
W20260810 13:54:46.497395 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 57868.6us
I20260810 13:54:46.498505 13382 leader_election.cc:304] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:46.499411 17897 raft_consensus.cc:2804] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.499800 17897 raft_consensus.cc:493] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.500138 17897 raft_consensus.cc:3060] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.500510 13382 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.501365 17917 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:46.510239 13382 leader_election.cc:304] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:46.511173 17899 raft_consensus.cc:2804] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.511106 17814 consensus_queue.cc:1048] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:46.511248 13382 leader_election.cc:304] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:46.512408 17914 raft_consensus.cc:2804] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:46.512897 17914 raft_consensus.cc:697] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:46.511615 17899 raft_consensus.cc:493] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.514022 17899 raft_consensus.cc:3060] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.513746 17914 consensus_queue.cc:237] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.516579 13164 leader_election.cc:304] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:46.517361 17814 raft_consensus.cc:2804] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.517769 17814 raft_consensus.cc:493] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.518677 17814 raft_consensus.cc:3060] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:46.519920 17924 log.cc:927] Time spent T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.072s user 0.001s sys 0.000s
I20260810 13:54:46.526469 17712 consensus_queue.cc:1059] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:46.527679 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb]). Expected version 1 got 0
I20260810 13:54:46.528151 17898 consensus_queue.cc:1048] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:46.528369 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]). Expected version 1 got 0
I20260810 13:54:46.529105 17712 raft_consensus.cc:3055] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:46.529333 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]). Expected version 2 got 0
I20260810 13:54:46.529500 17712 raft_consensus.cc:740] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:46.530042 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]). Expected version 1 got 0
I20260810 13:54:46.531348 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]). Expected version 1 got 0
I20260810 13:54:46.530928 17712 consensus_queue.cc:260] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.532400 17712 raft_consensus.cc:3060] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:46.534624 17917 raft_consensus.cc:2749] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.538189 17897 raft_consensus.cc:515] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.540675 12476 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7ffb0f96e744a4bb734aba7f3d82995 consensus state has no leader
I20260810 13:54:46.557168 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.558034 13240 raft_consensus.cc:2393] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:46.545125 13382 leader_election.cc:304] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.563612 13382 leader_election.cc:304] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.564317 17914 raft_consensus.cc:2749] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.564994 17914 raft_consensus.cc:2749] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.566088 13382 leader_election.cc:304] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.540616 17897 leader_election.cc:290] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.548233 17918 raft_consensus.cc:515] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.574983 13639 raft_consensus.cc:359] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.575718 13639 raft_consensus.cc:385] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:46.576047 13639 raft_consensus.cc:740] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:46.576720 13639 consensus_queue.cc:260] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.579306 13639 ts_tablet_manager.cc:1434] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.104s user 0.007s sys 0.003s
I20260810 13:54:46.579782 17914 raft_consensus.cc:2749] T 6d2d209f801b4aa0aff3137a51fc7556 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.580973 13382 leader_election.cc:304] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.581700 17917 raft_consensus.cc:2749] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.581955 12951 leader_election.cc:304] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.582820 13382 leader_election.cc:304] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.582958 17841 raft_consensus.cc:2749] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.583529 17917 raft_consensus.cc:2749] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.584643 13382 leader_election.cc:304] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.586700 12951 leader_election.cc:304] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:46.587774 17899 raft_consensus.cc:515] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.590293 17899 leader_election.cc:290] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.593142 17814 raft_consensus.cc:515] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.590862 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]). Expected version 2 got 0
I20260810 13:54:46.574034 17918 leader_election.cc:290] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:46.602811 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:46.603267 12951 leader_election.cc:304] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.603477 17712 raft_consensus.cc:2804] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:46.604127 17841 raft_consensus.cc:2749] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.604903 17712 raft_consensus.cc:697] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:46.606211 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]). Expected version 1 got 0
I20260810 13:54:46.607249 17712 consensus_queue.cc:237] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.608984 17917 raft_consensus.cc:2749] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.610265 13382 leader_election.cc:304] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:46.614619 17897 raft_consensus.cc:2804] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:46.615054 17897 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:46.615491 17897 raft_consensus.cc:3060] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:46.621301 13382 leader_election.cc:304] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:46.623585 17917 raft_consensus.cc:2804] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.623966 17917 raft_consensus.cc:493] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.624277 17917 raft_consensus.cc:3060] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.625437 17841 consensus_queue.cc:1048] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 13:54:46.624735 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.626039 13638 tablet_bootstrap.cc:654] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:46.631059 13640 tablet_bootstrap.cc:492] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:46.630334 13240 raft_consensus.cc:2468] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:46.632056 17917 raft_consensus.cc:515] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.634387 17917 leader_election.cc:290] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.635808 13244 raft_consensus.cc:1240] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:46.644279 17814 leader_election.cc:290] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.645071 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]). Expected version 1 got 0
I20260810 13:54:46.647248 13639 tablet_bootstrap.cc:492] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:46.627290 12951 leader_election.cc:304] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.655135 17841 raft_consensus.cc:2749] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.659703 17841 consensus_queue.cc:1048] T 00a4341f5d274a9eb54cb030b47c9a91 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:46.661168 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:46.661971 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]). Expected version 1 got 0
I20260810 13:54:46.662763 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:46.663260 13638 tablet_bootstrap.cc:492] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:46.663511 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:46.663530 12951 leader_election.cc:304] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:46.664340 13638 ts_tablet_manager.cc:1403] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.170s user 0.005s sys 0.010s
I20260810 13:54:46.664273 17841 raft_consensus.cc:2749] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.664376 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:46.667219 13638 raft_consensus.cc:359] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.660537 13639 tablet_bootstrap.cc:654] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:46.686755 13638 raft_consensus.cc:385] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:46.689097 13638 raft_consensus.cc:740] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:46.692939 13638 consensus_queue.cc:260] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.693671 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]). Expected version 1 got 0
I20260810 13:54:46.694871 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]). Expected version 1 got 0
I20260810 13:54:46.695719 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]). Expected version 1 got 0
I20260810 13:54:46.696391 12952 leader_election.cc:304] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:46.635397 13382 leader_election.cc:304] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:46.638239 13640 tablet_bootstrap.cc:654] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:46.697690 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 62353.3us
I20260810 13:54:46.698577 13382 leader_election.cc:304] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:46.699160 17814 raft_consensus.cc:493] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:46.699645 13382 leader_election.cc:304] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:46.699728 17814 raft_consensus.cc:515] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.700486 17914 raft_consensus.cc:2749] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:46.701556 17914 raft_consensus.cc:2804] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.702044 17914 raft_consensus.cc:493] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.702665 17914 raft_consensus.cc:3060] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.702896 17814 leader_election.cc:290] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.705873 17903 raft_consensus.cc:2804] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.706511 17903 raft_consensus.cc:493] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.706923 17903 raft_consensus.cc:3060] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.707259 17898 consensus_queue.cc:1059] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:46.709928 17826 raft_consensus.cc:3055] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:46.710402 17826 raft_consensus.cc:740] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:46.711529 17826 consensus_queue.cc:260] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.713433 17826 raft_consensus.cc:3060] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:46.716965 17918 raft_consensus.cc:2804] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.717483 17918 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.717932 17918 raft_consensus.cc:3060] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.654093 17899 raft_consensus.cc:493] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:46.724440 17899 raft_consensus.cc:515] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.704639 13638 ts_tablet_manager.cc:1434] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.040s user 0.005s sys 0.001s
I20260810 13:54:46.727393 17851 consensus_queue.cc:1048] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:46.727773 17814 raft_consensus.cc:493] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:46.728453 17814 raft_consensus.cc:515] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.734400 17899 leader_election.cc:290] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:46.737213 13382 leader_election.cc:343] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:46.738498 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:46.739360 13462 raft_consensus.cc:2468] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:46.742048 17814 leader_election.cc:290] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.743014 17914 raft_consensus.cc:515] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.680274 17897 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.750590 17897 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.752341 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]). Expected version 1 got 0
I20260810 13:54:46.753075 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]). Expected version 1 got 0
I20260810 13:54:46.753945 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]). Expected version 1 got 0
I20260810 13:54:46.755221 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]). Expected version 1 got 0
W20260810 13:54:46.755719 12717 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 3db559714d84493ebaf7d3b51719d81c (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3db559714d84493ebaf7d3b51719d81c consensus state has no leader
I20260810 13:54:46.750566 17811 raft_consensus.cc:493] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:46.758711 17811 raft_consensus.cc:515] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:46.760855 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 70141.9us
I20260810 13:54:46.761518 12951 leader_election.cc:304] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:46.761662 17811 leader_election.cc:290] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.763128 17896 raft_consensus.cc:2804] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:46.763844 17896 raft_consensus.cc:493] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:46.764572 17896 raft_consensus.cc:3060] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.765522 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:46.766165 13480 raft_consensus.cc:2468] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:46.767655 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:46.768285 13480 raft_consensus.cc:2468] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:46.769784 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330bcef6f234943b6b935b54aa3edfd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:46.770493 13480 raft_consensus.cc:2468] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:46.773465 13639 tablet_bootstrap.cc:492] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:46.785231 13638 tablet_bootstrap.cc:492] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:46.785974 13639 ts_tablet_manager.cc:1403] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.139s user 0.013s sys 0.000s
I20260810 13:54:46.791113 13640 tablet_bootstrap.cc:492] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:46.763635 17712 consensus_queue.cc:1048] T 75b8030450554de3b97266f348329ea6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:46.791677 13640 ts_tablet_manager.cc:1403] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.161s user 0.011s sys 0.003s
I20260810 13:54:46.794478 17914 leader_election.cc:290] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.794816 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330bcef6f234943b6b935b54aa3edfd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.795774 17883 consensus_queue.cc:1048] T 9c4ff1185d2848808cbd92760e595830 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:46.797298 17881 consensus_queue.cc:1048] T a43ea90fc236424489a4981c32087d81 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:46.756489 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]). Expected version 1 got 0
I20260810 13:54:46.804527 13640 raft_consensus.cc:359] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.794150 17918 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.805450 13640 raft_consensus.cc:385] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:46.805722 13640 raft_consensus.cc:740] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:46.807602 17918 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.813197 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]). Expected version 2 got 0
I20260810 13:54:46.823298 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.776106 17903 raft_consensus.cc:515] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.831192 17903 leader_election.cc:290] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.837652 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]). Expected version 1 got 0
I20260810 13:54:46.837940 13639 raft_consensus.cc:359] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.838864 13639 raft_consensus.cc:385] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:46.838994 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]). Expected version 1 got 0
I20260810 13:54:46.839196 13639 raft_consensus.cc:740] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:46.840150 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]). Expected version 1 got 0
I20260810 13:54:46.850636 17896 raft_consensus.cc:515] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.853863 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fde417598648968b4013c54f0bc854" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.854771 13640 consensus_queue.cc:260] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.855386 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.857614 13640 ts_tablet_manager.cc:1434] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.066s user 0.005s sys 0.004s
I20260810 13:54:46.857580 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.858542 13640 tablet_bootstrap.cc:492] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:46.859447 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.865777 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]). Expected version 1 got 0
I20260810 13:54:46.866571 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d36f17094e504d80a2443dc12855c744 (table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67]). Expected version 1 got 0
I20260810 13:54:46.867101 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]). Expected version 1 got 0
W20260810 13:54:46.867733 15130 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.638s (SENT) [suppressed 2 similar messages]
I20260810 13:54:46.867895 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]). Expected version 1 got 0
I20260810 13:54:46.871877 17918 raft_consensus.cc:493] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:46.872653 17918 raft_consensus.cc:515] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.875880 17918 leader_election.cc:290] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.877861 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.878629 13244 raft_consensus.cc:3060] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.840067 13639 consensus_queue.cc:260] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.887665 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.893838 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.894469 13260 raft_consensus.cc:3060] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.868405 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]). Expected version 1 got 0
I20260810 13:54:46.899792 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]). Expected version 1 got 0
I20260810 13:54:46.900437 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]). Expected version 1 got 0
I20260810 13:54:46.901387 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]). Expected version 1 got 0
I20260810 13:54:46.902185 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]). Expected version 1 got 0
I20260810 13:54:46.904938 13260 raft_consensus.cc:2468] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:46.905966 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.907836 13240 raft_consensus.cc:2393] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:46.910158 13638 tablet_bootstrap.cc:654] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:46.915091 13639 ts_tablet_manager.cc:1434] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.128s user 0.004s sys 0.003s
I20260810 13:54:46.915702 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.916160 13639 tablet_bootstrap.cc:492] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:46.916837 13253 raft_consensus.cc:2393] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:46.917745 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:46.918278 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:46.918999 13456 raft_consensus.cc:2393] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:46.920970 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:46.923511 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.924813 13253 raft_consensus.cc:3060] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.925452 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:46.927336 17903 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:46.928418 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:46.928864 17826 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:46.929708 13456 raft_consensus.cc:2393] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:46.929608 17826 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:46.936008 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:46.938637 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:46.939772 13456 raft_consensus.cc:2393] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:46.942816 13456 raft_consensus.cc:3060] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:46.928222 17903 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:46.951961 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]). Expected version 1 got 0
I20260810 13:54:46.941672 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.958948 13240 raft_consensus.cc:3060] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.961943 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:46.962606 13037 raft_consensus.cc:2468] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:46.963052 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:46.963744 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:46.964344 13027 raft_consensus.cc:2393] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:46.977421 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]). Expected version 1 got 0
I20260810 13:54:46.978076 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]). Expected version 2 got 0
I20260810 13:54:46.978122 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.978824 13260 raft_consensus.cc:3060] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:46.978874 17826 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:46.979416 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]). Expected version 3 got 0
I20260810 13:54:46.980111 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]). Expected version 1 got 0
I20260810 13:54:46.981974 17903 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.982004 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:46.982774 13265 raft_consensus.cc:2393] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:46.983291 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:46.983870 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]). Expected version 1 got 0
I20260810 13:54:46.984673 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:46.985360 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]). Expected version 1 got 0
I20260810 13:54:46.987283 17896 leader_election.cc:290] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:46.989848 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:46.990639 13027 raft_consensus.cc:2468] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:46.994418 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:46.997478 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:46.986675 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]). Expected version 3 got 0
I20260810 13:54:46.998051 13027 raft_consensus.cc:2468] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:46.998682 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]). Expected version 1 got 0
I20260810 13:54:47.000452 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.000998 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.001734 13035 raft_consensus.cc:2393] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:47.026005 13164 leader_election.cc:304] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:47.035514 13253 raft_consensus.cc:2468] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:47.029098 17897 raft_consensus.cc:493] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:47.041064 17897 raft_consensus.cc:515] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.042833 17897 leader_election.cc:290] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:47.052069 13454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:47.052853 13454 raft_consensus.cc:2393] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:47.056794 13457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:47.057515 13457 raft_consensus.cc:3060] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:47.042007 17814 raft_consensus.cc:2804] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:47.060976 17814 raft_consensus.cc:493] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:47.061367 17814 raft_consensus.cc:3060] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.044095 13164 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:47.062804 17702 raft_consensus.cc:2804] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:47.063217 17702 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:47.063628 17702 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:47.065256 17811 consensus_queue.cc:1048] T 587b591fb88a447b9bd5e071fa8c37e1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:47.066514 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:47.067160 13476 raft_consensus.cc:2468] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:47.068591 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:47.069382 13465 raft_consensus.cc:2393] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:47.074903 13640 tablet_bootstrap.cc:654] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:47.076028 13382 leader_election.cc:343] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:47.085490 13382 leader_election.cc:304] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.057113 13244 raft_consensus.cc:2468] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:47.076887 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:47.090173 13164 leader_election.cc:304] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:47.090948 17811 raft_consensus.cc:2764] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:47.092000 17811 consensus_queue.cc:1048] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:47.099495 13124 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:47.101986 13638 tablet_bootstrap.cc:492] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:47.102456 13638 ts_tablet_manager.cc:1403] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.317s user 0.011s sys 0.004s
W20260810 13:54:47.103627 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:47.127542 13382 leader_election.cc:304] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.128422 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]). Expected version 1 got 0
I20260810 13:54:47.129048 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]). Expected version 1 got 0
I20260810 13:54:47.129560 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]). Expected version 1 got 0
W20260810 13:54:47.131399 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:47.139326 17918 consensus_queue.cc:1059] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260810 13:54:47.143275 17814 raft_consensus.cc:515] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.148761 17814 leader_election.cc:290] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.131032 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]). Expected version 1 got 0
I20260810 13:54:47.150669 17702 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.155128 17702 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.157311 13456 raft_consensus.cc:1275] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:47.159169 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]). Expected version 2 got 0
I20260810 13:54:47.160861 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.161177 17918 raft_consensus.cc:3055] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:47.161561 17918 raft_consensus.cc:740] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:47.162070 13057 raft_consensus.cc:2393] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:47.162422 17918 consensus_queue.cc:260] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.163797 17918 raft_consensus.cc:3060] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:47.108747 17897 raft_consensus.cc:2749] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:47.165333 17851 raft_consensus.cc:2749] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:47.165652 13638 raft_consensus.cc:359] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.166380 13638 raft_consensus.cc:385] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:47.166572 13037 raft_consensus.cc:1275] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:47.166647 13638 raft_consensus.cc:740] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:47.167217 13638 consensus_queue.cc:260] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.169271 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.170113 13050 raft_consensus.cc:2393] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
W20260810 13:54:47.172657 13382 leader_election.cc:343] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:47.174355 13382 leader_election.cc:304] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.179311 13382 leader_election.cc:304] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.188061 17914 raft_consensus.cc:2749] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:47.177256 17934 raft_consensus.cc:2749] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:47.197021 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.197665 13026 raft_consensus.cc:3060] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.207177 13056 raft_consensus.cc:1275] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:47.214015 13639 tablet_bootstrap.cc:654] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:47.214531 13382 leader_election.cc:343] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:47.215577 13382 leader_election.cc:343] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:47.217020 13382 leader_election.cc:343] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:47.200469 13457 raft_consensus.cc:2468] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:47.231192 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.231765 13025 raft_consensus.cc:1275] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:47.233103 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.233949 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.234544 13043 raft_consensus.cc:3060] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.234982 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]). Expected version 2 got 0
I20260810 13:54:47.238860 13260 raft_consensus.cc:2468] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:47.234081 13025 raft_consensus.cc:2393] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:47.243094 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.243340 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.243867 13042 raft_consensus.cc:2393] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:47.243978 13050 raft_consensus.cc:2468] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:47.247999 13240 raft_consensus.cc:2468] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:47.248932 13640 tablet_bootstrap.cc:492] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:47.249591 13640 ts_tablet_manager.cc:1403] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.391s user 0.015s sys 0.004s
I20260810 13:54:47.257334 17917 consensus_queue.cc:1048] T fd22f04344954142922942fc4b7cb157 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:54:47.259809 13382 leader_election.cc:343] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:47.260939 13382 leader_election.cc:343] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:47.262183 13382 leader_election.cc:304] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:47.263011 17934 raft_consensus.cc:2804] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:47.263494 17934 raft_consensus.cc:697] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:47.264355 17934 consensus_queue.cc:237] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.269049 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.269871 12494 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]). Expected version 1 got 0
I20260810 13:54:47.270687 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.284365 13640 raft_consensus.cc:359] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.285182 13640 raft_consensus.cc:385] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:47.311544 13040 raft_consensus.cc:2468] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:47.313206 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.315399 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4da9b26ef40e4f7a8f9dfdc8f7ccfc8f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.285468 13640 raft_consensus.cc:740] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:47.317525 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008d393fcdf441eb17dbe0c1fa2393f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.318092 13042 raft_consensus.cc:2468] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:47.319252 13640 consensus_queue.cc:260] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.323035 13640 ts_tablet_manager.cc:1434] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.073s user 0.006s sys 0.000s
I20260810 13:54:47.325021 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330bcef6f234943b6b935b54aa3edfd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.325594 13042 raft_consensus.cc:2468] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:47.333437 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fde417598648968b4013c54f0bc854" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.336596 13638 ts_tablet_manager.cc:1434] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.234s user 0.009s sys 0.000s
I20260810 13:54:47.346081 13043 raft_consensus.cc:2468] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:47.351317 17814 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.349576 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.350951 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.352101 17814 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.352967 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.353566 13040 raft_consensus.cc:2468] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:47.353744 13039 raft_consensus.cc:2393] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:47.365406 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.366007 13039 raft_consensus.cc:3060] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.365934 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:47.366106 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.366793 13252 raft_consensus.cc:2393] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:47.367771 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:47.368583 13250 raft_consensus.cc:2393] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:47.373215 13640 tablet_bootstrap.cc:492] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:47.376178 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:47.377373 13253 raft_consensus.cc:2393] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:47.381230 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:47.382586 13240 raft_consensus.cc:2393] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:47.397640 13640 tablet_bootstrap.cc:654] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:47.397248 17949 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.398310 17949 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.401922 17949 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.354425 13026 raft_consensus.cc:2468] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:47.410820 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.411623 13056 raft_consensus.cc:2393] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:47.411723 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.412572 13027 raft_consensus.cc:3060] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.417557 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.418365 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.418778 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.419044 13043 raft_consensus.cc:2393] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:47.419404 13049 raft_consensus.cc:2393] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:47.419909 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.420480 13040 raft_consensus.cc:3060] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.424832 13056 raft_consensus.cc:3060] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.424979 13639 tablet_bootstrap.cc:492] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:47.425377 13639 ts_tablet_manager.cc:1403] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.509s user 0.010s sys 0.006s
I20260810 13:54:47.427879 13639 raft_consensus.cc:359] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.428500 13639 raft_consensus.cc:385] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:47.428922 13639 raft_consensus.cc:740] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:47.429541 13639 consensus_queue.cc:260] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.431392 13639 ts_tablet_manager.cc:1434] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 13:54:47.432106 13040 raft_consensus.cc:2468] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:47.432438 13639 tablet_bootstrap.cc:492] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:47.441752 17917 raft_consensus.cc:493] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:47.442462 17917 raft_consensus.cc:515] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.445685 17917 leader_election.cc:290] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:47.447520 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:47.448998 13462 raft_consensus.cc:2393] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:47.457629 17814 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.465245 13464 raft_consensus.cc:1240] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:47.467738 13056 raft_consensus.cc:2468] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:47.484547 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.488606 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.494675 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bf6a1f14bb4513b1addc4141b71373" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.495252 13043 raft_consensus.cc:3060] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.497254 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:47.498574 13035 raft_consensus.cc:2393] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:47.500185 13638 tablet_bootstrap.cc:492] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:47.512809 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:47.512326 13043 raft_consensus.cc:2468] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:47.518213 13638 tablet_bootstrap.cc:654] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:47.527911 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.530206 13640 tablet_bootstrap.cc:492] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
W20260810 13:54:47.530722 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.638s (SENT)
I20260810 13:54:47.530838 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.531191 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:47.532011 13640 ts_tablet_manager.cc:1403] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.159s user 0.010s sys 0.005s
I20260810 13:54:47.546600 17974 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:47.570842 13039 raft_consensus.cc:2468] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:47.572158 13638 tablet_bootstrap.cc:492] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:47.572585 13638 ts_tablet_manager.cc:1403] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.073s user 0.015s sys 0.000s
I20260810 13:54:47.517002 13027 raft_consensus.cc:2468] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:47.583743 17826 consensus_queue.cc:1048] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:47.592978 13167 leader_election.cc:304] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:47.594110 17814 raft_consensus.cc:2764] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:47.603995 13639 tablet_bootstrap.cc:654] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:47.606256 13638 raft_consensus.cc:359] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.607061 13638 raft_consensus.cc:385] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:47.607348 13638 raft_consensus.cc:740] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:47.607954 13638 consensus_queue.cc:260] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.617014 13026 raft_consensus.cc:2468] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 2.
I20260810 13:54:47.619138 13343 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:47.634693 17814 raft_consensus.cc:493] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.635205 17814 raft_consensus.cc:515] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.637300 17814 leader_election.cc:290] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.642858 13164 leader_election.cc:304] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.643621 17811 raft_consensus.cc:2749] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:47.647102 17811 consensus_queue.cc:1048] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:47.648211 13638 ts_tablet_manager.cc:1434] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.075s user 0.007s sys 0.000s
I20260810 13:54:47.649236 13638 tablet_bootstrap.cc:492] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:47.649802 17811 consensus_queue.cc:1048] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:47.679104 13639 tablet_bootstrap.cc:492] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:47.679644 13639 ts_tablet_manager.cc:1403] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.247s user 0.012s sys 0.002s
I20260810 13:54:47.681977 13164 leader_election.cc:304] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.682852 17811 raft_consensus.cc:2749] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:47.688764 17702 consensus_queue.cc:1048] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:47.691462 13639 raft_consensus.cc:359] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.692117 13639 raft_consensus.cc:385] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:47.692386 13639 raft_consensus.cc:740] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:47.693030 13639 consensus_queue.cc:260] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.697407 13164 leader_election.cc:304] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.704865 17814 consensus_queue.cc:1048] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:47.706409 13164 leader_election.cc:304] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.713074 13639 ts_tablet_manager.cc:1434] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.033s user 0.007s sys 0.000s
I20260810 13:54:47.717430 17702 raft_consensus.cc:2749] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:47.721701 13167 leader_election.cc:304] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:47.723140 17896 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:47.723874 17814 raft_consensus.cc:2804] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:47.723667 17896 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.724270 17814 raft_consensus.cc:493] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:47.724763 17814 raft_consensus.cc:3060] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.725818 17896 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.729553 17702 consensus_queue.cc:1048] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:47.733135 17951 raft_consensus.cc:2749] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:47.733592 13164 leader_election.cc:304] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.733654 17951 consensus_queue.cc:1048] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:47.734807 17951 raft_consensus.cc:2749] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:47.738034 13638 tablet_bootstrap.cc:654] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:47.739895 13426 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:47.740363 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:47.741564 13449 raft_consensus.cc:2468] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
W20260810 13:54:47.742882 12471 catalog_manager.cc:5129] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): alter failed for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]): Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:47.758488 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:47.759263 13456 raft_consensus.cc:2468] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:47.762167 17896 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.762786 17896 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.765358 17896 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.766702 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008d393fcdf441eb17dbe0c1fa2393f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:47.767442 13464 raft_consensus.cc:2468] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:47.770310 13167 leader_election.cc:304] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:47.772622 17896 raft_consensus.cc:493] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.773100 17896 raft_consensus.cc:515] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.775676 17826 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.775966 17896 leader_election.cc:290] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.776153 17826 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.777971 17826 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.779435 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:47.780069 13472 raft_consensus.cc:3060] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.783838 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:47.784585 13480 raft_consensus.cc:2468] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:47.799162 13640 raft_consensus.cc:359] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.800143 13640 raft_consensus.cc:385] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:47.800485 13640 raft_consensus.cc:740] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:47.801489 13640 consensus_queue.cc:260] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.796527 13472 raft_consensus.cc:2468] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:47.810264 17826 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.810808 17826 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.813485 17826 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.818112 13638 tablet_bootstrap.cc:492] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:47.818619 13638 ts_tablet_manager.cc:1403] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.170s user 0.009s sys 0.001s
I20260810 13:54:47.819453 17826 raft_consensus.cc:493] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.820097 17826 raft_consensus.cc:515] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.822984 17826 leader_election.cc:290] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.849498 18016 raft_consensus.cc:493] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:47.850167 18016 raft_consensus.cc:515] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.852391 18016 leader_election.cc:290] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.866431 18007 raft_consensus.cc:2804] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
W20260810 13:54:47.872038 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 100753us
I20260810 13:54:47.878337 17992 raft_consensus.cc:493] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:47.878994 17992 raft_consensus.cc:515] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:47.880992 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 145981us
I20260810 13:54:47.881101 17934 raft_consensus.cc:493] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:47.881608 17934 raft_consensus.cc:515] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.883872 17934 leader_election.cc:290] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:47.885113 13164 leader_election.cc:304] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.885849 17949 raft_consensus.cc:2749] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:47.886935 13164 leader_election.cc:304] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:47.887552 17949 raft_consensus.cc:2749] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:47.888624 17949 consensus_queue.cc:1048] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:47.894905 13638 raft_consensus.cc:359] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.895574 13638 raft_consensus.cc:385] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:47.895854 13638 raft_consensus.cc:740] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:47.898509 13167 leader_election.cc:304] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:47.899631 18018 consensus_queue.cc:1048] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:47.901647 18018 raft_consensus.cc:2804] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:47.856954 17826 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.905141 17826 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.906088 13639 tablet_bootstrap.cc:492] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:47.907516 17826 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.880029 17896 raft_consensus.cc:493] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:47.908318 17896 raft_consensus.cc:515] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.880847 12951 leader_election.cc:304] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:47.910367 17826 raft_consensus.cc:2804] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:47.910593 17896 leader_election.cc:290] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:47.910653 17826 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.911053 17826 raft_consensus.cc:3060] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:47.916872 12951 leader_election.cc:304] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:47.917680 18016 raft_consensus.cc:2804] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:47.920985 18016 raft_consensus.cc:493] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:47.930526 18016 raft_consensus.cc:3060] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:47.938294 13452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:47.927287 13639 tablet_bootstrap.cc:654] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:47.938964 13452 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:47.953208 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:47.954130 13462 raft_consensus.cc:2393] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:47.917958 12951 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:47.961184 17896 raft_consensus.cc:2804] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:47.961586 17896 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:47.962953 17896 raft_consensus.cc:3060] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:47.964011 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 46121us
I20260810 13:54:47.965265 12951 leader_election.cc:304] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:47.969401 17826 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.971515 17826 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:47.998631 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:48.022141 13640 ts_tablet_manager.cc:1434] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.490s user 0.010s sys 0.005s
I20260810 13:54:48.023495 13640 tablet_bootstrap.cc:492] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:47.913435 18007 raft_consensus.cc:697] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
W20260810 13:54:47.941789 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 51132us
I20260810 13:54:48.041473 18018 raft_consensus.cc:697] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:48.041972 18007 consensus_queue.cc:237] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.042327 18018 consensus_queue.cc:237] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:47.936391 13638 consensus_queue.cc:260] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.046473 13638 ts_tablet_manager.cc:1434] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.228s user 0.007s sys 0.000s
W20260810 13:54:47.978659 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 80234.1us
W20260810 13:54:48.035774 18025 log.cc:927] Time spent T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.111s user 0.001s sys 0.000s
W20260810 13:54:48.036164 18024 log.cc:927] Time spent T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.108s user 0.000s sys 0.001s
I20260810 13:54:48.053121 13638 tablet_bootstrap.cc:492] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:47.977058 17814 raft_consensus.cc:515] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.060477 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bf6a1f14bb4513b1addc4141b71373" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:48.061223 13258 raft_consensus.cc:3060] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:48.081266 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.081981 13467 raft_consensus.cc:2468] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:48.083400 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.083930 13467 raft_consensus.cc:2468] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:48.093271 18015 raft_consensus.cc:493] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.093813 18015 raft_consensus.cc:515] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.095746 18015 leader_election.cc:290] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:48.098728 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.100070 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.101290 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.105854 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.107440 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.052270 17992 leader_election.cc:290] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:48.113788 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 65736.8us
I20260810 13:54:48.114795 13167 leader_election.cc:304] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:48.115113 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.119374 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.121608 17814 leader_election.cc:290] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.123093 17814 raft_consensus.cc:2804] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:48.123513 17814 raft_consensus.cc:697] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:48.125759 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:48.126616 13250 raft_consensus.cc:2393] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:48.087600 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.136288 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c57ca566cfe47f6a331bbbe5c344a89" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.137231 13462 raft_consensus.cc:2468] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:48.138947 13453 raft_consensus.cc:1275] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:47.975320 13639 tablet_bootstrap.cc:492] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:48.145105 13639 ts_tablet_manager.cc:1403] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.239s user 0.008s sys 0.002s
I20260810 13:54:47.981431 18038 raft_consensus.cc:2804] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:48.148310 18038 raft_consensus.cc:493] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:48.148654 18038 raft_consensus.cc:3060] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:48.140308 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:47.991741 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:48.153939 13026 raft_consensus.cc:2468] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:47.992991 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:47.993985 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:48.154830 13056 raft_consensus.cc:2468] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:48.154881 13027 raft_consensus.cc:2468] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:47.995198 17896 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.155572 13639 raft_consensus.cc:359] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.156183 13639 raft_consensus.cc:385] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:48.157259 12721 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6d2d209f801b4aa0aff3137a51fc7556 consensus state has no leader
I20260810 13:54:48.156843 17896 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.156435 13639 raft_consensus.cc:740] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:48.014137 18043 raft_consensus.cc:493] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.047291 18044 raft_consensus.cc:493] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.159137 18044 raft_consensus.cc:515] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.137441 17814 consensus_queue.cc:237] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.161195 18044 leader_election.cc:290] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.161831 18043 raft_consensus.cc:515] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:48.071352 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:48.165881 18038 raft_consensus.cc:515] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.167917 18038 leader_election.cc:290] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.170708 13638 tablet_bootstrap.cc:654] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:48.092183 18016 raft_consensus.cc:515] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.125128 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:48.158367 13639 consensus_queue.cc:260] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.173723 13046 raft_consensus.cc:2468] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:48.174456 13639 ts_tablet_manager.cc:1434] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.029s user 0.003s sys 0.002s
I20260810 13:54:48.175349 13639 tablet_bootstrap.cc:492] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:48.177533 18016 leader_election.cc:290] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.170744 18043 leader_election.cc:290] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.183753 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:48.184649 13056 raft_consensus.cc:2393] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:48.215241 13258 raft_consensus.cc:2468] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:48.234428 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.239586 18015 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:48.240132 18015 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.242249 18015 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:48.261153 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.264053 13639 tablet_bootstrap.cc:654] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:48.267719 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.269191 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.269984 13252 raft_consensus.cc:2393] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:48.270922 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.274163 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.289088 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c57ca566cfe47f6a331bbbe5c344a89" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.289662 13257 raft_consensus.cc:2468] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:48.290056 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.297717 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:48.298429 13468 raft_consensus.cc:2393] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:48.307727 13640 tablet_bootstrap.cc:654] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:48.306712 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:48.318184 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 54425.7us
I20260810 13:54:48.319123 13167 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:48.319979 18056 raft_consensus.cc:2804] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:48.320362 18056 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:48.320920 18056 raft_consensus.cc:3060] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:48.322049 13167 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:48.323436 13167 leader_election.cc:304] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:48.327457 17896 raft_consensus.cc:493] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:48.328145 17896 raft_consensus.cc:515] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.332551 17896 leader_election.cc:290] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.338171 13167 leader_election.cc:304] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:48.339018 18005 raft_consensus.cc:2804] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:48.339372 18005 raft_consensus.cc:493] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:48.339689 18005 raft_consensus.cc:3060] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:48.341285 17951 raft_consensus.cc:2804] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:48.341655 17951 raft_consensus.cc:493] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:48.341964 17951 raft_consensus.cc:3060] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:48.344017 17811 raft_consensus.cc:2804] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:48.344385 17811 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:48.344727 17811 raft_consensus.cc:3060] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:48.354538 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:48.355331 13252 raft_consensus.cc:2393] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:48.355387 18005 raft_consensus.cc:515] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.364313 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:48.369701 17826 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:48.370327 17826 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.373689 17826 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.378795 18015 raft_consensus.cc:493] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:48.379348 18015 raft_consensus.cc:515] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.391228 13639 tablet_bootstrap.cc:492] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:48.392881 13639 ts_tablet_manager.cc:1403] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.218s user 0.008s sys 0.003s
I20260810 13:54:48.395154 13639 raft_consensus.cc:359] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.395740 13639 raft_consensus.cc:385] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:48.396008 13639 raft_consensus.cc:740] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:48.399186 13252 raft_consensus.cc:1240] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:48.303269 13449 raft_consensus.cc:2468] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:48.425792 13638 tablet_bootstrap.cc:492] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:48.426296 13638 ts_tablet_manager.cc:1403] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.373s user 0.016s sys 0.000s
I20260810 13:54:48.463420 13552 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:48.393357 18056 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:48.474828 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:48.483330 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:48.484126 13260 raft_consensus.cc:2393] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:48.410415 17951 raft_consensus.cc:515] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:48.489111 18083 log.cc:927] Time spent T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb: Append to log took a long time: real 0.091s user 0.000s sys 0.000s
I20260810 13:54:48.482309 17811 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.499753 17951 leader_election.cc:290] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.500511 18056 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.497108 18005 leader_election.cc:290] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.505651 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fde417598648968b4013c54f0bc854" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.515056 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330bcef6f234943b6b935b54aa3edfd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:48.523314 13252 raft_consensus.cc:3060] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:48.528995 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.396610 13639 consensus_queue.cc:260] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.526046 13638 raft_consensus.cc:359] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.531726 13638 raft_consensus.cc:385] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:48.531989 13638 raft_consensus.cc:740] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:48.539675 13639 ts_tablet_manager.cc:1434] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.147s user 0.005s sys 0.000s
I20260810 13:54:48.549125 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:48.550066 13253 raft_consensus.cc:2393] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:48.552966 17811 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.541285 17951 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.556274 17951 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.558414 17951 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.618340 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:48.623878 13639 tablet_bootstrap.cc:492] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:48.625679 18051 raft_consensus.cc:493] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.626247 18051 raft_consensus.cc:515] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.630872 18051 leader_election.cc:290] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.641043 12951 leader_election.cc:304] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:48.643002 12951 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:48.644604 17896 raft_consensus.cc:2749] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:48.646222 17896 raft_consensus.cc:2804] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:48.646551 17896 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:48.646889 17896 raft_consensus.cc:3060] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:48.659871 13639 tablet_bootstrap.cc:654] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:48.665318 12951 leader_election.cc:304] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:48.666136 18051 raft_consensus.cc:2804] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:48.666564 18051 raft_consensus.cc:493] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:48.666960 18051 raft_consensus.cc:3060] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:48.482774 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.488371 18015 leader_election.cc:290] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:48.527021 13640 tablet_bootstrap.cc:492] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:48.550524 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.551790 18116 raft_consensus.cc:493] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:48.669529 18116 raft_consensus.cc:515] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.671938 18116 leader_election.cc:290] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:48.558501 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:48.673326 13640 ts_tablet_manager.cc:1403] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.650s user 0.014s sys 0.000s
I20260810 13:54:48.673429 17896 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:48.679991 18051 raft_consensus.cc:515] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.682181 13640 raft_consensus.cc:359] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.682960 13640 raft_consensus.cc:385] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:48.683267 13640 raft_consensus.cc:740] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:48.683377 12951 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:48.684290 18039 raft_consensus.cc:2804] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:48.684064 13640 consensus_queue.cc:260] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.684612 18039 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:48.684952 18039 raft_consensus.cc:3060] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:48.685961 13640 ts_tablet_manager.cc:1434] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260810 13:54:48.687119 13640 tablet_bootstrap.cc:492] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:48.577484 18117 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:48.692386 18117 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.695020 18117 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:48.702566 12951 leader_election.cc:304] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:48.703409 18016 raft_consensus.cc:2804] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:48.703853 18016 raft_consensus.cc:697] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:48.704663 18016 consensus_queue.cc:237] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.712347 13638 consensus_queue.cc:260] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.718393 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.726634 12951 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:48.716872 18007 raft_consensus.cc:493] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.727319 18016 raft_consensus.cc:2804] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:48.715776 18005 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:48.727640 18016 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:48.728107 18016 raft_consensus.cc:3060] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:48.723693 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.737018 18039 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.739305 17896 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:48.750304 13638 ts_tablet_manager.cc:1434] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.322s user 0.008s sys 0.000s
I20260810 13:54:48.752388 13638 tablet_bootstrap.cc:492] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:48.733976 18005 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.733836 18007 raft_consensus.cc:515] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.759485 18007 leader_election.cc:290] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.768853 13640 tablet_bootstrap.cc:654] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:48.769675 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.772934 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:48.773773 13240 raft_consensus.cc:2393] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:48.775915 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafed58a5994479e91678ddbe74cd353" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:48.756536 18005 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.777593 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:48.778144 13027 raft_consensus.cc:2468] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:48.779747 18039 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.780508 18051 leader_election.cc:290] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.783633 13640 tablet_bootstrap.cc:492] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:48.784116 13640 ts_tablet_manager.cc:1403] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.097s user 0.012s sys 0.000s
I20260810 13:54:48.786604 13640 raft_consensus.cc:359] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.789393 13640 raft_consensus.cc:385] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:48.789709 13640 raft_consensus.cc:740] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:48.790797 12951 leader_election.cc:304] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:48.791733 13640 consensus_queue.cc:260] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.792476 18043 raft_consensus.cc:2749] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:48.793044 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008d393fcdf441eb17dbe0c1fa2393f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:48.793566 13240 raft_consensus.cc:3060] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:48.797412 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:48.798205 13269 raft_consensus.cc:2393] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:48.798007 18016 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.800406 13252 raft_consensus.cc:2468] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:48.800648 13640 ts_tablet_manager.cc:1434] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260810 13:54:48.801101 18039 raft_consensus.cc:493] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.805125 18039 raft_consensus.cc:515] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.807408 18039 leader_election.cc:290] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.809739 18039 consensus_queue.cc:1048] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:48.811923 13638 tablet_bootstrap.cc:654] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:48.819242 13240 raft_consensus.cc:2468] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:48.824823 13639 tablet_bootstrap.cc:492] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:48.838097 13640 tablet_bootstrap.cc:492] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:48.839325 18016 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.844040 13640 tablet_bootstrap.cc:654] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:48.825423 13639 ts_tablet_manager.cc:1403] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.202s user 0.006s sys 0.007s
I20260810 13:54:48.857362 13639 raft_consensus.cc:359] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.858099 13639 raft_consensus.cc:385] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:48.858402 13639 raft_consensus.cc:740] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:48.859076 13639 consensus_queue.cc:260] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:48.823334 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 367170us
I20260810 13:54:48.856266 12951 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:48.862166 13640 tablet_bootstrap.cc:492] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:48.862639 13640 ts_tablet_manager.cc:1403] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.007s
I20260810 13:54:48.863729 12952 leader_election.cc:304] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:48.865747 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:48.867226 13640 raft_consensus.cc:359] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.871142 17702 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.871836 17702 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.873435 13640 raft_consensus.cc:385] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:48.873778 13640 raft_consensus.cc:740] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:48.874598 13640 consensus_queue.cc:260] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.875414 17702 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:48.886693 13638 tablet_bootstrap.cc:492] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:48.887410 13638 ts_tablet_manager.cc:1403] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.135s user 0.005s sys 0.004s
I20260810 13:54:48.888063 18117 raft_consensus.cc:493] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.888727 18015 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.889381 18015 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.892241 18015 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:48.888666 18117 raft_consensus.cc:515] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.895591 18117 leader_election.cc:290] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:48.897164 13640 ts_tablet_manager.cc:1434] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.034s user 0.006s sys 0.001s
I20260810 13:54:48.898847 13640 tablet_bootstrap.cc:492] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:48.903748 13638 raft_consensus.cc:359] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.904464 13638 raft_consensus.cc:385] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:48.912053 13640 tablet_bootstrap.cc:654] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:48.920276 13382 leader_election.cc:304] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:48.924799 13638 raft_consensus.cc:740] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:48.925683 13638 consensus_queue.cc:260] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.928896 13638 ts_tablet_manager.cc:1434] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.041s user 0.001s sys 0.008s
I20260810 13:54:48.929885 13638 tablet_bootstrap.cc:492] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:48.938100 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2a2e00edb244e54b04a511dd0e76c9f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.926594 18117 raft_consensus.cc:493] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:48.944976 18117 raft_consensus.cc:515] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.946988 18117 leader_election.cc:290] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:48.938521 13640 tablet_bootstrap.cc:492] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:48.947718 13640 ts_tablet_manager.cc:1403] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.005s
I20260810 13:54:48.950224 13640 raft_consensus.cc:359] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.950820 13640 raft_consensus.cc:385] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:48.951066 13640 raft_consensus.cc:740] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:48.951656 13640 consensus_queue.cc:260] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:48.954180 13640 ts_tablet_manager.cc:1434] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 13:54:48.955137 13640 tablet_bootstrap.cc:492] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:48.961025 18117 raft_consensus.cc:2749] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260810 13:54:48.963703 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 43692.5us
I20260810 13:54:48.964548 13382 leader_election.cc:304] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:48.965245 18117 raft_consensus.cc:2749] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 13:54:48.981000 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafed58a5994479e91678ddbe74cd353" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.981505 13382 leader_election.cc:304] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:48.984596 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.985414 13640 tablet_bootstrap.cc:654] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:48.987862 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:48.987970 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 131843us
I20260810 13:54:48.988651 13240 raft_consensus.cc:2393] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:48.988788 12951 leader_election.cc:304] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:48.990393 12951 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:48.991227 18038 raft_consensus.cc:2804] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:48.991586 18038 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:48.991915 18038 raft_consensus.cc:3060] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:48.992882 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 129229us
W20260810 13:54:48.994350 12952 leader_election.cc:343] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:48.987982 18051 raft_consensus.cc:2804] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:48.995951 18051 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:48.995815 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:48.996910 18041 raft_consensus.cc:2804] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:48.997313 18041 raft_consensus.cc:493] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:48.997671 18041 raft_consensus.cc:3060] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:49.003186 13639 ts_tablet_manager.cc:1434] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.154s user 0.006s sys 0.001s
I20260810 13:54:48.996282 18044 raft_consensus.cc:2749] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:48.996313 18051 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:49.013520 12951 leader_election.cc:304] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:49.014827 18044 raft_consensus.cc:2749] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:49.015302 13638 tablet_bootstrap.cc:654] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:49.016010 12951 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:49.016748 18044 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:49.018973 18044 consensus_queue.cc:1048] T 247fb8b09c12407d8535c07c5d0687fe P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:49.030061 18038 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.032310 18038 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.043643 18117 raft_consensus.cc:2804] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:49.044039 18117 raft_consensus.cc:493] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:49.044375 18117 raft_consensus.cc:3060] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:49.044099 17702 consensus_queue.cc:1048] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:49.048853 18056 consensus_queue.cc:1048] T 6406062bb0934eadae901502806178b5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:49.049356 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 67963.9us
I20260810 13:54:49.053925 13382 leader_election.cc:304] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:49.064105 17702 raft_consensus.cc:493] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.064644 17702 raft_consensus.cc:515] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.067473 17702 leader_election.cc:290] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.068562 18123 raft_consensus.cc:2804] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:49.068936 18123 raft_consensus.cc:493] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:49.069249 18123 raft_consensus.cc:3060] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:49.070050 13382 leader_election.cc:343] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:49.070459 13382 leader_election.cc:304] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.071095 18015 raft_consensus.cc:2749] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:49.072232 13382 leader_election.cc:304] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:49.061152 18117 raft_consensus.cc:515] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.074441 18117 leader_election.cc:290] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:49.033087 12951 leader_election.cc:304] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
W20260810 13:54:49.075824 12951 leader_election.cc:343] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:49.076432 13638 tablet_bootstrap.cc:492] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:49.076278 12951 leader_election.cc:304] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:49.077102 18016 raft_consensus.cc:2749] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:49.076799 18123 raft_consensus.cc:515] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.077665 18016 raft_consensus.cc:2749] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:49.078648 18123 leader_election.cc:290] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:49.078811 12951 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:49.079484 18016 raft_consensus.cc:2749] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:49.082614 12951 leader_election.cc:304] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.083084 13164 leader_election.cc:304] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.083372 18044 raft_consensus.cc:2804] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:49.083961 18056 raft_consensus.cc:2749] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:49.084446 18044 raft_consensus.cc:697] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:49.086126 18044 consensus_queue.cc:237] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.076953 13638 ts_tablet_manager.cc:1403] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.147s user 0.011s sys 0.002s
I20260810 13:54:49.042747 18051 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.091558 18051 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.026510 18041 raft_consensus.cc:515] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.094015 13164 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.093429 18041 leader_election.cc:290] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.095582 13639 tablet_bootstrap.cc:492] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:49.097401 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 102264us
I20260810 13:54:49.102592 13382 leader_election.cc:304] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.105786 17826 consensus_queue.cc:1059] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260810 13:54:49.103255 18117 raft_consensus.cc:2804] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:49.106750 18144 raft_consensus.cc:3055] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:49.107128 18144 raft_consensus.cc:740] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:49.108031 18144 consensus_queue.cc:260] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.109475 18144 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:49.110077 18117 raft_consensus.cc:493] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:49.110510 18117 raft_consensus.cc:3060] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:49.112900 18056 raft_consensus.cc:2749] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260810 13:54:49.117208 18015 raft_consensus.cc:2749] T 73a7e7c310e24d8caca5756fe67631ce P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:49.118407 13638 raft_consensus.cc:359] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.119103 13638 raft_consensus.cc:385] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:49.119396 13638 raft_consensus.cc:740] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:49.118835 13382 leader_election.cc:304] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.121706 13640 tablet_bootstrap.cc:492] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:49.122121 13640 ts_tablet_manager.cc:1403] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.167s user 0.009s sys 0.000s
I20260810 13:54:49.122539 18015 raft_consensus.cc:2749] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260810 13:54:49.124011 13382 leader_election.cc:343] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:49.124732 13640 raft_consensus.cc:359] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.125388 13640 raft_consensus.cc:385] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:49.125087 13382 leader_election.cc:304] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.136067 18117 raft_consensus.cc:515] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.137629 18056 consensus_queue.cc:1048] T d891e763a1854b6a8bda1071448fd8e0 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:49.138433 18015 raft_consensus.cc:2749] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:49.139459 13382 leader_election.cc:304] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.143376 18015 raft_consensus.cc:2749] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:49.144541 13382 leader_election.cc:304] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.145267 18015 raft_consensus.cc:2749] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:49.146694 13382 leader_election.cc:304] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.125633 13640 raft_consensus.cc:740] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:49.148924 18015 raft_consensus.cc:2804] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:49.149403 18015 raft_consensus.cc:697] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:49.149165 13640 consensus_queue.cc:260] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.150870 13640 ts_tablet_manager.cc:1434] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.028s user 0.005s sys 0.000s
I20260810 13:54:49.150259 18015 consensus_queue.cc:237] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.151867 13640 tablet_bootstrap.cc:492] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:49.153111 13638 consensus_queue.cc:260] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:49.153510 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 45306.3us
W20260810 13:54:49.154160 12952 leader_election.cc:343] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:49.155118 13382 leader_election.cc:343] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: 674599456f9a49dc98d8d089c166ca89
I20260810 13:54:49.155529 13638 ts_tablet_manager.cc:1434] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.067s user 0.004s sys 0.001s
I20260810 13:54:49.156199 17826 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.156646 17826 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.158488 17826 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.162398 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:49.163125 13240 raft_consensus.cc:2393] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:49.164343 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:49.164798 13639 tablet_bootstrap.cc:654] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:49.164903 13240 raft_consensus.cc:2468] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:49.165241 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:49.165477 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:49.165810 13027 raft_consensus.cc:3060] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:49.165932 13056 raft_consensus.cc:3060] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:49.158852 18051 raft_consensus.cc:493] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.167491 18051 raft_consensus.cc:515] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.169351 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:49.170006 13057 raft_consensus.cc:3060] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:49.175274 13056 raft_consensus.cc:2468] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:49.177994 18051 leader_election.cc:290] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.181511 13638 tablet_bootstrap.cc:492] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:49.181893 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:49.196149 13041 raft_consensus.cc:3060] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:49.183187 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.197643 13042 raft_consensus.cc:2468] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:49.197983 13382 leader_election.cc:304] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.198781 18123 raft_consensus.cc:2749] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260810 13:54:49.198972 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 43910.5us
I20260810 13:54:49.199717 13382 leader_election.cc:304] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.200536 13382 leader_election.cc:304] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.201321 18126 raft_consensus.cc:2804] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:49.202098 13382 leader_election.cc:304] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.202186 18116 raft_consensus.cc:2749] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:49.203490 18116 raft_consensus.cc:2804] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:49.203903 18116 raft_consensus.cc:697] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:49.205488 13041 raft_consensus.cc:2468] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:49.205607 18056 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.205576 18116 consensus_queue.cc:237] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.206185 18056 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.190857 13057 raft_consensus.cc:2468] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:49.195375 13027 raft_consensus.cc:2468] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:49.211140 18056 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.148474 18117 leader_election.cc:290] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:49.218663 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.219316 13027 raft_consensus.cc:2468] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:49.221047 18056 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:49.221499 18056 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.225209 18056 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.227378 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.228077 13027 raft_consensus.cc:2468] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:49.236961 13638 tablet_bootstrap.cc:654] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:49.241253 13640 tablet_bootstrap.cc:654] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:49.245971 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]). Expected version 1 got 0
I20260810 13:54:49.251730 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.252533 13057 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:49.253118 18056 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.253588 18056 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.255959 18056 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.265050 13124 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:49.278837 13639 tablet_bootstrap.cc:492] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:49.279304 13639 ts_tablet_manager.cc:1403] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.184s user 0.011s sys 0.000s
I20260810 13:54:49.283818 18015 raft_consensus.cc:493] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.284700 18015 raft_consensus.cc:515] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.286140 18126 raft_consensus.cc:697] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:49.287240 18126 consensus_queue.cc:237] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.291132 13640 tablet_bootstrap.cc:492] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:49.291596 13640 ts_tablet_manager.cc:1403] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.140s user 0.013s sys 0.000s
I20260810 13:54:49.294235 13640 raft_consensus.cc:359] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.294854 13640 raft_consensus.cc:385] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:49.295099 13640 raft_consensus.cc:740] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:49.295719 13640 consensus_queue.cc:260] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.311578 13638 tablet_bootstrap.cc:492] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:49.312292 13638 ts_tablet_manager.cc:1403] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.131s user 0.003s sys 0.011s
I20260810 13:54:49.313156 18015 leader_election.cc:290] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
W20260810 13:54:49.313906 12952 leader_election.cc:343] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:49.314827 13638 raft_consensus.cc:359] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.315464 13638 raft_consensus.cc:385] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:49.315716 13638 raft_consensus.cc:740] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:49.316866 12952 leader_election.cc:304] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.317677 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.320022 13041 raft_consensus.cc:2468] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:49.321101 13638 consensus_queue.cc:260] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.321516 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]). Expected version 1 got 0
I20260810 13:54:49.322177 18051 raft_consensus.cc:2804] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:49.322613 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]). Expected version 1 got 0
I20260810 13:54:49.322714 18051 raft_consensus.cc:697] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:49.323347 13640 ts_tablet_manager.cc:1434] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.031s user 0.006s sys 0.001s
I20260810 13:54:49.324420 13640 tablet_bootstrap.cc:492] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:49.324208 18051 consensus_queue.cc:237] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.329255 13638 ts_tablet_manager.cc:1434] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.017s user 0.002s sys 0.004s
I20260810 13:54:49.323675 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]). Expected version 1 got 0
I20260810 13:54:49.336483 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]). Expected version 1 got 0
W20260810 13:54:49.342152 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:49.343160 12952 leader_election.cc:304] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.344236 12952 leader_election.cc:304] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.344962 18144 raft_consensus.cc:2804] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:49.345484 18144 raft_consensus.cc:697] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:49.346385 18144 consensus_queue.cc:237] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.348857 18016 raft_consensus.cc:2804] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:49.349334 18016 raft_consensus.cc:493] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:49.349661 18016 raft_consensus.cc:3060] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:49.350862 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]). Expected version 1 got 0
I20260810 13:54:49.352887 13638 tablet_bootstrap.cc:492] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:49.353521 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb]). Expected version 1 got 0
I20260810 13:54:49.356501 13640 tablet_bootstrap.cc:654] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:49.357539 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]). Expected version 1 got 0
I20260810 13:54:49.359356 18016 raft_consensus.cc:515] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.362344 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]). Expected version 2 got 0
I20260810 13:54:49.362847 18016 leader_election.cc:290] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.363976 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]). Expected version 1 got 0
I20260810 13:54:49.366047 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]). Expected version 1 got 0
I20260810 13:54:49.366597 13639 raft_consensus.cc:359] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.367439 13639 raft_consensus.cc:385] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:49.367769 13639 raft_consensus.cc:740] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:49.368970 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]). Expected version 2 got 0
I20260810 13:54:49.373458 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]). Expected version 1 got 0
I20260810 13:54:49.375725 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.376145 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]). Expected version 2 got 0
I20260810 13:54:49.376394 13041 raft_consensus.cc:2468] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:49.377290 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]). Expected version 1 got 0
I20260810 13:54:49.380858 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.381521 13027 raft_consensus.cc:2468] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
W20260810 13:54:49.381587 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 179563us
I20260810 13:54:49.383424 18015 consensus_queue.cc:1048] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:49.383687 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:49.384509 13240 raft_consensus.cc:2393] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
W20260810 13:54:49.385111 13382 leader_election.cc:343] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:49.390046 13041 raft_consensus.cc:1275] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:49.386060 13382 leader_election.cc:304] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.393710 18015 raft_consensus.cc:2804] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:49.394198 18015 raft_consensus.cc:697] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:49.395020 18015 consensus_queue.cc:237] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.396867 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:49.398139 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c57ca566cfe47f6a331bbbe5c344a89" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:49.398689 13252 raft_consensus.cc:3060] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:49.402766 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.403431 13041 raft_consensus.cc:2468] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 2.
I20260810 13:54:49.405193 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:49.405699 13240 raft_consensus.cc:2468] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:49.377866 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]). Expected version 1 got 0
I20260810 13:54:49.406535 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:49.406961 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]). Expected version 1 got 0
I20260810 13:54:49.407034 13258 raft_consensus.cc:2468] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:49.407725 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:49.407603 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.413738 13252 raft_consensus.cc:2468] T 7c57ca566cfe47f6a331bbbe5c344a89 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:49.418437 13382 leader_election.cc:304] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:49.420855 18116 raft_consensus.cc:2804] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:49.421355 18116 raft_consensus.cc:697] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:49.422163 18116 consensus_queue.cc:237] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.425616 13638 tablet_bootstrap.cc:654] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:49.441840 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:49.443486 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:49.446465 18018 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.448593 18018 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:49.451349 18018 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.454815 13167 leader_election.cc:304] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.455791 18018 raft_consensus.cc:2804] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:49.455786 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:49.444615 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:49.456394 18018 raft_consensus.cc:697] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:49.456980 13252 raft_consensus.cc:3060] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:49.457124 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]). Expected version 1 got 0
I20260810 13:54:49.457661 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:49.457396 18018 consensus_queue.cc:237] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.470841 13638 tablet_bootstrap.cc:492] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:49.476001 13638 ts_tablet_manager.cc:1403] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.146s user 0.009s sys 0.006s
I20260810 13:54:49.481942 13638 raft_consensus.cc:359] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.485380 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]). Expected version 1 got 0
I20260810 13:54:49.486279 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]). Expected version 1 got 0
I20260810 13:54:49.491518 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]). Expected version 1 got 0
I20260810 13:54:49.492054 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]). Expected version 1 got 0
I20260810 13:54:49.492638 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]). Expected version 1 got 0
I20260810 13:54:49.494990 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]). Expected version 1 got 0
I20260810 13:54:49.496109 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]). Expected version 1 got 0
I20260810 13:54:49.368494 13639 consensus_queue.cc:260] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.498512 13639 ts_tablet_manager.cc:1434] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.219s user 0.009s sys 0.000s
I20260810 13:54:49.498945 13638 raft_consensus.cc:385] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:49.501387 13638 raft_consensus.cc:740] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:49.505173 13638 consensus_queue.cc:260] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.500808 13252 raft_consensus.cc:2468] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:49.510496 13638 ts_tablet_manager.cc:1434] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.032s user 0.005s sys 0.001s
I20260810 13:54:49.512662 13638 tablet_bootstrap.cc:492] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:49.525740 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 107384us
W20260810 13:54:49.527242 13382 leader_election.cc:343] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:49.527848 13382 leader_election.cc:304] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.524925 13167 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.530067 13167 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.529160 18157 consensus_queue.cc:1048] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260810 13:54:49.530999 13167 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.531827 13167 leader_election.cc:304] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.532568 18059 raft_consensus.cc:2804] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:49.529289 18158 raft_consensus.cc:2804] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:49.532783 17702 raft_consensus.cc:2804] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:49.533352 18059 raft_consensus.cc:697] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:49.533408 18158 raft_consensus.cc:493] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:49.529331 18056 raft_consensus.cc:2804] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:49.533962 18158 raft_consensus.cc:3060] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:49.534116 18056 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:49.534446 18056 raft_consensus.cc:3060] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:49.534446 18059 consensus_queue.cc:237] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.528640 13382 leader_election.cc:304] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.539953 18157 raft_consensus.cc:2804] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:49.540782 18157 raft_consensus.cc:697] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:49.542933 18157 consensus_queue.cc:237] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.549506 18058 raft_consensus.cc:2804] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:49.550311 13640 tablet_bootstrap.cc:492] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:49.550834 13640 ts_tablet_manager.cc:1403] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.227s user 0.014s sys 0.011s
I20260810 13:54:49.552179 17702 raft_consensus.cc:697] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:49.553761 17702 consensus_queue.cc:237] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.560002 18058 raft_consensus.cc:697] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:49.561599 18058 consensus_queue.cc:237] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.566854 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]). Expected version 2 got 0
I20260810 13:54:49.569422 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]). Expected version 1 got 0
I20260810 13:54:49.570416 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]). Expected version 1 got 0
W20260810 13:54:49.586477 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 44269.3us
I20260810 13:54:49.587267 12952 leader_election.cc:304] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.587643 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]). Expected version 1 got 0
I20260810 13:54:49.588799 17896 raft_consensus.cc:2804] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:49.589218 17896 raft_consensus.cc:493] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:49.588997 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]). Expected version 1 got 0
I20260810 13:54:49.589597 17896 raft_consensus.cc:3060] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:49.589774 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]). Expected version 1 got 0
I20260810 13:54:49.590792 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]). Expected version 1 got 0
I20260810 13:54:49.595844 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d36f17094e504d80a2443dc12855c744 (table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67]). Expected version 1 got 0
I20260810 13:54:49.596545 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]). Expected version 1 got 0
I20260810 13:54:49.597807 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]). Expected version 1 got 0
I20260810 13:54:49.601545 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]). Expected version 1 got 0
I20260810 13:54:49.603334 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]). Expected version 1 got 0
I20260810 13:54:49.604132 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]). Expected version 1 got 0
I20260810 13:54:49.606451 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]). Expected version 2 got 0
I20260810 13:54:49.610057 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]). Expected version 3 got 0
I20260810 13:54:49.621084 12952 leader_election.cc:304] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.622141 18051 raft_consensus.cc:2804] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:49.622617 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]). Expected version 1 got 0
I20260810 13:54:49.623308 18051 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:49.623909 18051 raft_consensus.cc:3060] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:49.624677 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]). Expected version 1 got 0
W20260810 13:54:49.624660 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 72850.9us
I20260810 13:54:49.625648 13167 leader_election.cc:304] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.604519 17896 raft_consensus.cc:515] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.630402 12952 leader_election.cc:304] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:49.634856 13382 leader_election.cc:343] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:49.635239 13382 leader_election.cc:304] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.638137 18116 raft_consensus.cc:2749] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:49.636521 13382 leader_election.cc:304] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.641124 18144 raft_consensus.cc:2804] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:49.642190 18144 raft_consensus.cc:697] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:49.643306 18144 consensus_queue.cc:237] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.647353 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]). Expected version 3 got 0
I20260810 13:54:49.650673 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]). Expected version 1 got 0
I20260810 13:54:49.651402 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]). Expected version 1 got 0
I20260810 13:54:49.655833 13382 leader_election.cc:304] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.656639 18015 raft_consensus.cc:2749] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:49.664294 18126 raft_consensus.cc:2749] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:49.669494 13382 leader_election.cc:304] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.670476 18015 raft_consensus.cc:2749] T a2a2e00edb244e54b04a511dd0e76c9f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 13:54:49.673321 18116 consensus_queue.cc:1048] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:49.676295 13640 raft_consensus.cc:359] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.677147 13640 raft_consensus.cc:385] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:49.679764 13640 raft_consensus.cc:740] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:49.680577 13640 consensus_queue.cc:260] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:49.685088 13382 leader_election.cc:343] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:49.685974 13382 leader_election.cc:304] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:49.686568 13640 ts_tablet_manager.cc:1434] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.135s user 0.008s sys 0.000s
I20260810 13:54:49.682547 18158 raft_consensus.cc:515] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.687777 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]). Expected version 1 got 0
I20260810 13:54:49.698050 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]). Expected version 2 got 0
I20260810 13:54:49.698865 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]). Expected version 1 got 0
I20260810 13:54:49.703369 12952 leader_election.cc:304] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:49.648231 18187 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.655591 18186 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.720214 18193 raft_consensus.cc:2804] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:49.720768 18193 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:49.721258 18193 raft_consensus.cc:3060] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:49.722150 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]). Expected version 1 got 0
W20260810 13:54:49.729764 13382 leader_election.cc:343] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:49.733398 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:49.735139 18185 raft_consensus.cc:2749] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:49.736188 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.737404 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.738076 13468 raft_consensus.cc:3060] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:49.741179 13452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fde417598648968b4013c54f0bc854" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:49.741528 18158 leader_election.cc:290] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:49.742076 13452 raft_consensus.cc:2468] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:49.744626 13640 tablet_bootstrap.cc:492] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:49.744868 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330bcef6f234943b6b935b54aa3edfd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.745740 13453 raft_consensus.cc:2393] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:49.752118 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.752595 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.757223 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:49.759195 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:49.763124 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]). Expected version 1 got 0
I20260810 13:54:49.751485 18144 raft_consensus.cc:2804] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:49.765014 18144 raft_consensus.cc:697] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:49.765272 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]). Expected version 2 got 0
I20260810 13:54:49.766537 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]). Expected version 1 got 0
I20260810 13:54:49.766510 18144 consensus_queue.cc:237] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.767812 12492 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a04498da4fce45bb9a906e75594a023f (table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]). Expected version 1 got 0
I20260810 13:54:49.710081 18016 raft_consensus.cc:493] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:49.770188 18016 raft_consensus.cc:515] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.773536 18016 leader_election.cc:290] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.774451 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.780997 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008d393fcdf441eb17dbe0c1fa2393f" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.781823 13467 raft_consensus.cc:2393] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:49.782763 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.791306 13449 raft_consensus.cc:2468] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:49.796218 18123 raft_consensus.cc:493] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.797533 18123 raft_consensus.cc:515] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.805292 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.806113 13472 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:49.806329 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:49.806972 13462 raft_consensus.cc:2468] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:49.811790 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c57ca566cfe47f6a331bbbe5c344a89" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:49.812311 13462 raft_consensus.cc:3060] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:49.812315 13452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:49.813310 13452 raft_consensus.cc:2393] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:49.800416 18123 leader_election.cc:290] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:49.826171 13468 raft_consensus.cc:2468] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:49.827584 13640 tablet_bootstrap.cc:654] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:49.863797 13638 tablet_bootstrap.cc:654] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:49.714323 18187 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.830861 13461 raft_consensus.cc:2468] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:49.711234 17896 leader_election.cc:290] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.883057 18038 raft_consensus.cc:493] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.883647 18038 raft_consensus.cc:515] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.885896 18038 leader_election.cc:290] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:49.888660 12471 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: UpdateConsensus RPC to 127.12.36.60:38017 timed out after 30.000s (SENT) [suppressed 1 similar messages]
I20260810 13:54:49.716570 18186 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.864859 18059 raft_consensus.cc:493] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.905099 18056 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.907317 18056 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.909088 18187 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:49.909461 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 206152us
I20260810 13:54:49.911761 18193 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:49.912629 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:49.913955 18193 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.890805 18186 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.922003 13041 raft_consensus.cc:1240] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Rejecting Update request from peer 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:49.925534 18186 raft_consensus.cc:493] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:49.926062 18186 raft_consensus.cc:515] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.934717 18186 leader_election.cc:290] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.940874 18059 raft_consensus.cc:515] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.943310 18059 leader_election.cc:290] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.952359 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:49.953040 13041 raft_consensus.cc:2468] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:49.959288 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:49.959861 13260 raft_consensus.cc:3060] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:49.968894 12471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 80278.4us
I20260810 13:54:49.877975 18051 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.973233 18051 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.978089 13639 tablet_bootstrap.cc:492] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:49.987610 13639 tablet_bootstrap.cc:654] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:49.991529 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:49.997951 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:49.998531 13269 raft_consensus.cc:2468] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:49.976454 18186 raft_consensus.cc:493] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.002346 18186 raft_consensus.cc:515] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.005937 18186 leader_election.cc:290] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.008201 13260 raft_consensus.cc:2468] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
W20260810 13:54:50.021426 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 395853us
I20260810 13:54:50.022362 13167 leader_election.cc:304] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.022639 13638 tablet_bootstrap.cc:492] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:50.023145 13638 ts_tablet_manager.cc:1403] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.511s user 0.006s sys 0.007s
I20260810 13:54:50.023211 18058 raft_consensus.cc:2804] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:50.023773 18058 raft_consensus.cc:493] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:50.024331 18058 raft_consensus.cc:3060] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.024583 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:50.025279 13269 raft_consensus.cc:3060] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:50.026110 13638 raft_consensus.cc:359] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.026877 13638 raft_consensus.cc:385] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:50.027185 13638 raft_consensus.cc:740] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:50.027899 13638 consensus_queue.cc:260] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.030912 13638 ts_tablet_manager.cc:1434] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260810 13:54:50.031828 13638 tablet_bootstrap.cc:492] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:50.041317 17896 consensus_queue.cc:1048] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:50.049013 12952 leader_election.cc:304] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.051141 13638 tablet_bootstrap.cc:654] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:50.052340 18144 raft_consensus.cc:2804] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:50.052831 18144 raft_consensus.cc:493] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:50.053270 18144 raft_consensus.cc:3060] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:50.049467 13639 tablet_bootstrap.cc:492] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:50.055925 13639 ts_tablet_manager.cc:1403] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.097s user 0.005s sys 0.007s
I20260810 13:54:50.059583 13639 raft_consensus.cc:359] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.060369 13639 raft_consensus.cc:385] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:50.060642 13639 raft_consensus.cc:740] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:50.061340 13639 consensus_queue.cc:260] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.069564 13639 ts_tablet_manager.cc:1434] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20260810 13:54:50.070513 12952 leader_election.cc:304] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.072535 13638 tablet_bootstrap.cc:492] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:50.072989 13638 ts_tablet_manager.cc:1403] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.041s user 0.014s sys 0.000s
I20260810 13:54:50.073135 17896 raft_consensus.cc:2804] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:50.074281 17896 raft_consensus.cc:697] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.075569 17896 consensus_queue.cc:237] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.076507 13639 tablet_bootstrap.cc:492] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:50.080519 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 51561.6us
I20260810 13:54:50.091836 13638 raft_consensus.cc:359] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.092864 13638 raft_consensus.cc:385] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:50.093444 18059 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.093946 18059 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.101029 18059 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.104525 13470 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:50.093178 13638 raft_consensus.cc:740] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:49.832006 13452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.106762 13638 consensus_queue.cc:260] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:49.843840 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
W20260810 13:54:49.847270 13426 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:50.111804 13472 raft_consensus.cc:2468] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 3.
I20260810 13:54:49.850627 18157 raft_consensus.cc:493] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:49.861382 13480 raft_consensus.cc:2468] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:50.100170 18185 raft_consensus.cc:493] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.101589 18117 raft_consensus.cc:493] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:50.121423 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:50.123183 18116 raft_consensus.cc:493] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:50.133428 18142 raft_consensus.cc:493] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.134016 18142 raft_consensus.cc:515] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.133636 13474 raft_consensus.cc:3060] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.137437 18142 leader_election.cc:290] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:49.849072 13476 raft_consensus.cc:2468] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:50.143232 13639 tablet_bootstrap.cc:654] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:50.137974 18117 raft_consensus.cc:515] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.125280 18157 raft_consensus.cc:515] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.147061 18117 leader_election.cc:290] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:50.147279 18157 leader_election.cc:290] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:50.139456 13452 raft_consensus.cc:2468] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:50.149176 13269 raft_consensus.cc:2468] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 3.
I20260810 13:54:50.153017 18142 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.153796 18142 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:50.154791 12471 catalog_manager.cc:5129] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): alter failed for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]): Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:50.141325 18116 raft_consensus.cc:515] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:50.163168 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_9f48e93a010b4fc5b43124a1f8248ddf [id=011f63bf5ea44f918070a9ead229fa95]
I20260810 13:54:50.161080 18142 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.165649 18116 leader_election.cc:290] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:50.167472 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.169901 13253 raft_consensus.cc:1275] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:50.171123 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.171800 13240 raft_consensus.cc:2468] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:50.142930 13462 raft_consensus.cc:2468] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:50.168354 13250 raft_consensus.cc:2468] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:50.139014 18185 raft_consensus.cc:515] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.195397 18185 leader_election.cc:290] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:50.197867 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.198352 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.198617 13639 tablet_bootstrap.cc:492] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:50.199101 13639 ts_tablet_manager.cc:1403] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.123s user 0.007s sys 0.008s
I20260810 13:54:50.201731 12952 leader_election.cc:304] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.203550 12952 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.217312 13474 raft_consensus.cc:2468] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:50.217594 18142 raft_consensus.cc:2804] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:50.218190 18142 raft_consensus.cc:697] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [term 3 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.219242 18142 consensus_queue.cc:237] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.220028 17896 consensus_queue.cc:1048] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:50.223858 18144 raft_consensus.cc:515] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.224792 12952 leader_election.cc:304] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.225673 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e317f4e20e124c60bbed5450c6c3ca07 [id=01638b930a5e4b46925cdbfd23f204ea]
I20260810 13:54:50.226136 18038 raft_consensus.cc:2804] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:50.226454 18038 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:50.226902 18038 raft_consensus.cc:3060] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:50.227831 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_230d8010fef046048e532692ee7681c8 [id=01dba6a69dec44aeb2f402dddb3e0cae]
I20260810 13:54:50.237246 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:50.237916 13258 raft_consensus.cc:3060] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:50.245611 13638 ts_tablet_manager.cc:1434] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.172s user 0.008s sys 0.000s
I20260810 13:54:50.246665 13638 tablet_bootstrap.cc:492] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:50.256928 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 163045us
I20260810 13:54:50.257606 13167 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.247854 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]
I20260810 13:54:50.269313 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e8a597f1c0ec4cd8878f49046eb45e66 [id=047df8b2dabc4682a2227e841b10a53c]
I20260810 13:54:50.276033 13258 raft_consensus.cc:2468] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:50.281064 18043 consensus_queue.cc:1048] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:50.282341 13639 raft_consensus.cc:359] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.283016 13639 raft_consensus.cc:385] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:50.283254 13639 raft_consensus.cc:740] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:50.284436 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 55061.6us
I20260810 13:54:50.283826 13639 consensus_queue.cc:260] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.289983 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_8054f93e82de4c898987acb86f25e5d0 [id=0685b3b0945a493db836d29e5993e447]
I20260810 13:54:50.292186 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a8f5484f0ff14287be783696e6d8525d [id=06f3859cd5e748a3800b66ecf0a93c28]
I20260810 13:54:50.281121 17896 raft_consensus.cc:2804] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:50.292856 17896 raft_consensus.cc:493] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:50.293228 17896 raft_consensus.cc:3060] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.303459 18051 raft_consensus.cc:493] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.303951 18051 raft_consensus.cc:515] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.304790 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]
I20260810 13:54:50.307991 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_b392780f45ab4b899ddb12eefbcdd556 [id=0a7b7ff4685e4a8884b4aab7a835890d]
I20260810 13:54:50.285363 18144 leader_election.cc:290] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.306736 18051 leader_election.cc:290] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.325202 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_3fb4e7e2f617464f930b338a8ece6e38 [id=0acde9f8e2f7483c9eb7f3df14b0859d]
I20260810 13:54:50.288805 17702 raft_consensus.cc:2804] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:50.327824 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_88dee97116de4d0dac8a7af552b06f14 [id=0b34e431b94a4d24ad26858d4630420f]
I20260810 13:54:50.330428 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:50.331089 13467 raft_consensus.cc:3060] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:50.328150 13638 tablet_bootstrap.cc:654] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:50.332078 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:50.341153 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_f0a8373b96114e0c896e54dcb940f74d [id=0c70c375ac604d158df38f374fc3c1d1]
I20260810 13:54:50.343017 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_1668535b5107458a842c0def2c55461f [id=0cdd1449d5734d559f49933deef6bb19]
I20260810 13:54:50.347692 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.348241 13468 raft_consensus.cc:2468] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:50.348588 18038 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.353129 18038 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.355825 18234 raft_consensus.cc:493] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:50.356407 18234 raft_consensus.cc:515] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.357517 18051 raft_consensus.cc:493] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:50.358281 18051 raft_consensus.cc:515] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.358894 18234 leader_election.cc:290] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:50.360538 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:50.351475 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.361610 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:50.362195 13461 raft_consensus.cc:2410] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260810 13:54:50.366277 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:50.367986 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.368521 13476 raft_consensus.cc:2468] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:50.369359 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:50.369671 13043 raft_consensus.cc:1240] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:50.370110 13057 raft_consensus.cc:2393] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 3: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:50.370992 13041 raft_consensus.cc:1240] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:50.371915 13043 raft_consensus.cc:1240] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:50.377211 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:50.377499 13640 tablet_bootstrap.cc:492] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:50.377907 13640 ts_tablet_manager.cc:1403] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.633s user 0.013s sys 0.017s
I20260810 13:54:50.378707 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:50.381742 17896 raft_consensus.cc:515] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.382758 12952 leader_election.cc:304] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.383502 18236 raft_consensus.cc:2804] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:50.383972 18236 raft_consensus.cc:697] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.385573 17896 leader_election.cc:290] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.389856 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]). Expected version 2 got 0
I20260810 13:54:50.391078 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]). Expected version 1 got 0
I20260810 13:54:50.387917 17826 raft_consensus.cc:493] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:50.388746 18236 consensus_queue.cc:237] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.390730 18051 leader_election.cc:290] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.399421 13057 raft_consensus.cc:1240] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:50.411360 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]
I20260810 13:54:50.413355 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9]
I20260810 13:54:50.415586 13467 raft_consensus.cc:2468] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 3.
I20260810 13:54:50.429729 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_94153e136b9f4ea9aeb589c1a0322981 [id=12299e0dca554badab42ee7a73ea9723]
I20260810 13:54:50.439177 13639 ts_tablet_manager.cc:1434] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.240s user 0.013s sys 0.006s
I20260810 13:54:50.441097 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008d393fcdf441eb17dbe0c1fa2393f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:50.446725 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e424bd25638b4b23b721c8529aa42285 [id=126e0229d9904feba5c16222cecf5140]
I20260810 13:54:50.451534 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_72e9522a295642b28aa17f724e010d9e [id=143a3ec1ee2d409fa9de19aa1c8c8ab3]
I20260810 13:54:50.455585 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:50.437988 18043 raft_consensus.cc:493] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:50.455658 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330bcef6f234943b6b935b54aa3edfd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:50.456233 13043 raft_consensus.cc:3060] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.445057 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:50.437436 17826 raft_consensus.cc:515] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.463369 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]). Expected version 1 got 0
I20260810 13:54:50.457069 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:50.423882 13640 raft_consensus.cc:359] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.473523 13041 raft_consensus.cc:2468] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:50.473608 13640 raft_consensus.cc:385] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:50.473929 13640 raft_consensus.cc:740] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:50.457967 13026 raft_consensus.cc:1240] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:50.474612 13640 consensus_queue.cc:260] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.460894 13035 raft_consensus.cc:1240] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:50.462117 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:50.462983 17826 leader_election.cc:290] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.477703 13640 ts_tablet_manager.cc:1434] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.100s user 0.002s sys 0.006s
I20260810 13:54:50.476984 13050 raft_consensus.cc:3060] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.463529 18043 raft_consensus.cc:515] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.456674 13639 tablet_bootstrap.cc:492] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:50.482257 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2695264893564646a621e76ff6443e84 [id=147b038d3de54c8d85e666747153cb7d]
I20260810 13:54:50.485373 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]). Expected version 1 got 0
I20260810 13:54:50.337064 17702 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 13:54:50.342419 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 49871.6us
I20260810 13:54:50.345350 18196 raft_consensus.cc:493] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.346182 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.346886 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.347355 18059 raft_consensus.cc:493] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.349203 13253 raft_consensus.cc:1240] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:50.349730 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.488412 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]). Expected version 1 got 0
I20260810 13:54:50.488736 13269 raft_consensus.cc:2468] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 2.
I20260810 13:54:50.350405 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.353371 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.353314 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a008d393fcdf441eb17dbe0c1fa2393f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:50.354595 13261 raft_consensus.cc:1240] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:50.354861 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:50.355243 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330bcef6f234943b6b935b54aa3edfd" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:50.364078 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.490175 13257 raft_consensus.cc:2468] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:50.379055 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.491071 13258 raft_consensus.cc:2468] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:50.395048 13343 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:50.400434 18058 raft_consensus.cc:515] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.491840 12951 leader_election.cc:304] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:50.494684 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb]). Expected version 1 got 0
I20260810 13:54:50.495237 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]). Expected version 1 got 0
I20260810 13:54:50.495940 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]). Expected version 2 got 0
I20260810 13:54:50.500099 13043 raft_consensus.cc:2468] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:50.500588 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]
I20260810 13:54:50.503512 13264 raft_consensus.cc:2393] T a008d393fcdf441eb17dbe0c1fa2393f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:50.496500 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]). Expected version 1 got 0
I20260810 13:54:50.508237 18043 leader_election.cc:290] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.463423 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:50.509848 12951 leader_election.cc:304] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:50.512036 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]). Expected version 1 got 0
I20260810 13:54:50.513748 13050 raft_consensus.cc:2468] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:50.514359 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]). Expected version 2 got 0
I20260810 13:54:50.521070 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]). Expected version 1 got 0
I20260810 13:54:50.522929 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68]
I20260810 13:54:50.505796 17826 raft_consensus.cc:2749] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 13:54:50.509143 13027 raft_consensus.cc:2468] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:50.528295 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]). Expected version 1 got 0
I20260810 13:54:50.537027 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:50.537168 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_c752da6252ce4541be9cef2bce47bfe3 [id=178f273145a74eb2a2de7da53f248126]
I20260810 13:54:50.538908 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d]
I20260810 13:54:50.541594 13252 raft_consensus.cc:2393] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:50.542187 13254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:50.543195 13254 raft_consensus.cc:3060] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:50.543448 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_57980e60ac6549c8b24861967f6cc198 [id=18ade4a3af044a498725f45a06e04b81]
I20260810 13:54:50.545039 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]
I20260810 13:54:50.545320 13243 raft_consensus.cc:2393] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:50.523530 18196 raft_consensus.cc:515] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.551434 18196 leader_election.cc:290] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.526273 18059 raft_consensus.cc:515] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.553910 18058 leader_election.cc:290] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.554562 18059 leader_election.cc:290] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.554781 13639 tablet_bootstrap.cc:654] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:50.555610 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 [id=19cf8ac217b34ed1b6ceccb40508fd56]
I20260810 13:54:50.558532 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]
I20260810 13:54:50.504581 17702 raft_consensus.cc:3060] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
W20260810 13:54:50.564549 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 45151us
I20260810 13:54:50.564791 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.565991 18043 consensus_queue.cc:1048] T 7a7bddc8e6374437a37aeb755389d91f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:50.568787 18016 raft_consensus.cc:493] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:50.569514 18016 raft_consensus.cc:515] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.572670 18016 leader_election.cc:290] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.573141 12951 leader_election.cc:304] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:50.574712 18043 raft_consensus.cc:2749] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:50.575834 12951 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:50.575881 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_98fbef24cbef43679502dae9e67e35cf [id=1e5fe6bb81ec41d3be1b189a0631e695]
I20260810 13:54:50.577960 13640 tablet_bootstrap.cc:492] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:50.578984 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]
I20260810 13:54:50.586126 18237 raft_consensus.cc:2804] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:50.588816 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_6d071c01702c4d3cb0e693f02ef8a90f [id=20edfa4b7c00446bae121b000f8faf5f]
I20260810 13:54:50.591359 18237 raft_consensus.cc:493] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:50.595422 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_734de53e103d480c93e2779ef687142e [id=23152d9b944747f89cd06ee3a569b5b3]
I20260810 13:54:50.597584 18237 raft_consensus.cc:3060] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.599967 18016 raft_consensus.cc:2804] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:50.601140 18016 raft_consensus.cc:697] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.602761 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2a27c95d054b44dd84ede3639a6395c5 [id=232f082ff5eb446bbb2e7869e83b2449]
I20260810 13:54:50.602450 18016 consensus_queue.cc:237] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.605176 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]
I20260810 13:54:50.605870 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]). Expected version 1 got 0
I20260810 13:54:50.607245 18185 raft_consensus.cc:493] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:50.607861 18185 raft_consensus.cc:515] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:50.610950 18185 leader_election.cc:290] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:50.613546 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.614070 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_004ad2bd15214f94a0c183ec75f725ca [id=240ee1976c8f40c59438f7f22839e297]
I20260810 13:54:50.615677 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]
I20260810 13:54:50.615587 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:50.616719 13245 raft_consensus.cc:3060] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.619102 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]
I20260810 13:54:50.619242 17702 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.638561 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]
W20260810 13:54:50.648823 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 45664.9us
I20260810 13:54:50.649698 12951 leader_election.cc:304] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:50.606619 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:50.653473 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:50.654619 18185 raft_consensus.cc:493] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.655030 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]
I20260810 13:54:50.655303 18185 raft_consensus.cc:515] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.656733 18051 raft_consensus.cc:2749] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:50.658046 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]
I20260810 13:54:50.658846 18185 leader_election.cc:290] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:50.659567 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.661463 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:50.663230 13639 tablet_bootstrap.cc:492] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:50.663692 13639 ts_tablet_manager.cc:1403] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.207s user 0.012s sys 0.004s
I20260810 13:54:50.675375 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_40e69780eeb744aa8a192c8623bc7d4b [id=2ef48298f4404224bb44136ff71befd8]
I20260810 13:54:50.678061 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]
I20260810 13:54:50.680464 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]
I20260810 13:54:50.683123 12951 leader_election.cc:304] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:50.685657 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]
I20260810 13:54:50.689338 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_da87a4b83c12422e999c5b88c825d890 [id=3064108a10bd4f76b2be6614ebed22fc]
I20260810 13:54:50.691107 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:50.691782 13476 raft_consensus.cc:2393] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:50.693893 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f]
I20260810 13:54:50.698042 17896 raft_consensus.cc:2804] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:50.698786 17896 raft_consensus.cc:697] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.700866 17896 consensus_queue.cc:237] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.704593 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6]
I20260810 13:54:50.706571 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c]
I20260810 13:54:50.709957 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_dfe0fd41b106448e8a729e593ac63e5a [id=342af46254364715a3eb6166299c7275]
I20260810 13:54:50.712478 13639 raft_consensus.cc:359] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.714143 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_4b2d4fca101f4cbc9f296c50ca183066 [id=35087d7e2d0642a59670773333dda055]
I20260810 13:54:50.719213 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]). Expected version 1 got 0
I20260810 13:54:50.719918 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:50.720041 13639 raft_consensus.cc:385] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:50.721001 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]). Expected version 1 got 0
I20260810 13:54:50.721518 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_9d26366e03454a73ae877683e6700ff0 [id=3587a6d27d294470ac7551a3bb96a701]
I20260810 13:54:50.722777 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_51b05316075a49bc898ede0e35031c70 [id=359af78e1c844299a56756c90613d641]
I20260810 13:54:50.713469 12951 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:50.725594 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:50.725638 12951 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:50.726845 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:50.726329 17896 raft_consensus.cc:2749] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:50.724186 13639 raft_consensus.cc:740] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:50.728616 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:50.730257 18144 raft_consensus.cc:2804] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:50.730628 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]). Expected version 1 got 0
I20260810 13:54:50.730768 18144 raft_consensus.cc:697] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.731228 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]). Expected version 1 got 0
I20260810 13:54:50.731693 18144 consensus_queue.cc:237] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.733338 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]
W20260810 13:54:50.734979 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 193761us
I20260810 13:54:50.718463 17702 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.736158 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2416e07beb8d42a6a48de9dab42936cf [id=39551fb5d1804467bb58d5b00de27be4]
I20260810 13:54:50.737794 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]
I20260810 13:54:50.738207 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.739840 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d460b63b63de413ebdeeb708b4be6b10 [id=3d7325460d7842658631298c2538a71c]
I20260810 13:54:50.729045 13639 consensus_queue.cc:260] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.741914 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_4f780597fcec4261acd040c8816826c4 [id=3e00d0fc074747809ebc1f6b3696649d]
I20260810 13:54:50.742072 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.744170 13639 ts_tablet_manager.cc:1434] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.075s user 0.006s sys 0.001s
I20260810 13:54:50.747208 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a0e9339c31fa470380def2ad49326176 [id=3e51b3dca7144d7b8494e0a36e61706a]
I20260810 13:54:50.750377 13639 tablet_bootstrap.cc:492] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:50.752157 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.747455 12951 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:50.753784 18144 raft_consensus.cc:2804] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:50.741057 13254 raft_consensus.cc:2468] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 3.
I20260810 13:54:50.754609 18144 raft_consensus.cc:697] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [term 3 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.756806 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]
I20260810 13:54:50.757627 12951 leader_election.cc:304] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:50.758127 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_fd80397e5f4247339b3e3d483a671afa [id=3f7a51368fe34ca6b66f5c810e94ae60]
I20260810 13:54:50.759539 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_83164f9e96c540f58a5af47229b70854 [id=3f7f1db8228e4efa9b34bc33cb13be40]
I20260810 13:54:50.761299 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 [id=3fa9cd2a62034a4d81a0b740d5c31447]
I20260810 13:54:50.762465 12951 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:50.766150 13638 tablet_bootstrap.cc:492] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:50.763177 17896 raft_consensus.cc:2804] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:50.766559 13638 ts_tablet_manager.cc:1403] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.520s user 0.007s sys 0.013s
I20260810 13:54:50.767139 17896 raft_consensus.cc:697] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.768340 17896 consensus_queue.cc:237] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.772740 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_57828eb9ca764faf923e3e68fd0233a8 [id=3fff8bc92af84e59a10a592e85ad8503]
I20260810 13:54:50.756384 18144 consensus_queue.cc:237] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.774325 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e9c73c2f54b54ea485cdcadc15b0a420 [id=41772225716845f794c8c7d1ab21fd32]
I20260810 13:54:50.776168 12952 leader_election.cc:304] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.778040 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_def78e8fb6b74845bf2ef24bcef6691b [id=42af124147fe44c1875a9803af2e97a9]
I20260810 13:54:50.778258 18016 raft_consensus.cc:2804] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:50.778740 18016 raft_consensus.cc:493] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:50.778674 13245 raft_consensus.cc:2468] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:50.779292 18016 raft_consensus.cc:3060] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.779448 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]
I20260810 13:54:50.780709 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_f7160fbf49d74f79b79a300e67af5cbf [id=440aa3e8a24a415eb98a448b4848e76d]
I20260810 13:54:50.782006 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]
I20260810 13:54:50.784072 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_c39a51586fe847b990c6d2c59e2280ff [id=44428a121dc24f5ba5e5d74158f9f4d0]
I20260810 13:54:50.786222 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_51d643dcb2a5451e9cff367f2b3649c5 [id=46372d6eedfe4d56b2f2ce9a85f7f1fc]
W20260810 13:54:50.788950 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 52472.4us
I20260810 13:54:50.793287 13167 leader_election.cc:304] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.796762 18236 raft_consensus.cc:2804] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:50.797595 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_586e39daebb14dfaa08b3cc251eeb18a [id=46490c79e3814a82b21ab79f2a53814e]
I20260810 13:54:50.797995 18236 raft_consensus.cc:697] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.799119 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]
I20260810 13:54:50.800465 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_87c087a440044f9483716cce60bb4777 [id=4777400951884e84a747cbc635b6a087]
I20260810 13:54:50.799588 18236 consensus_queue.cc:237] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:50.806428 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 44043.3us
I20260810 13:54:50.806710 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1]
I20260810 13:54:50.808061 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_f6d23e8eec824ef08b26dec8c7c6d010 [id=4d373c8f174b46e99209a83ab947b204]
I20260810 13:54:50.810307 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.810985 13476 raft_consensus.cc:2368] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3.
I20260810 13:54:50.811864 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_276835c42e5a48309351dd4e441cc62f [id=4d5771db00ae42b9957c6453d83f81ae]
I20260810 13:54:50.811823 12951 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:50.813689 17826 raft_consensus.cc:2804] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:50.814296 17826 raft_consensus.cc:697] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.815461 17826 consensus_queue.cc:237] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:50.822952 18043 consensus_queue.cc:1048] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:50.732481 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]). Expected version 1 got 0
I20260810 13:54:50.833315 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]). Expected version 1 got 0
I20260810 13:54:50.834036 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]). Expected version 1 got 0
I20260810 13:54:50.833918 18249 raft_consensus.cc:2804] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:50.834520 18249 raft_consensus.cc:493] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:50.835108 18249 raft_consensus.cc:3060] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.835393 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]). Expected version 1 got 0
I20260810 13:54:50.836254 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]). Expected version 1 got 0
W20260810 13:54:50.836869 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 43702.3us
I20260810 13:54:50.837303 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_312808fed3bf45e8923e2b1be7f4d9fa [id=4de804595a6142819c0ea2f64fd1e34c]
I20260810 13:54:50.839814 13638 raft_consensus.cc:359] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.840627 13638 raft_consensus.cc:385] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:50.840837 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_10638f441f654317829d436d2e7eb979 [id=4f21b5213a724ce5989d7684473d65e9]
I20260810 13:54:50.840965 13638 raft_consensus.cc:740] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:50.841607 13638 consensus_queue.cc:260] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.843246 13638 ts_tablet_manager.cc:1434] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.076s user 0.005s sys 0.001s
I20260810 13:54:50.844796 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d171e1a65676495882912f18dddff2ee [id=4f6c1859cd1a481da7b9b3c2013365c3]
I20260810 13:54:50.861109 12952 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.865355 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e16662a9b5514b04b2d2fad48ad3d82f [id=51cc3d6cb6d248fc94d93654adfc72c0]
I20260810 13:54:50.865213 18038 raft_consensus.cc:2804] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:50.865859 18038 raft_consensus.cc:697] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [term 3 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:50.868115 13167 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:50.867393 18038 consensus_queue.cc:237] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.873426 13638 tablet_bootstrap.cc:492] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:50.875610 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]
I20260810 13:54:50.876878 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.877772 13476 raft_consensus.cc:2393] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:50.877498 12487 catalog_manager.cc:5719] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
I20260810 13:54:50.880235 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]). Expected version 2 got 0
I20260810 13:54:50.883994 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.885025 13476 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:50.887681 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]
I20260810 13:54:50.891099 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.891862 13467 raft_consensus.cc:2468] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:50.893031 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.893440 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]). Expected version 1 got 0
I20260810 13:54:50.893728 13462 raft_consensus.cc:2468] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:50.894345 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]). Expected version 1 got 0
I20260810 13:54:50.883090 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:50.771910 18237 raft_consensus.cc:515] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:50.888432 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:50.900791 13124 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:50.901397 12487 catalog_manager.cc:5719] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3). New cstate: current_term: 1 leader_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: HEALTHY } } }
W20260810 13:54:50.902119 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 54548.9us
I20260810 13:54:50.903450 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_7c53cfb1808c47e59a8e23b0e6325acd [id=5558467decbe4ca29c989c08073be0de]
I20260810 13:54:50.906123 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.910108 13265 raft_consensus.cc:1240] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:50.910902 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]
I20260810 13:54:50.912770 13476 raft_consensus.cc:1240] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Rejecting Update request from peer 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260810 13:54:50.901028 18237 leader_election.cc:290] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.918043 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]
I20260810 13:54:50.909315 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]). Expected version 1 got 0
I20260810 13:54:50.927544 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_7e2df1474a324a139e9e31ca581a4f34 [id=5b1484c8fdc64ee6a07bd203fa140fcb]
I20260810 13:54:50.927572 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]). Expected version 1 got 0
I20260810 13:54:50.928185 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet d36f17094e504d80a2443dc12855c744 (table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67]). Expected version 1 got 0
I20260810 13:54:50.928654 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]). Expected version 1 got 0
I20260810 13:54:50.929296 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]). Expected version 1 got 0
I20260810 13:54:50.929765 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]). Expected version 1 got 0
I20260810 13:54:50.930305 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]). Expected version 1 got 0
I20260810 13:54:50.930131 12951 leader_election.cc:304] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:50.930752 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_bd734d41b4c04e8fae8551c8d2f341dc [id=5b4eac88920044a7ba18bf40b8783a9d]
I20260810 13:54:50.932199 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ed026dd607ea4b2e8b1f22bee438879d [id=5b919872756647048ea2e4fecbe78537]
I20260810 13:54:50.932202 13260 raft_consensus.cc:1240] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:50.933571 18237 raft_consensus.cc:2749] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:50.935837 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_b5e6f89f8d854f7e991193036d4d8321 [id=5d59e07d6bc5465eaaf40d68610bc154]
I20260810 13:54:50.936929 13252 raft_consensus.cc:1240] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:50.937988 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:50.938544 13243 raft_consensus.cc:3060] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:50.940743 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f4b863f701471ab173b68049b1a602" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.941071 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.941642 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0]
I20260810 13:54:50.943027 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d4a38708152b4705af7eaf9af6ddc436 [id=5edfc8942f7145adae70b892942fbd64]
I20260810 13:54:50.944752 13639 tablet_bootstrap.cc:654] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:50.945638 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_856a1bf64ef9498890c9b6d98edcc8ad [id=60b4f30b701344d79b0c64b4e8127dbd]
I20260810 13:54:50.947851 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_8eeb870902124e9696cfa7e98dfa0e88 [id=614fbd4b5dd440cb8f5a6fa4d994266d]
I20260810 13:54:50.941900 13244 raft_consensus.cc:2468] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:50.953713 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_32a20912aef145aabc1b19b2b796c682 [id=6180bc58d52049fa82f92dc5e5a6b891]
W20260810 13:54:50.953897 13164 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 45556.8us
I20260810 13:54:50.955235 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_0cd1166b3e534639918d41544e409ec7 [id=631d4e81ac6b445183e988a0821e0e61]
I20260810 13:54:50.956775 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5d55900f1adf4aca973dbf4e94ca29c3 [id=63c1004ec7f44526929d7b9f809c0e04]
I20260810 13:54:50.960255 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.962055 13452 raft_consensus.cc:1275] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:50.963065 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_96cdf642a68642ce9fe947569577b42a [id=667ccf7ba20c49b2be82e167aa212ecd]
I20260810 13:54:50.963757 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.964632 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:50.965617 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_3ffb4babc30c4b76ae97168cb6dbdeee [id=66920d867573408d811d1fa6b877d355]
I20260810 13:54:50.966482 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:50.967396 13461 raft_consensus.cc:2468] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:50.967859 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]
I20260810 13:54:50.969194 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_cc339254bace4b5e87544b721a6493a5 [id=685e6bce7ba5467693e2b0e1c739897b]
I20260810 13:54:50.970671 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]
I20260810 13:54:50.975376 18196 raft_consensus.cc:493] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:50.976060 18196 raft_consensus.cc:515] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.920205 18016 raft_consensus.cc:515] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:50.961562 18142 consensus_queue.cc:1048] T 1330bcef6f234943b6b935b54aa3edfd P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:50.983556 18196 leader_election.cc:290] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.985984 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad]
I20260810 13:54:50.987629 18016 leader_election.cc:290] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:50.988109 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_77e30d5f98584b9e9711faa0b7a824df [id=6afc4e9a485640dda167bbaa0d6b347e]
I20260810 13:54:50.993646 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]
I20260810 13:54:50.995990 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]
W20260810 13:54:50.998127 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 130136us
I20260810 13:54:50.998646 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ecf31f9a869a44ecad98460873c65372 [id=6ec5427039a4417b98471e08ccf0b2c9]
I20260810 13:54:50.999066 18193 raft_consensus.cc:2804] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:50.999711 18193 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:51.000056 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5ac9d00cb7b3422e9810b51a4f20e029 [id=6f7b1b6d99b64d008a7c3c527f172e24]
I20260810 13:54:51.000208 18193 raft_consensus.cc:3060] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
W20260810 13:54:51.001056 13167 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:51.001711 13167 leader_election.cc:304] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:51.003391 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_772227d6702d4cf7bf6729e922d3eea5 [id=6ffcaf4f90f14e24b6d02b21e2936bd3]
I20260810 13:54:51.005647 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_8606de06b2994b3291a5ee1e28ad7100 [id=7162bee4392749a38057f272df172987]
I20260810 13:54:51.009511 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 [id=766aaf50fb2f4fbca53416a8e853f9c1]
I20260810 13:54:51.011302 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9]
I20260810 13:54:51.014446 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]
I20260810 13:54:51.015190 13638 tablet_bootstrap.cc:654] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:51.015663 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 [id=7a54639f4e1a4f1a82278d5d64b347b8]
I20260810 13:54:51.016820 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 [id=7a8b712d0b1a4766ab00cd2c4739c311]
I20260810 13:54:51.017943 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ee9ef5f74a944eaabe6af879e8ab15a2 [id=7a8f1c3ab411436fa3940b3261d0e05f]
I20260810 13:54:51.019070 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 [id=7b407001f6d54bd2929f1f0d141b065e]
I20260810 13:54:51.020150 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_acc827f97bb244f59d2eed071cc9bd55 [id=7b4d23c35bc14f8598821f2838a18148]
I20260810 13:54:51.022008 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_b33cb4c7a80141c49d306885213f30a9 [id=7dff57e81c064728a8160d5c02c11de5]
I20260810 13:54:51.021929 18142 raft_consensus.cc:493] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.022706 18142 raft_consensus.cc:515] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.026432 18142 leader_election.cc:290] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.026593 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]
I20260810 13:54:51.027760 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 [id=8129beecaba3450c9041bb715af80988]
I20260810 13:54:50.930787 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]). Expected version 1 got 0
I20260810 13:54:51.029803 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_921fde42e0214ef58181c03785687004 [id=828ce62882b949d6887e75923229655e]
I20260810 13:54:51.030493 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]). Expected version 1 got 0
I20260810 13:54:51.031222 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_383bd937c51942a1b124430d2b5086af [id=82f67714ca3b4e6aab8557bd0f53d264]
I20260810 13:54:51.032421 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_54ea5af3ae44427eb0031a29dd62e663 [id=834d810fa56c49de9d97b91dabab82f1]
I20260810 13:54:51.033833 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_6964fe82ae0c4d96a86d800f82062b3e [id=83fc760e794d422d8614bf728e3e47df]
I20260810 13:54:51.034096 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]). Expected version 1 got 0
I20260810 13:54:51.035291 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_612d612a32794a8998dd3a19129b79c3 [id=840614d5bd744a82bf94fd2f23a31d69]
I20260810 13:54:51.037304 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_4b93246ea61e418db4efb3c2732711af [id=847e7c0039964b3f94192d5032791e4a]
I20260810 13:54:51.035652 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]). Expected version 2 got 0
I20260810 13:54:51.038690 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_f835565354f042368700f4252335e8eb [id=84ca48404db8439697f8035aa3bc34d3]
I20260810 13:54:51.041088 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]
I20260810 13:54:51.042551 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]
I20260810 13:54:51.044116 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d5c509cabbb84883a9a911c2f4e04c88 [id=865c0ec036ca45caaec23fe2cf899d1d]
I20260810 13:54:51.045526 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e8940f9b8b5647b29566e6383b5c8fd7 [id=866777afb37d48b7bc025eba1377a8d0]
I20260810 13:54:51.045776 13243 raft_consensus.cc:2468] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:51.047690 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_7cf74351dd314634a7a8ca1b1a24302b [id=884f2bca73394b0b97902104a5b68976]
I20260810 13:54:51.049412 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_7cbcdca887724284a33c681c9574ea82 [id=8a8a45a7ac264648b3810d9c69a36751]
I20260810 13:54:51.050901 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a49a2f11e36d4162bc5847bacee456e7 [id=8aad892ad49f4c0aa7681d88843d3561]
I20260810 13:54:51.053028 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.053632 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]
I20260810 13:54:51.053617 13474 raft_consensus.cc:2468] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:51.057775 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_09a6fde1eefc4ce0a591129d6ab65e3a [id=8b4fe3206c2344728b61ed31b33580a6]
I20260810 13:54:51.059026 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_213c40da56b549d3bb97fccaa8f872cd [id=8bb576bce14b4fc3b1848496c6081841]
I20260810 13:54:51.055706 18193 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.061216 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_72fd7834d8574cb1a74c1d08699d1f7e [id=8cdd566d9af748b6a8d998ecf7221fb6]
I20260810 13:54:51.062566 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ee42df273bce4386bbf8edb282c2059a [id=8d115ba01bfd4ed7b90f6531e9ef66c2]
I20260810 13:54:51.063867 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_819cbf37633d4c75ba529b0d037cb8db [id=8d2ee7c5b732405c804aec9f79e98038]
W20260810 13:54:51.065448 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 204397us
I20260810 13:54:51.066135 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]
I20260810 13:54:51.067370 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_fe0baa9629ad42fbb05cfbc004e62688 [id=907a4591204d4db697b44488fef76406]
I20260810 13:54:51.068724 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2c6e1c408acb44358898a1a4ff356bdd [id=909cf43e9f9e4d439f8f246cef081d56]
I20260810 13:54:51.069718 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]). Expected version 3 got 0
I20260810 13:54:51.070658 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]). Expected version 1 got 0
I20260810 13:54:51.071198 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]
I20260810 13:54:51.072350 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]). Expected version 1 got 0
I20260810 13:54:51.072463 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_bc50dbac8249499e90b8d763fd7041f2 [id=92622bf6828843419776bf2bbe0c6aee]
I20260810 13:54:51.073549 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]). Expected version 1 got 0
I20260810 13:54:51.075309 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]
I20260810 13:54:51.078044 18142 raft_consensus.cc:493] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.081302 18193 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.083474 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_3c8a09c1dfda4797918bd6715bdfebce [id=9656e3a9a8f6431cb7b42ea64ae16159]
I20260810 13:54:51.083384 18185 raft_consensus.cc:493] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.083261 18142 raft_consensus.cc:515] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.084033 18185 raft_consensus.cc:515] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.086647 18142 leader_election.cc:290] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.087404 18185 leader_election.cc:290] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:51.089993 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ea7f41d802964936a967be553d7418fe [id=96574627e23442ebb0323b065423efae]
I20260810 13:54:51.092106 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_eebc498aa5734ab8b23c00b74d896ba9 [id=9756f3d17c15460e84863e49504d8349]
I20260810 13:54:51.093356 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_4f9508194c21480d9b603b139bdaf902 [id=98e554f12bf944c98887ed2293df2e26]
I20260810 13:54:51.094491 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_209ee5a105144c7e871214eaafcd0cbe [id=9a05ad06179141dfabe2d12858c1746c]
I20260810 13:54:51.095253 13638 tablet_bootstrap.cc:492] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:51.095741 13638 ts_tablet_manager.cc:1403] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.223s user 0.015s sys 0.001s
I20260810 13:54:51.100605 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]). Expected version 3 got 0
I20260810 13:54:51.105165 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_215968e7ab2540ab8a35960795941543 [id=9bac646089c94e54b68ff14ce2a50793]
I20260810 13:54:51.106495 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_6c443ac64289437d8c7dcf5ea44469dd [id=9c99ad2364cc45fba0746cbae06deeeb]
I20260810 13:54:51.107348 13640 tablet_bootstrap.cc:700] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent opening tablet: real 0.127s user 0.003s sys 0.000s
I20260810 13:54:51.108053 13640 tablet_bootstrap.cc:654] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:51.117192 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet a04498da4fce45bb9a906e75594a023f (table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]). Expected version 1 got 0
I20260810 13:54:51.109517 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]
I20260810 13:54:51.118819 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5388dd61e30949a5a2b9c07a35637080 [id=9fe82107b8344dfdae308a0d7091488d]
I20260810 13:54:51.120723 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d]
I20260810 13:54:51.121284 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]). Expected version 1 got 0
I20260810 13:54:51.122750 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b]
I20260810 13:54:51.123950 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_63e74b1d9a4e48c3b9343a12f0b926e6 [id=a17784f2e3a940e59b5603273436c417]
I20260810 13:54:51.124605 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]). Expected version 1 got 0
I20260810 13:54:51.125208 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]
I20260810 13:54:51.125725 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]). Expected version 1 got 0
I20260810 13:54:51.126513 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5022f9898a2b4343b457ad28e07a933f [id=a31aa9b4d20f46b4bd283aca2d2b446c]
I20260810 13:54:51.081473 17896 raft_consensus.cc:493] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.112900 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.127734 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_23cb4b4f896b48b1adc91079a7382c5c [id=a32ace7c7992464c8a5ef3f8169906b6]
I20260810 13:54:51.114148 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f4b863f701471ab173b68049b1a602" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.116241 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.117092 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.135933 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f]
I20260810 13:54:51.138020 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e9bf94db05cb46279abaeba00681ab82 [id=a547ccb6c9c24877b0b8d81d52e1630a]
I20260810 13:54:51.140585 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2901b91576984ac4a165471a90e86a8b [id=a67f03853a964c2fbf175165ee422881]
I20260810 13:54:51.158846 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]). Expected version 1 got 0
I20260810 13:54:51.159469 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.160916 13462 raft_consensus.cc:2468] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:51.161849 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:51.162354 13476 raft_consensus.cc:3060] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 3
I20260810 13:54:51.163546 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]
I20260810 13:54:51.164996 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_40ebe892a09b471581cb322124cf7630 [id=a79fc8e8c8ec420fb2c6e6cc0fdbc17e]
I20260810 13:54:51.165977 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]). Expected version 2 got 0
I20260810 13:54:51.166229 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_210fb0797673402e8e79fcf4e3c293b6 [id=aa1bdb6bb7c04faabb47c1552cc4aaff]
I20260810 13:54:51.167438 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_3abcbf71e2004a07888fe131143e8e76 [id=ab67527f31ce42d7a92bb0cba8f69ff6]
I20260810 13:54:51.169078 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]). Expected version 1 got 0
I20260810 13:54:51.169216 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_04b11142c9fe418a8f08aaa2b71df931 [id=ab8f7b2b94f247cbaf31717fe45c73f0]
I20260810 13:54:51.170501 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607]
I20260810 13:54:51.171761 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4]
I20260810 13:54:51.173872 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_03b06d24159c4b079c0008aa041c517b [id=af367ad99e9a4fa9907c170b0a5dee49]
I20260810 13:54:51.175300 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]
I20260810 13:54:51.127354 12952 leader_election.cc:304] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:51.178341 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a3085b5448ff4df8a25c4802ca130085 [id=b3648e88a1fc44808dcf824092d5de35]
I20260810 13:54:51.182533 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]
I20260810 13:54:51.183715 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_029a3ba2ee734a729e84a4482938ed5b [id=b437e76811d440ca817fca27a8dcbd45]
I20260810 13:54:51.185056 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_dfe60ded8ca240529710962e7f530298 [id=b4ce0aca49834e698812644caf8b8a94]
I20260810 13:54:51.186156 13639 tablet_bootstrap.cc:492] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:51.186589 13639 ts_tablet_manager.cc:1403] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.436s user 0.012s sys 0.006s
I20260810 13:54:51.187361 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_9ec2734c1c43472ca16731c99911a350 [id=b5072df8be3e4cc58980380d089942e2]
I20260810 13:54:51.188876 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]
I20260810 13:54:51.190245 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_131ccf6f50394a4facf6e622d5449b17 [id=b559d903254d433989a2deb00eb27361]
I20260810 13:54:51.191671 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]). Expected version 1 got 0
I20260810 13:54:51.192349 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5b39c1bb4b614f97ab6eb4d521628013 [id=b69ad2b0c70949b98192ae056eb2cab0]
I20260810 13:54:51.193670 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d8ab37a103a5426b81dcf295239ec9af [id=b7130fcdfcf54b76861fd9c87559beeb]
W20260810 13:54:51.198871 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 71604.3us
I20260810 13:54:51.199914 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a80ad2cc0680447898f832a3da957607 [id=b7e44fb60b9b401db5517c2fd7e8c70b]
I20260810 13:54:51.201704 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_4f02931df6b0437a9cb7869b14b73084 [id=b8289db1d29241f3815ff2da32fcfc1a]
I20260810 13:54:51.211746 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.212863 13474 raft_consensus.cc:2410] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260810 13:54:51.214418 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:51.215138 13474 raft_consensus.cc:2368] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3.
I20260810 13:54:51.216593 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.219010 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.219908 13474 raft_consensus.cc:2393] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:51.221642 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_c4942145f1414e939000a9b7443c0d29 [id=b88902dec1e34475b3ae470c1c17f777]
I20260810 13:54:51.222374 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fde417598648968b4013c54f0bc854" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.223453 13467 raft_consensus.cc:2468] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:51.223551 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]). Expected version 1 got 0
I20260810 13:54:51.224619 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]). Expected version 1 got 0
I20260810 13:54:51.225337 18185 raft_consensus.cc:493] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:51.226174 12487 catalog_manager.cc:5811] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) does not have the latest schema for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]). Expected version 2 got 0
I20260810 13:54:51.226153 18185 raft_consensus.cc:515] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:51.229660 18185 leader_election.cc:290] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:51.238324 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_18833ebfc83a4c33a1a94a902b97ffaf [id=bb2789ba0fd043c2a44479f23111dcbb]
I20260810 13:54:51.242949 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ec24cdc578624353b8936b6a7add0b7b [id=bf5a9955305343258f05d827cd3e8aec]
I20260810 13:54:51.183408 18142 raft_consensus.cc:493] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.263808 18142 raft_consensus.cc:515] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.244542 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_86dcc5d091024407b7e167806ec593a3 [id=c07ecd00b44e49c9b0a32e8710373471]
I20260810 13:54:51.239064 18043 raft_consensus.cc:2804] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:51.239209 18237 consensus_queue.cc:1048] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260810 13:54:51.267356 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]
I20260810 13:54:51.126284 18058 raft_consensus.cc:2804] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:51.272751 18058 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:51.273161 18058 raft_consensus.cc:3060] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:51.134409 18187 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:51.277285 18187 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.278012 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]
I20260810 13:54:51.279597 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]
I20260810 13:54:51.142091 13638 raft_consensus.cc:359] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.281430 13638 raft_consensus.cc:385] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:51.281679 13638 raft_consensus.cc:740] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:51.282342 13638 consensus_queue.cc:260] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.276136 18142 leader_election.cc:290] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.277472 18038 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:51.283998 13638 ts_tablet_manager.cc:1434] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.188s user 0.002s sys 0.007s
I20260810 13:54:51.284029 18038 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.285326 18187 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:51.126384 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 124727us
I20260810 13:54:51.286835 18038 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.287346 18193 consensus_queue.cc:1048] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:51.287971 18186 consensus_queue.cc:1048] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:51.279114 18016 raft_consensus.cc:493] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:51.289264 18016 raft_consensus.cc:515] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.279752 18043 raft_consensus.cc:697] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:51.291571 18196 consensus_queue.cc:1059] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260810 13:54:51.292793 18059 raft_consensus.cc:3055] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:51.293260 18059 raft_consensus.cc:740] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:51.179463 17896 raft_consensus.cc:515] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.294565 18059 consensus_queue.cc:260] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.296640 18059 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:51.296856 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d21ea3e2ede2490b963de16453e2ad9e [id=c34177c45eda4d9e892e77cc723efbf1]
I20260810 13:54:51.296880 17896 leader_election.cc:290] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.299023 18016 leader_election.cc:290] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.300172 18185 raft_consensus.cc:493] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:51.301246 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]
I20260810 13:54:51.300920 18185 raft_consensus.cc:515] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.300005 18043 consensus_queue.cc:237] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.305188 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_ecb9a9595610488796d066d45e53880a [id=c478e4b06e604e5d8277d76680a5e8f8]
I20260810 13:54:51.304178 18185 leader_election.cc:290] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:51.307224 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]
I20260810 13:54:51.292158 13167 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:51.308436 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_d3680fc81fed4821bc9a2eccc77c35d8 [id=c9181e9bcc3546a5ac7aed13b663deaa]
I20260810 13:54:51.303999 13639 raft_consensus.cc:359] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.319520 13639 raft_consensus.cc:385] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:51.319885 13639 raft_consensus.cc:740] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:51.319808 18058 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.320993 18186 raft_consensus.cc:2804] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:51.321452 18186 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:51.321983 18186 raft_consensus.cc:3060] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:51.323143 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_70a5ed6b181b4db1ae5c28b4b6ca4553 [id=c93d3c57643543cda0f021e1171b3365]
I20260810 13:54:51.323897 13639 consensus_queue.cc:260] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.328859 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e0bb4403efd84db5ac45ace77b9b1a90 [id=c9ebbfcd82964aa798abcf82aaf3e881]
I20260810 13:54:51.330978 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]
I20260810 13:54:51.124621 18249 raft_consensus.cc:515] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.348004 18249 leader_election.cc:290] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:51.358855 18284 log.cc:927] Time spent T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.283s user 0.002s sys 0.000s
I20260810 13:54:51.365365 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f [id=cb722d559fe647018b6c959f6a93a037]
I20260810 13:54:51.369443 13639 ts_tablet_manager.cc:1434] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.183s user 0.008s sys 0.000s
W20260810 13:54:51.370121 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:51.370728 13639 tablet_bootstrap.cc:492] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:51.371986 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.372584 13467 raft_consensus.cc:2468] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:51.382054 13638 tablet_bootstrap.cc:492] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:51.385282 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_8e7dd076a139448aa4a3761732ba38bf [id=cfa9167657134719904b3f604fa43b4c]
W20260810 13:54:51.388949 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 188884us
I20260810 13:54:51.391294 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_890e94f5e2914f4e9e3994ab8bc4075c [id=d08463e955564de898a2af8457a26457]
I20260810 13:54:51.394228 18185 raft_consensus.cc:493] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.395117 18185 raft_consensus.cc:515] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.399060 18185 leader_election.cc:290] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:51.407541 13640 tablet_bootstrap.cc:492] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:51.409381 18292 raft_consensus.cc:493] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.409986 13640 ts_tablet_manager.cc:1403] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.832s user 0.009s sys 0.010s
I20260810 13:54:51.409798 18292 raft_consensus.cc:515] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.411993 18292 leader_election.cc:290] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.417112 18193 raft_consensus.cc:493] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.417989 18193 raft_consensus.cc:515] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.431734 13552 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:51.411403 18309 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.435632 13476 raft_consensus.cc:2468] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:51.435526 18309 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:51.438107 18193 leader_election.cc:290] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.444922 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2da57f87f29a425dbef85d4f4db4bc26 [id=d3522604bed74abf8b357894ca97ddad]
I20260810 13:54:51.449174 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]
I20260810 13:54:51.452107 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_278ad8ed658b48d28fcc3aa3eec747b0 [id=d585e61cb61a4312ba2dbadbcae39899]
I20260810 13:54:51.460872 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:51.461599 13476 raft_consensus.cc:2393] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:51.463579 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]
I20260810 13:54:51.468997 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.470697 18058 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.478483 13638 tablet_bootstrap.cc:654] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:51.481273 18185 raft_consensus.cc:493] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:51.483456 18185 raft_consensus.cc:515] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.484844 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:51.485682 13449 raft_consensus.cc:3060] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:51.486263 13462 raft_consensus.cc:3055] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:51.486824 13462 raft_consensus.cc:740] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:51.489684 13462 consensus_queue.cc:260] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.490818 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:51.491102 13462 raft_consensus.cc:3060] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:51.499603 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.502110 13640 raft_consensus.cc:359] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.502861 13640 raft_consensus.cc:385] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:51.503211 13640 raft_consensus.cc:740] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:51.504638 15216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:51.519282 18185 leader_election.cc:290] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:51.535622 13467 raft_consensus.cc:3055] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:51.536023 13467 raft_consensus.cc:740] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:51.537194 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.538875 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:51.539361 13468 raft_consensus.cc:3060] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:51.539740 13449 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:51.541296 18186 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:51.546197 13468 raft_consensus.cc:2468] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:51.546954 13467 consensus_queue.cc:260] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.548118 13467 raft_consensus.cc:3060] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:51.465792 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 50554.2us
I20260810 13:54:51.561671 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fde417598648968b4013c54f0bc854" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:51.562427 13250 raft_consensus.cc:3060] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:51.565778 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:51.566524 13256 raft_consensus.cc:3060] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:51.569548 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:51.570185 13243 raft_consensus.cc:2468] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:51.539266 18293 raft_consensus.cc:493] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.575361 18293 raft_consensus.cc:515] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.576992 18186 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.579138 18293 leader_election.cc:290] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.581003 13640 consensus_queue.cc:260] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.583177 18185 raft_consensus.cc:493] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.585155 13476 raft_consensus.cc:3055] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:51.585477 13476 raft_consensus.cc:740] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:51.586311 13476 consensus_queue.cc:260] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.588099 13476 raft_consensus.cc:3060] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:51.593420 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.594959 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.583734 18185 raft_consensus.cc:515] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.595824 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.596094 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:51.596257 13474 raft_consensus.cc:3055] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:51.596575 13474 raft_consensus.cc:740] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:51.597355 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.598117 13041 raft_consensus.cc:2393] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:51.597249 13474 consensus_queue.cc:260] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.598031 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:51.598629 13474 raft_consensus.cc:3060] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:51.598608 13027 raft_consensus.cc:3060] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:51.598944 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fde417598648968b4013c54f0bc854" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.599624 13057 raft_consensus.cc:2393] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:51.600025 18315 raft_consensus.cc:493] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.602079 13640 ts_tablet_manager.cc:1434] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.192s user 0.008s sys 0.002s
I20260810 13:54:51.605639 13250 raft_consensus.cc:2468] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:51.607069 18185 leader_election.cc:290] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:51.500501 18309 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:51.518355 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:51.607913 13027 raft_consensus.cc:2468] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:51.608878 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_78c6761fe1e748bf8bea32e7a13650f3 [id=d855b11b57bd447a9285b0945f28219d]
I20260810 13:54:51.608873 18309 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260810 13:54:51.608232 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 90714.4us
I20260810 13:54:51.610158 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 [id=d8943f60b8e3464087c954a42ff795ba]
I20260810 13:54:51.600478 18315 raft_consensus.cc:515] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.612262 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.612571 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:51.612574 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:51.613121 13461 raft_consensus.cc:3060] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:51.613168 13268 raft_consensus.cc:2468] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:51.614509 18315 leader_election.cc:290] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:51.616957 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:51.621529 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:51.622740 13461 raft_consensus.cc:2468] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:51.624213 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0f39d7fa7e4cac9dda6ec101229efd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:51.624773 13461 raft_consensus.cc:2468] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:51.625149 13476 raft_consensus.cc:1275] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260810 13:54:51.645004 18051 raft_consensus.cc:493] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.645601 18051 raft_consensus.cc:515] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.647888 18051 leader_election.cc:290] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.542230 13639 tablet_bootstrap.cc:654] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:51.649498 13640 tablet_bootstrap.cc:492] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:51.653199 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:51.655623 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:51.655956 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:51.678239 13640 tablet_bootstrap.cc:654] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:51.691128 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:51.691854 13245 raft_consensus.cc:2468] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:51.695782 18051 raft_consensus.cc:493] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.696655 18051 raft_consensus.cc:515] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.707144 18043 raft_consensus.cc:493] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.707751 18043 raft_consensus.cc:515] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.708323 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:51.712950 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:51.713764 13449 raft_consensus.cc:3060] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:51.721093 13382 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:51.721930 18315 raft_consensus.cc:2764] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260810 13:54:51.722298 13382 leader_election.cc:304] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:51.722994 18315 raft_consensus.cc:2749] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:51.724481 18315 consensus_queue.cc:1059] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:51.725229 18315 raft_consensus.cc:3055] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:51.725515 18315 raft_consensus.cc:740] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:51.726222 18315 consensus_queue.cc:260] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.727211 18315 raft_consensus.cc:3060] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:51.741595 13167 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:51.746356 18249 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.747259 18249 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.750662 18249 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.752049 18302 raft_consensus.cc:493] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.752915 18302 raft_consensus.cc:515] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:51.761498 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:51.764248 13256 raft_consensus.cc:2468] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:51.767072 13639 tablet_bootstrap.cc:492] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:51.767638 13639 ts_tablet_manager.cc:1403] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.397s user 0.011s sys 0.004s
I20260810 13:54:51.771744 18043 leader_election.cc:290] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.784332 18051 leader_election.cc:290] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.826318 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:51.827169 13041 raft_consensus.cc:2393] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:51.825007 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.828853 13043 raft_consensus.cc:2468] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:51.833417 13035 raft_consensus.cc:1275] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:51.825304 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.822723 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.834662 13057 raft_consensus.cc:2468] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:51.772516 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_8a8233c099eb45dba66c3d0f9bdbe18b [id=d9a327f6557d42bb998964e1d594cb1c]
I20260810 13:54:51.836819 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_2ca2243ef2fe4479bb1edec0046866b9 [id=d9cc836fbee549a08553ed113e483bf6]
I20260810 13:54:51.778487 13638 tablet_bootstrap.cc:492] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:51.827415 13254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:51.832824 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bf6a1f14bb4513b1addc4141b71373" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:51.836809 13245 raft_consensus.cc:1275] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 13:54:51.859623 13638 ts_tablet_manager.cc:1403] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.478s user 0.011s sys 0.008s
I20260810 13:54:51.859689 13254 raft_consensus.cc:2468] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:51.862824 13638 raft_consensus.cc:359] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.863508 13638 raft_consensus.cc:385] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:51.863765 13638 raft_consensus.cc:740] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:51.859652 13261 raft_consensus.cc:2468] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:51.864339 13638 consensus_queue.cc:260] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.867208 13638 ts_tablet_manager.cc:1434] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20260810 13:54:51.876312 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:51.881222 13042 raft_consensus.cc:1275] T 918edf5d7b4f45009c5d476588399d0c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:51.882972 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]). Expected version 1 got 0
I20260810 13:54:51.884905 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]). Expected version 1 got 0
I20260810 13:54:51.886250 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]). Expected version 1 got 0
I20260810 13:54:51.887243 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]). Expected version 1 got 0
I20260810 13:54:51.888087 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]). Expected version 1 got 0
I20260810 13:54:51.887988 13639 raft_consensus.cc:359] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.888732 13639 raft_consensus.cc:385] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:51.889000 13639 raft_consensus.cc:740] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:51.890044 12485 catalog_manager.cc:5719] T b54b73458a4c4201bc3b44259bc12436 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 1 to 2, leader changed from 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3) to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 2 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } }
I20260810 13:54:51.891430 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]). Expected version 1 got 0
I20260810 13:54:51.892210 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]). Expected version 1 got 0
I20260810 13:54:51.892951 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]). Expected version 2 got 0
I20260810 13:54:51.893463 13042 raft_consensus.cc:1275] T 1c68d8171bf847eab37c505640b831fc P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 13:54:51.893615 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]). Expected version 1 got 0
I20260810 13:54:51.894887 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]). Expected version 1 got 0
I20260810 13:54:51.895661 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]). Expected version 2 got 0
I20260810 13:54:51.896206 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]). Expected version 1 got 0
I20260810 13:54:51.898589 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]). Expected version 2 got 0
I20260810 13:54:51.901360 12485 catalog_manager.cc:5719] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 2 to 3, leader changed from 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1) to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 3 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:51.903076 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]). Expected version 1 got 0
I20260810 13:54:51.903674 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]). Expected version 1 got 0
I20260810 13:54:51.816329 13474 raft_consensus.cc:1275] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:51.911120 13638 tablet_bootstrap.cc:492] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:51.918319 13638 tablet_bootstrap.cc:654] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:51.904368 12485 catalog_manager.cc:5719] T a2a2e00edb244e54b04a511dd0e76c9f P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 1 to 2, leader changed from 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1) to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 2 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:51.920111 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]). Expected version 1 got 0
I20260810 13:54:51.920998 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:51.922475 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:51.924464 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:51.844635 13640 tablet_bootstrap.cc:492] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:51.907401 13467 raft_consensus.cc:1275] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260810 13:54:51.928393 18059 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:51.929044 13467 pending_rounds.cc:85] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting all ops after (but not including) 0
I20260810 13:54:51.929272 13467 pending_rounds.cc:107] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260810 13:54:51.929515 13467 raft_consensus.cc:2889] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:51.929160 18059 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.929059 13640 ts_tablet_manager.cc:1403] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.280s user 0.029s sys 0.040s
I20260810 13:54:51.931983 18059 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.933561 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:51.855415 13462 raft_consensus.cc:1275] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:51.934384 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]). Expected version 1 got 0
I20260810 13:54:51.932153 12952 leader_election.cc:304] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:51.935456 12485 catalog_manager.cc:5719] T 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 1 to 2, leader changed from 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3) to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 2 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:51.937870 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.939445 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:51.941572 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]). Expected version 1 got 0
I20260810 13:54:51.940977 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:51.946218 13041 raft_consensus.cc:3060] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:51.889591 13639 consensus_queue.cc:260] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.949609 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:51.952459 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:51.953305 13057 raft_consensus.cc:2468] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:51.954629 13639 ts_tablet_manager.cc:1434] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.187s user 0.006s sys 0.001s
I20260810 13:54:51.956753 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]). Expected version 1 got 0
I20260810 13:54:51.958645 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]). Expected version 1 got 0
I20260810 13:54:51.955679 13639 tablet_bootstrap.cc:492] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:51.959314 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 74024.3us
I20260810 13:54:51.961082 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]). Expected version 1 got 0
I20260810 13:54:51.961522 13382 leader_election.cc:304] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:51.962600 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]). Expected version 1 got 0
I20260810 13:54:51.962378 18313 raft_consensus.cc:2764] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:51.964023 13638 tablet_bootstrap.cc:492] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:51.964547 13638 ts_tablet_manager.cc:1403] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.000s
I20260810 13:54:51.964766 13640 raft_consensus.cc:359] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.965878 13640 raft_consensus.cc:385] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:51.966208 13640 raft_consensus.cc:740] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:51.967000 13640 consensus_queue.cc:260] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.968096 13638 raft_consensus.cc:359] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.967521 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]). Expected version 1 got 0
I20260810 13:54:51.969118 13638 raft_consensus.cc:385] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:51.969396 13638 raft_consensus.cc:740] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:51.970108 13638 consensus_queue.cc:260] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.970597 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]). Expected version 1 got 0
I20260810 13:54:51.972612 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]). Expected version 2 got 0
I20260810 13:54:51.974169 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]). Expected version 1 got 0
I20260810 13:54:51.976184 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]). Expected version 1 got 0
I20260810 13:54:51.981571 12485 catalog_manager.cc:5719] T 30d9e5103fe644f38d969c64182f7cbb P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
W20260810 13:54:51.983017 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:51.984061 18059 raft_consensus.cc:493] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:51.984850 18059 raft_consensus.cc:515] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.985689 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]). Expected version 1 got 0
I20260810 13:54:51.986676 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]). Expected version 1 got 0
I20260810 13:54:51.987308 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]). Expected version 1 got 0
I20260810 13:54:51.988291 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]). Expected version 1 got 0
I20260810 13:54:51.989252 18059 leader_election.cc:290] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:51.994774 12485 catalog_manager.cc:5719] T ebb1392a98aa4af199236e4b4b4ab3c5 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:51.996011 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]). Expected version 1 got 0
I20260810 13:54:51.998605 13638 ts_tablet_manager.cc:1434] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
I20260810 13:54:51.997588 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]). Expected version 1 got 0
I20260810 13:54:52.001928 13638 tablet_bootstrap.cc:492] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:52.001892 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]). Expected version 1 got 0
I20260810 13:54:52.004019 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]). Expected version 1 got 0
I20260810 13:54:52.006104 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]). Expected version 1 got 0
I20260810 13:54:52.008183 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]). Expected version 2 got 0
I20260810 13:54:52.010550 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]). Expected version 3 got 0
I20260810 13:54:52.012789 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]). Expected version 1 got 0
I20260810 13:54:52.012766 13041 raft_consensus.cc:2468] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:52.015306 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]). Expected version 1 got 0
I20260810 13:54:52.017853 18313 raft_consensus.cc:493] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.018847 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]). Expected version 3 got 0
I20260810 13:54:52.018729 18313 raft_consensus.cc:515] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.020375 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]). Expected version 1 got 0
I20260810 13:54:52.022845 18313 leader_election.cc:290] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.023981 18185 consensus_queue.cc:1059] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:52.024649 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]). Expected version 1 got 0
I20260810 13:54:52.025291 18185 consensus_queue.cc:1243] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer 88ed04d733ec447583fc897e233dd4b3 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260810 13:54:52.026486 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]). Expected version 1 got 0
I20260810 13:54:52.026458 18315 raft_consensus.cc:3055] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:52.026989 18315 raft_consensus.cc:740] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:52.028451 18315 consensus_queue.cc:260] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:51.948730 18293 raft_consensus.cc:2804] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:52.033213 18315 raft_consensus.cc:3060] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:51.925781 13449 raft_consensus.cc:2468] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:52.044554 13382 leader_election.cc:304] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:52.045501 13382 leader_election.cc:304] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:52.046228 18185 raft_consensus.cc:2804] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:52.046768 18185 raft_consensus.cc:697] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:52.047768 18185 consensus_queue.cc:237] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.053632 18313 raft_consensus.cc:2804] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:52.059824 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_774345b28c70458f95bf2fcd0e4f42cb [id=dbd65a5203064e10a464df6a3208ae67]
I20260810 13:54:52.061942 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_b6a730448efc42958de4f9513cbd365b [id=dbf489131f724a7b85f1bac4f9e3e614]
I20260810 13:54:52.063737 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_071663fc830e44ef9d25a38fc8301ba7 [id=dd579b0cb2684ce08640cf4f5edae65c]
I20260810 13:54:52.069402 13638 tablet_bootstrap.cc:654] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.071208 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]). Expected version 2 got 0
I20260810 13:54:52.075784 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]). Expected version 1 got 0
I20260810 13:54:51.948428 18016 consensus_queue.cc:1048] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.084s
I20260810 13:54:52.090272 13640 ts_tablet_manager.cc:1434] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.160s user 0.004s sys 0.004s
I20260810 13:54:52.105398 18313 raft_consensus.cc:697] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Leader. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
W20260810 13:54:52.106921 13164 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.3:36001 timed out after 3.080s (SENT) [suppressed 5 similar messages]
I20260810 13:54:52.032857 18293 raft_consensus.cc:493] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:52.113461 18313 consensus_queue.cc:237] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.113238 18293 raft_consensus.cc:3060] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:52.121606 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 76186.6us
I20260810 13:54:52.140131 13638 tablet_bootstrap.cc:492] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:52.140311 13382 leader_election.cc:304] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:52.140707 13638 ts_tablet_manager.cc:1403] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.139s user 0.012s sys 0.009s
I20260810 13:54:52.143709 13638 raft_consensus.cc:359] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.144451 13638 raft_consensus.cc:385] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260810 13:54:52.150452 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:52.160192 18059 raft_consensus.cc:493] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.160832 18059 raft_consensus.cc:515] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.162695 18331 raft_consensus.cc:2804] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:52.163075 18059 leader_election.cc:290] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:52.163188 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 56292.1us
I20260810 13:54:52.163182 18331 raft_consensus.cc:493] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:52.163776 18331 raft_consensus.cc:3060] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:52.167748 13261 raft_consensus.cc:1275] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260810 13:54:52.170221 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0f39d7fa7e4cac9dda6ec101229efd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.170823 13261 raft_consensus.cc:2468] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:52.176420 18185 raft_consensus.cc:493] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.176777 13638 raft_consensus.cc:740] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:52.176986 18185 raft_consensus.cc:515] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.177544 13638 consensus_queue.cc:260] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.179082 18185 leader_election.cc:290] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.179638 13638 ts_tablet_manager.cc:1434] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.039s user 0.005s sys 0.001s
W20260810 13:54:52.179978 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 243976us
I20260810 13:54:52.180655 13638 tablet_bootstrap.cc:492] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:52.180707 12952 leader_election.cc:304] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:52.181813 12952 leader_election.cc:304] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:52.182667 18295 raft_consensus.cc:2804] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:52.183189 18295 raft_consensus.cc:697] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:52.183290 18144 raft_consensus.cc:2804] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:52.184378 18144 raft_consensus.cc:493] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:52.184041 18295 consensus_queue.cc:237] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.184844 18144 raft_consensus.cc:3060] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:52.188697 18059 raft_consensus.cc:493] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:52.087914 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]). Expected version 1 got 0
I20260810 13:54:52.189244 18059 raft_consensus.cc:515] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.189839 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]). Expected version 1 got 0
I20260810 13:54:52.191202 18059 leader_election.cc:290] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.196238 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]). Expected version 2 got 0
I20260810 13:54:52.198395 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb [id=dea63931a83f494b8fa574685cd4ff24]
W20260810 13:54:52.200186 13382 leader_election.cc:343] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:52.200958 13382 leader_election.cc:343] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:52.203120 13638 tablet_bootstrap.cc:654] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.205814 18315 consensus_queue.cc:1048] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:52.206043 18144 raft_consensus.cc:515] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.209142 18331 raft_consensus.cc:515] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.211573 18331 leader_election.cc:290] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:52.215474 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]). Expected version 1 got 0
I20260810 13:54:52.208956 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:52.209439 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:52.216641 13043 raft_consensus.cc:3060] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:52.214617 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0f39d7fa7e4cac9dda6ec101229efd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:52.220063 13040 raft_consensus.cc:2468] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:54:52.222756 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:52.224121 13043 raft_consensus.cc:2468] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:52.224496 12485 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a04498da4fce45bb9a906e75594a023f (table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]). Expected version 1 got 0
I20260810 13:54:52.219027 18302 leader_election.cc:290] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.164585 18293 raft_consensus.cc:515] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.231417 18293 leader_election.cc:290] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.241336 13639 tablet_bootstrap.cc:654] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.248347 18144 leader_election.cc:290] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.250638 12952 leader_election.cc:304] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:52.257556 18016 raft_consensus.cc:2804] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:52.258112 18016 raft_consensus.cc:493] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:52.258600 18016 raft_consensus.cc:3060] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:52.236711 18059 raft_consensus.cc:493] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.270174 18059 raft_consensus.cc:515] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.271979 13256 raft_consensus.cc:1240] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:52.272173 18059 leader_election.cc:290] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.269100 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafed58a5994479e91678ddbe74cd353" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.273619 13261 raft_consensus.cc:2468] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:52.277810 18016 raft_consensus.cc:515] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.282143 13640 tablet_bootstrap.cc:492] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:52.283037 18016 leader_election.cc:290] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:52.311190 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:52.317762 13640 tablet_bootstrap.cc:654] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.319789 13639 tablet_bootstrap.cc:492] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:52.320549 13639 ts_tablet_manager.cc:1403] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.365s user 0.023s sys 0.008s
I20260810 13:54:52.323021 13639 raft_consensus.cc:359] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.323691 13639 raft_consensus.cc:385] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:52.323979 13639 raft_consensus.cc:740] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:52.324627 13639 consensus_queue.cc:260] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.326649 13639 ts_tablet_manager.cc:1434] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260810 13:54:52.334123 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]
I20260810 13:54:52.336090 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_9d81870e910444848f2c714a1b9da18c [id=e506f8a07858485398058c93c553f904]
I20260810 13:54:52.350443 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]
I20260810 13:54:52.359021 13638 tablet_bootstrap.cc:492] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:52.359709 13638 ts_tablet_manager.cc:1403] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.179s user 0.004s sys 0.018s
I20260810 13:54:52.367396 13261 raft_consensus.cc:1240] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:52.368041 13254 raft_consensus.cc:1240] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:52.371351 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.379463 18059 raft_consensus.cc:493] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:52.379956 18059 raft_consensus.cc:515] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.382529 18059 leader_election.cc:290] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.385902 13638 raft_consensus.cc:359] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.386729 13638 raft_consensus.cc:385] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:52.387051 13638 raft_consensus.cc:740] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:52.387940 13638 consensus_queue.cc:260] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.389901 13638 ts_tablet_manager.cc:1434] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.030s user 0.002s sys 0.003s
I20260810 13:54:52.390776 13638 tablet_bootstrap.cc:492] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:52.395905 13638 tablet_bootstrap.cc:654] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.401176 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.413940 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 [id=e992c0b15e564af7a0722b50e969adf4]
I20260810 13:54:52.416204 13640 tablet_bootstrap.cc:492] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:52.416736 13640 ts_tablet_manager.cc:1403] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.135s user 0.012s sys 0.001s
I20260810 13:54:52.419629 13640 raft_consensus.cc:359] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.420419 13640 raft_consensus.cc:385] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:52.420749 13640 raft_consensus.cc:740] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:52.421496 13640 consensus_queue.cc:260] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.429903 13164 leader_election.cc:304] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:52.431463 18059 raft_consensus.cc:2749] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:52.457891 13638 tablet_bootstrap.cc:492] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:52.458509 13638 ts_tablet_manager.cc:1403] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.068s user 0.009s sys 0.003s
I20260810 13:54:52.461165 13638 raft_consensus.cc:359] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.465081 13638 raft_consensus.cc:385] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:52.465365 13638 raft_consensus.cc:740] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:52.465986 13638 consensus_queue.cc:260] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.467401 13638 ts_tablet_manager.cc:1434] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260810 13:54:52.467653 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]
I20260810 13:54:52.468308 13638 tablet_bootstrap.cc:492] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:52.469398 18059 consensus_queue.cc:1048] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:52.471756 18059 consensus_queue.cc:1048] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:52.473719 13164 leader_election.cc:343] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Not found: Tablet not found: ac9e3d3430044a5e85e2d812b7e221f5
I20260810 13:54:52.474146 13164 leader_election.cc:304] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:52.474833 18059 raft_consensus.cc:2749] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:52.478542 18059 consensus_queue.cc:1048] T 98ce3cccca464b938fd45afe292b4ad8 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:52.482141 13640 ts_tablet_manager.cc:1434] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.065s user 0.004s sys 0.001s
I20260810 13:54:52.482220 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_0ccfac1ffac44e3b89c7a180d2477433 [id=ec8b097f455e4160a1aee6dc4866fc98]
I20260810 13:54:52.497530 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_dd910306a7864aeb9230c62730dc3ff4 [id=ee077cecabdd48809356d55acc5604a6]
I20260810 13:54:52.497843 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.498850 13638 tablet_bootstrap.cc:654] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.504160 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_df8743b260984398bf1a3a7c1ee5c4a2 [id=f01c22584d5f4cb696573d09deec464e]
I20260810 13:54:52.509253 18313 raft_consensus.cc:493] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.509811 18313 raft_consensus.cc:515] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.511852 18313 leader_election.cc:290] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.514956 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_4f7895e8b4164093b5fa194d7f828d2a [id=f492b2e2f4cf4205a7d147ddad56af40]
I20260810 13:54:52.520376 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_699797a1320b40709d0bf25947241900 [id=f656a6598c1145d89230d014ba6873a6]
I20260810 13:54:52.528308 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 [id=f6ba2bd3294c4b49a617aee9388a1248]
I20260810 13:54:52.534662 13638 tablet_bootstrap.cc:492] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:52.535101 13638 ts_tablet_manager.cc:1403] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.067s user 0.017s sys 0.005s
I20260810 13:54:52.534382 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_08e421ad9e1d4274b11c4cb314c36201 [id=f7546e5fae5641d0b1747c71934496ec]
I20260810 13:54:52.539630 13638 raft_consensus.cc:359] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.542150 13638 raft_consensus.cc:385] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:52.542894 13638 raft_consensus.cc:740] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:52.543922 13638 consensus_queue.cc:260] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.548043 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_229c64c5f5804f6c8a3047ec7858322b [id=f8aaac66943a4d9d8d2bf15d12a18009]
I20260810 13:54:52.553851 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_356ec0418a38420d8a4e18b2f69682c3 [id=f8b08e6c518647d194daba555502622a]
I20260810 13:54:52.566102 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_e4f9174b7de74fd79642def9d4d0fffd [id=f8ba71724c3f4068a8377462165aee32]
I20260810 13:54:52.573151 13638 ts_tablet_manager.cc:1434] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.038s user 0.006s sys 0.002s
I20260810 13:54:52.575917 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb]
I20260810 13:54:52.585194 18357 raft_consensus.cc:493] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.585778 18357 raft_consensus.cc:515] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.591427 13638 tablet_bootstrap.cc:492] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:52.591840 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_7c263dc08783483d941121c9c3cafdc6 [id=fc5a0ae7f9074bfc89acd9077b020821]
I20260810 13:54:52.593303 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5f9fcf73b953458c909f7910f76e523b [id=fc79cc0a93504726a69ff73e657c6f21]
W20260810 13:54:52.601329 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 64386.7us
I20260810 13:54:52.603144 13164 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:52.603991 18059 raft_consensus.cc:2804] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:52.604348 18059 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:52.604658 18059 raft_consensus.cc:3060] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:52.613917 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_5967f54814d04534b6a591a3bf9a4e8e [id=fd3f5c353a584a6b9d955543762bb8c6]
I20260810 13:54:52.614097 18059 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.615379 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a34a40f45be7413bb670738c4199fa50 [id=fd9cae2939d9440b92dc923383e5839c]
I20260810 13:54:52.617700 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_86221744224e4ac4aeebf77dbd274d49 [id=fe2f8409777b4c94b59159a106e77e7f]
I20260810 13:54:52.618544 13164 leader_election.cc:400] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Vote denied by peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) with higher term. Message: Invalid argument: T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3.
I20260810 13:54:52.618956 13164 leader_election.cc:403] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260810 13:54:52.619554 18356 raft_consensus.cc:2749] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) with higher term. Message: Invalid argument: T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3.
I20260810 13:54:52.621133 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]
I20260810 13:54:52.622968 18357 leader_election.cc:290] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.623121 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_a232694e27574131946f967d95a292f4 [id=fec6784b9d334a72907abaf252914033]
I20260810 13:54:52.630049 16177 catalog_manager.cc:679] Loaded metadata for table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e]
I20260810 13:54:52.636723 13164 leader_election.cc:304] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:52.635412 13638 tablet_bootstrap.cc:654] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.649350 13164 leader_election.cc:304] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:52.658218 18355 raft_consensus.cc:2804] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:52.660463 18355 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.660837 18355 raft_consensus.cc:3060] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:52.665092 18059 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.666376 18059 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.666764 18059 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:52.668809 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:52.655411 18356 raft_consensus.cc:2764] T 82fde417598648968b4013c54f0bc854 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260810 13:54:52.683480 18367 raft_consensus.cc:493] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.684316 13164 leader_election.cc:304] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:52.685786 18356 raft_consensus.cc:2804] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:52.686236 18356 raft_consensus.cc:697] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:52.687258 18356 consensus_queue.cc:237] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.683940 18367 raft_consensus.cc:515] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.690263 18367 leader_election.cc:290] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.692699 18313 raft_consensus.cc:493] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.693151 18313 raft_consensus.cc:515] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.695250 18313 leader_election.cc:290] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.668565 18059 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.697018 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f37f4b2d04f84e119da2743234865baf" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.696327 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.697851 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.698798 18357 raft_consensus.cc:493] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.699287 18357 raft_consensus.cc:515] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.704564 18357 leader_election.cc:290] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.716317 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:52.719208 13037 raft_consensus.cc:1275] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260810 13:54:52.719477 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:52.720037 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:52.670003 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 419189us
I20260810 13:54:52.670936 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:52.714061 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a059240c0f48ee958ef728acfcae92" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:52.714695 18295 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.715500 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:52.716446 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:52.723384 13049 raft_consensus.cc:2468] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:52.723583 13027 raft_consensus.cc:2468] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:52.724463 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:52.724998 18355 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.727284 18355 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.727160 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:52.725348 13050 raft_consensus.cc:2468] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:52.753031 13639 tablet_bootstrap.cc:492] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:52.755826 13638 tablet_bootstrap.cc:492] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
W20260810 13:54:52.755999 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:52.756242 13638 ts_tablet_manager.cc:1403] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.165s user 0.013s sys 0.012s
I20260810 13:54:52.759807 13164 leader_election.cc:304] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:52.760667 13164 leader_election.cc:304] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:52.762574 13640 tablet_bootstrap.cc:492] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:52.743571 13039 raft_consensus.cc:2468] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:52.769688 13638 raft_consensus.cc:359] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.770445 13638 raft_consensus.cc:385] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:52.770750 13638 raft_consensus.cc:740] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:52.771430 18355 raft_consensus.cc:2804] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:52.771907 18355 raft_consensus.cc:697] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:52.757359 18295 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.768656 13640 tablet_bootstrap.cc:654] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.772770 18355 consensus_queue.cc:237] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.774474 18364 raft_consensus.cc:2804] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:52.775523 18295 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.775842 18364 raft_consensus.cc:697] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:52.776638 18364 consensus_queue.cc:237] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.780625 18313 raft_consensus.cc:493] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.781170 18313 raft_consensus.cc:515] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.783143 18313 leader_election.cc:290] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.783754 13164 leader_election.cc:304] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:52.785197 18363 raft_consensus.cc:2804] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:52.785671 18363 raft_consensus.cc:697] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:52.786792 18363 consensus_queue.cc:237] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.790923 13164 leader_election.cc:304] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:52.792528 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.793133 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.795746 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce84eacbab61417a9497f8770b4da511" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.795861 18367 raft_consensus.cc:2804] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:52.789985 13638 consensus_queue.cc:260] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.798719 13638 ts_tablet_manager.cc:1434] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.042s user 0.004s sys 0.004s
I20260810 13:54:52.796280 18367 raft_consensus.cc:493] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:52.800784 18367 raft_consensus.cc:3060] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:52.802239 18059 consensus_queue.cc:1048] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:52.802421 18313 raft_consensus.cc:493] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.802946 18313 raft_consensus.cc:515] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.805045 18313 leader_election.cc:290] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.807555 13167 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:52.809326 18059 raft_consensus.cc:2749] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 13:54:52.813766 18313 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.814376 18313 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.817229 18313 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.817833 13638 tablet_bootstrap.cc:492] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:52.817834 18313 raft_consensus.cc:493] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.818405 18313 raft_consensus.cc:515] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:52.820546 18313 leader_election.cc:290] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.808285 18367 raft_consensus.cc:515] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.834376 18367 leader_election.cc:290] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.837519 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc446acced34a6c87e459c5542c1c77" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.845494 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:52.846488 18363 consensus_queue.cc:1048] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260810 13:54:52.852397 18363 consensus_queue.cc:1048] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:52.853224 18355 consensus_queue.cc:1048] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:52.855559 13164 leader_election.cc:304] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:52.857273 18355 consensus_queue.cc:1048] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:52.870406 18363 raft_consensus.cc:2804] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:52.871043 18363 raft_consensus.cc:697] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:52.872078 18363 consensus_queue.cc:237] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:52.880013 13638 tablet_bootstrap.cc:654] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.883526 18388 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:52.884073 18388 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:52.886467 18388 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:52.888031 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 830 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:52.899930 16177 tablet_loader.cc:96] loaded metadata for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085])
I20260810 13:54:52.904263 13638 tablet_bootstrap.cc:492] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:52.904834 13638 ts_tablet_manager.cc:1403] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.087s user 0.009s sys 0.003s
I20260810 13:54:52.915436 18313 raft_consensus.cc:493] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.881940 13640 tablet_bootstrap.cc:492] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:52.908054 13638 raft_consensus.cc:359] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.917196 13638 raft_consensus.cc:385] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:52.917410 13640 ts_tablet_manager.cc:1403] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.155s user 0.007s sys 0.004s
I20260810 13:54:52.917469 13638 raft_consensus.cc:740] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:52.918135 13638 consensus_queue.cc:260] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.920459 13640 raft_consensus.cc:359] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.921144 13167 leader_election.cc:304] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:52.926162 13639 tablet_bootstrap.cc:654] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.927539 18355 raft_consensus.cc:2749] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:52.927683 13167 leader_election.cc:304] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:52.928412 18367 raft_consensus.cc:2749] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:52.930258 13640 raft_consensus.cc:385] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:52.930615 13640 raft_consensus.cc:740] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:52.893956 18378 raft_consensus.cc:493] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.932017 18378 raft_consensus.cc:515] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.932974 13638 ts_tablet_manager.cc:1434] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.028s user 0.004s sys 0.001s
I20260810 13:54:52.933949 13638 tablet_bootstrap.cc:492] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:52.934296 18378 leader_election.cc:290] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.894860 18386 raft_consensus.cc:493] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.935016 18386 raft_consensus.cc:515] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.937181 18386 leader_election.cc:290] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.939630 16177 tablet_loader.cc:96] loaded metadata for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd])
I20260810 13:54:52.940615 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]). Expected version 1 got 0
W20260810 13:54:52.942749 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:52.916160 18313 raft_consensus.cc:515] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.948163 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]). Expected version 1 got 0
I20260810 13:54:52.948668 18313 leader_election.cc:290] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.951818 13638 tablet_bootstrap.cc:654] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:52.953059 12484 catalog_manager.cc:5719] T 3066b475871c45fdbe585947fd6800c9 P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 1 to 2, leader changed from 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3) to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 2 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:52.956817 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]). Expected version 1 got 0
I20260810 13:54:52.907313 18391 raft_consensus.cc:493] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.851405 18376 raft_consensus.cc:493] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.931346 13640 consensus_queue.cc:260] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.957417 18376 raft_consensus.cc:515] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.958570 13640 ts_tablet_manager.cc:1434] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.041s user 0.005s sys 0.000s
I20260810 13:54:52.959511 13640 tablet_bootstrap.cc:492] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:52.959410 13167 leader_election.cc:304] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:52.959566 18376 leader_election.cc:290] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.890584 18377 raft_consensus.cc:493] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.960527 18377 raft_consensus.cc:515] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:52.962668 18377 leader_election.cc:290] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.963027 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]). Expected version 1 got 0
I20260810 13:54:52.964232 18391 raft_consensus.cc:515] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.965310 18357 raft_consensus.cc:493] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:52.965442 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 189100us
I20260810 13:54:52.965777 18357 raft_consensus.cc:515] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.966086 18364 raft_consensus.cc:2749] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:52.966187 18391 leader_election.cc:290] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:52.967789 18357 leader_election.cc:290] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:52.970606 13639 tablet_bootstrap.cc:492] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:52.971189 13639 ts_tablet_manager.cc:1403] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.250s user 0.007s sys 0.006s
I20260810 13:54:52.975915 13639 raft_consensus.cc:359] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.976579 13639 raft_consensus.cc:385] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:52.978169 13167 leader_election.cc:304] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:52.979655 18059 raft_consensus.cc:2804] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:52.980026 18059 raft_consensus.cc:493] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:52.980180 16177 tablet_loader.cc:96] loaded metadata for tablet 01d42c8476514b71af3ce2fbc12270d0 (table default.Table_9c1a136459f6465d95a6d324db1dd0c3 [id=6ad727ee2da444d8815b59952aeec0ad])
I20260810 13:54:52.980356 18059 raft_consensus.cc:3060] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:52.983623 18364 consensus_queue.cc:1048] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260810 13:54:52.989845 13382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:52.990170 13382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:52.991758 13382 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:52.992556 18394 raft_consensus.cc:493] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.992862 18059 raft_consensus.cc:515] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.995551 13167 leader_election.cc:304] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:52.996277 18355 raft_consensus.cc:2804] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:52.996618 18355 raft_consensus.cc:493] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:52.996987 18355 raft_consensus.cc:3060] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:52.992816 18376 raft_consensus.cc:493] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:52.997593 18376 raft_consensus.cc:515] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:52.999744 18376 leader_election.cc:290] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:52.993000 18386 raft_consensus.cc:493] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:52.993820 18377 raft_consensus.cc:2804] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:53.000494 18377 raft_consensus.cc:493] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.000451 18386 raft_consensus.cc:515] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.000978 18377 raft_consensus.cc:3060] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:53.002446 18386 leader_election.cc:290] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.003077 18394 raft_consensus.cc:515] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.004508 18355 raft_consensus.cc:515] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.006156 16177 tablet_loader.cc:96] loaded metadata for tablet 01f616bc07234fa2a454811e75a1aec2 (table default.Table_2236639ddb2b4f37a3b08c0ec4e1aba6 [id=7a8b712d0b1a4766ab00cd2c4739c311])
I20260810 13:54:53.008227 18394 leader_election.cc:290] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:53.009131 18357 consensus_queue.cc:1048] T 918edf5d7b4f45009c5d476588399d0c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:53.010632 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]). Expected version 1 got 0
I20260810 13:54:53.012586 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]). Expected version 2 got 0
I20260810 13:54:53.013088 18059 leader_election.cc:290] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.014696 16177 tablet_loader.cc:96] loaded metadata for tablet 049416892e964159a06d5817932bbd7a (table default.Table_612d612a32794a8998dd3a19129b79c3 [id=840614d5bd744a82bf94fd2f23a31d69])
I20260810 13:54:53.018725 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]). Expected version 1 got 0
I20260810 13:54:53.019709 13638 tablet_bootstrap.cc:492] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:53.020124 13638 ts_tablet_manager.cc:1403] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.086s user 0.006s sys 0.008s
I20260810 13:54:53.024053 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]). Expected version 1 got 0
I20260810 13:54:53.032246 18295 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.032904 18295 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.034360 13638 raft_consensus.cc:359] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.034935 18295 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.035012 13638 raft_consensus.cc:385] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:53.035234 16177 tablet_loader.cc:96] loaded metadata for tablet 058562eef38d46a8a3a39e3ce5425dd6 (table default.Table_9d81870e910444848f2c714a1b9da18c [id=e506f8a07858485398058c93c553f904])
I20260810 13:54:53.035247 13638 raft_consensus.cc:740] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:53.035938 13638 consensus_queue.cc:260] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.039268 13638 ts_tablet_manager.cc:1434] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20260810 13:54:53.040517 13640 tablet_bootstrap.cc:654] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:53.041661 18357 consensus_queue.cc:1048] T 1c68d8171bf847eab37c505640b831fc P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:53.042817 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]). Expected version 1 got 0
I20260810 13:54:53.044473 13167 leader_election.cc:304] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.045188 18357 raft_consensus.cc:2749] T a67cf93d78254f15a1b89c99048110c8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:53.045372 18355 leader_election.cc:290] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.045849 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]). Expected version 2 got 0
W20260810 13:54:53.050701 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 57999.4us
I20260810 13:54:53.051473 13382 leader_election.cc:304] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.052341 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]). Expected version 1 got 0
I20260810 13:54:53.053081 16177 tablet_loader.cc:96] loaded metadata for tablet 07405ca45a9c4575bc653c2dd95fea6b (table default.Table_356ec0418a38420d8a4e18b2f69682c3 [id=f8b08e6c518647d194daba555502622a])
I20260810 13:54:53.053222 13382 leader_election.cc:304] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.053951 18394 raft_consensus.cc:2749] T a008d393fcdf441eb17dbe0c1fa2393f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:53.054308 13382 leader_election.cc:304] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.054893 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]). Expected version 2 got 0
I20260810 13:54:53.057466 13638 tablet_bootstrap.cc:492] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:53.058853 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]). Expected version 1 got 0
I20260810 13:54:53.060163 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:53.062176 12952 leader_election.cc:304] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.063078 18295 raft_consensus.cc:2804] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:53.063256 12952 leader_election.cc:304] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.063494 18295 raft_consensus.cc:493] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.063804 18295 raft_consensus.cc:3060] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:53.064164 12952 leader_election.cc:304] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:52.976893 13639 raft_consensus.cc:740] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:53.065438 13639 consensus_queue.cc:260] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.067226 13639 ts_tablet_manager.cc:1434] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.096s user 0.003s sys 0.003s
I20260810 13:54:53.067124 18292 raft_consensus.cc:2804] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:53.068885 18016 consensus_queue.cc:1048] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:53.071292 16177 tablet_loader.cc:96] loaded metadata for tablet 094a3448b54c409281c31813e60dcb7f (table default.Table_ad168069ee724269847a89933edb81f2 [id=3355c884d0cd4593bdc0a5e79fd2add6])
I20260810 13:54:53.074733 16177 tablet_loader.cc:96] loaded metadata for tablet 09d572e2dc764d259df43026f49e0831 (table default.Table_a7e503c1cea04f7dbe5a53f7237e60c0 [id=7b407001f6d54bd2929f1f0d141b065e])
I20260810 13:54:53.083753 16177 tablet_loader.cc:96] loaded metadata for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c])
I20260810 13:54:53.084851 13638 tablet_bootstrap.cc:654] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:53.089226 18016 raft_consensus.cc:2804] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:53.089687 18016 raft_consensus.cc:493] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.090042 18016 raft_consensus.cc:3060] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:53.091152 16177 tablet_loader.cc:96] loaded metadata for tablet 0d147e624d4243b9b330c874e0f27f6c (table default.Table_213c40da56b549d3bb97fccaa8f872cd [id=8bb576bce14b4fc3b1848496c6081841])
I20260810 13:54:53.090047 13639 tablet_bootstrap.cc:492] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:53.086825 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]). Expected version 1 got 0
I20260810 13:54:53.105749 16177 tablet_loader.cc:96] loaded metadata for tablet 1122dcf7bcea4654bf29ff01fc4a350d (table default.Table_456a959279c440c9bbedd036b78afab9 [id=fbcec0863c7a488f8298fb2b486bfefb])
I20260810 13:54:53.109635 18371 consensus_queue.cc:1048] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:53.117177 13167 leader_election.cc:304] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:53.117993 18357 raft_consensus.cc:2804] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:53.118373 18357 raft_consensus.cc:493] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.118713 18357 raft_consensus.cc:3060] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:53.122048 16177 tablet_loader.cc:96] loaded metadata for tablet 121d7abf368a4cf99fd045b8c8ba4b69 (table default.Table_1efc108552b047538e81a19f9d985680 [id=b0c2c10c7abb49c0b0026662e9edba2a])
I20260810 13:54:53.124792 16177 tablet_loader.cc:96] loaded metadata for tablet 146ff83104d247cfa565cec8579ca00f (table default.Table_7cf74351dd314634a7a8ca1b1a24302b [id=884f2bca73394b0b97902104a5b68976])
I20260810 13:54:53.125269 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:53.127223 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:53.133208 18395 raft_consensus.cc:2749] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:53.133864 18395 raft_consensus.cc:2749] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:53.134982 18394 raft_consensus.cc:493] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.135668 18392 raft_consensus.cc:493] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.135429 18394 raft_consensus.cc:515] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.136104 18392 raft_consensus.cc:515] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.137392 18394 leader_election.cc:290] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:53.137949 18392 leader_election.cc:290] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.138034 18386 raft_consensus.cc:493] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.138399 18392 raft_consensus.cc:493] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.138471 18386 raft_consensus.cc:515] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.140354 18386 leader_election.cc:290] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.140715 18394 raft_consensus.cc:493] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.141129 18394 raft_consensus.cc:515] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:53.143149 18394 leader_election.cc:290] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.143882 18386 raft_consensus.cc:493] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.144821 18378 raft_consensus.cc:493] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.144869 18386 raft_consensus.cc:515] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.145326 18378 raft_consensus.cc:515] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:53.145941 18295 raft_consensus.cc:515] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.146899 18386 leader_election.cc:290] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.147037 18378 leader_election.cc:290] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.147585 18391 raft_consensus.cc:493] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
W20260810 13:54:53.148108 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:53.148442 18295 leader_election.cc:290] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.144338 18376 raft_consensus.cc:493] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.148079 18391 raft_consensus.cc:515] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.148468 18378 raft_consensus.cc:493] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.149029 18378 raft_consensus.cc:515] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.150209 16177 tablet_loader.cc:96] loaded metadata for tablet 14a19e0d12cf4582b0b5ec5c2fa25f49 (table default.Table_23cb4b4f896b48b1adc91079a7382c5c [id=a32ace7c7992464c8a5ef3f8169906b6])
I20260810 13:54:53.151046 18378 leader_election.cc:290] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.149000 18376 raft_consensus.cc:515] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.152609 18376 leader_election.cc:290] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.153232 18376 raft_consensus.cc:493] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.153635 18376 raft_consensus.cc:515] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.155370 18376 leader_election.cc:290] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.157826 18391 leader_election.cc:290] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.138799 18392 raft_consensus.cc:515] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.159778 18392 leader_election.cc:290] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.148891 12952 leader_election.cc:304] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.148365 18357 raft_consensus.cc:515] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.162629 18404 raft_consensus.cc:2804] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:53.163010 18404 raft_consensus.cc:493] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.163308 18404 raft_consensus.cc:3060] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:53.151250 13639 tablet_bootstrap.cc:654] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:53.166478 16177 tablet_loader.cc:96] loaded metadata for tablet 14e68b57d7fb40cd8430144733749c21 (table default.Table_40e69780eeb744aa8a192c8623bc7d4b [id=2ef48298f4404224bb44136ff71befd8])
I20260810 13:54:53.155478 18292 raft_consensus.cc:697] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:53.168076 18392 raft_consensus.cc:493] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.168159 13167 leader_election.cc:304] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters: 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:53.168051 18292 consensus_queue.cc:237] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.168562 18392 raft_consensus.cc:515] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.170338 18357 leader_election.cc:290] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.170794 18392 leader_election.cc:290] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:53.172626 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 118364us
I20260810 13:54:53.173493 13382 leader_election.cc:304] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.174471 16177 tablet_loader.cc:96] loaded metadata for tablet 15149232bd7645be840c1d223a829eb4 (table default.Table_a49a2f11e36d4162bc5847bacee456e7 [id=8aad892ad49f4c0aa7681d88843d3561])
I20260810 13:54:53.175369 18371 consensus_queue.cc:1059] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:53.179602 18273 raft_consensus.cc:3055] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:53.180063 18273 raft_consensus.cc:740] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:53.181229 18273 consensus_queue.cc:260] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.182736 18273 raft_consensus.cc:3060] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:53.187500 16177 tablet_loader.cc:96] loaded metadata for tablet 15857ead4a9a48c49b4acea92d4bba60 (table default.Table_2da57f87f29a425dbef85d4f4db4bc26 [id=d3522604bed74abf8b357894ca97ddad])
I20260810 13:54:53.190215 18364 raft_consensus.cc:2804] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:53.190768 18364 raft_consensus.cc:697] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:53.191704 18364 consensus_queue.cc:237] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.194145 16177 tablet_loader.cc:96] loaded metadata for tablet 1946995eb9354e19916f31e1f8e46996 (table default.Table_b6a730448efc42958de4f9513cbd365b [id=dbf489131f724a7b85f1bac4f9e3e614])
I20260810 13:54:53.198939 16177 tablet_loader.cc:96] loaded metadata for tablet 1956edd131c14f93994b5d9f2a7420b1 (table default.Table_72e9522a295642b28aa17f724e010d9e [id=143a3ec1ee2d409fa9de19aa1c8c8ab3])
I20260810 13:54:53.187321 12952 leader_election.cc:304] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.203037 13261 raft_consensus.cc:1275] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:53.205140 13268 raft_consensus.cc:1240] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:53.205327 13261 raft_consensus.cc:1240] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:53.206284 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:53.206908 18407 raft_consensus.cc:2804] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:53.207810 18407 raft_consensus.cc:493] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.208226 18407 raft_consensus.cc:3060] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:53.213444 16177 tablet_loader.cc:96] loaded metadata for tablet 19fe94b1d72b4bb29f0154f58c9fa43f (table default.Table_c7b5e070007b4fab95eda8b85768c899 [id=0eec168000a24c91a30ac617c2f391f9])
I20260810 13:54:53.213343 18371 consensus_queue.cc:1048] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:53.214723 18377 raft_consensus.cc:515] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.216018 18371 raft_consensus.cc:493] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.158919 18016 raft_consensus.cc:515] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.218374 18016 leader_election.cc:290] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.220288 16177 tablet_loader.cc:96] loaded metadata for tablet 1a0f39d7fa7e4cac9dda6ec101229efd (table default.Table_131ccf6f50394a4facf6e622d5449b17 [id=b559d903254d433989a2deb00eb27361])
I20260810 13:54:53.230597 13261 raft_consensus.cc:1275] T d1ec72a86a08452fb8b390b62f8c6dec P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 1. (index mismatch)
I20260810 13:54:53.231237 13268 raft_consensus.cc:1275] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260810 13:54:53.235896 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:53.236753 18292 raft_consensus.cc:493] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.237640 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:53.237413 18292 raft_consensus.cc:515] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.238214 13268 raft_consensus.cc:3060] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:53.239811 18292 leader_election.cc:290] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.236426 13245 raft_consensus.cc:3060] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:53.149514 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:53.244781 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:53.245592 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]). Expected version 1 got 0
I20260810 13:54:53.246507 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:53.247257 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]). Expected version 1 got 0
I20260810 13:54:53.251868 13245 raft_consensus.cc:2468] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:53.259456 18377 leader_election.cc:290] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.216538 18371 raft_consensus.cc:515] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.271170 18371 leader_election.cc:290] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.254141 13268 raft_consensus.cc:2468] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:53.256166 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:53.263782 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:53.264249 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:53.301328 16177 tablet_loader.cc:96] loaded metadata for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e])
W20260810 13:54:53.222325 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 48897.3us
I20260810 13:54:53.222767 18313 raft_consensus.cc:493] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.223131 18376 raft_consensus.cc:493] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.223503 18378 raft_consensus.cc:493] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.224094 18394 raft_consensus.cc:493] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.316632 16177 tablet_loader.cc:96] loaded metadata for tablet 1a7fb49228fa4a0c8d28a4ed0a4ae180 (table default.Table_2ca2243ef2fe4479bb1edec0046866b9 [id=d9cc836fbee549a08553ed113e483bf6])
I20260810 13:54:53.318087 16177 tablet_loader.cc:96] loaded metadata for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6])
I20260810 13:54:53.320089 16177 tablet_loader.cc:96] loaded metadata for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc])
I20260810 13:54:53.224094 18404 raft_consensus.cc:515] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.336164 18404 leader_election.cc:290] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.343391 13039 raft_consensus.cc:1240] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:53.346113 16177 tablet_loader.cc:96] loaded metadata for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e])
I20260810 13:54:53.348654 13039 raft_consensus.cc:1240] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:53.224520 18391 raft_consensus.cc:2749] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:53.236981 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:53.249358 18395 raft_consensus.cc:493] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.218910 13640 tablet_bootstrap.cc:492] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:53.355346 13640 ts_tablet_manager.cc:1403] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.396s user 0.018s sys 0.015s
I20260810 13:54:53.306181 13382 leader_election.cc:304] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.358008 18386 raft_consensus.cc:493] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.360428 18386 raft_consensus.cc:515] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.362564 18386 leader_election.cc:290] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.356361 18313 raft_consensus.cc:515] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:53.364502 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 58420.3us
I20260810 13:54:53.356271 18376 raft_consensus.cc:515] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.365876 18386 raft_consensus.cc:2749] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:53.366303 18376 leader_election.cc:290] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:53.356133 18378 raft_consensus.cc:515] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:53.321094 18407 raft_consensus.cc:515] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.370579 18407 leader_election.cc:290] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.368414 18378 leader_election.cc:290] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.357110 18394 raft_consensus.cc:515] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:53.378733 18394 leader_election.cc:290] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.359419 18395 raft_consensus.cc:515] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.380676 18395 leader_election.cc:290] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.372920 18313 leader_election.cc:290] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.363190 18391 raft_consensus.cc:493] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:53.376091 13640 raft_consensus.cc:359] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.383003 13640 raft_consensus.cc:385] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:53.383435 13640 raft_consensus.cc:740] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:53.387837 13639 tablet_bootstrap.cc:492] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:53.388302 13639 ts_tablet_manager.cc:1403] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.299s user 0.008s sys 0.004s
I20260810 13:54:53.391860 13639 raft_consensus.cc:359] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.392772 13639 raft_consensus.cc:385] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:53.393407 13639 raft_consensus.cc:740] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:53.394050 13639 consensus_queue.cc:260] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.395612 13639 ts_tablet_manager.cc:1434] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260810 13:54:53.395448 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.396907 13639 tablet_bootstrap.cc:492] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:53.254151 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]). Expected version 1 got 0
I20260810 13:54:53.399050 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]). Expected version 1 got 0
I20260810 13:54:53.400087 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]). Expected version 1 got 0
I20260810 13:54:53.413880 13039 raft_consensus.cc:1240] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:53.413870 18415 raft_consensus.cc:493] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:53.416987 18415 raft_consensus.cc:515] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.419291 18415 leader_election.cc:290] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.420531 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d891e763a1854b6a8bda1071448fd8e0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.424508 16177 tablet_loader.cc:96] loaded metadata for tablet 1c68d8171bf847eab37c505640b831fc (table default.Table_df8743b260984398bf1a3a7c1ee5c4a2 [id=f01c22584d5f4cb696573d09deec464e])
W20260810 13:54:53.426684 15130 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.539s (SENT)
I20260810 13:54:53.429085 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.430315 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f37f4b2d04f84e119da2743234865baf" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.430373 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.430511 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.434551 16177 tablet_loader.cc:96] loaded metadata for tablet 1ee6e694366543328526313d7018b5db (table default.Table_f8b9ea9b553b4effb76fe1c6046b7592 [id=7704635a3bb14b59b8e8ab5a59b4daa9])
W20260810 13:54:53.438185 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:53.439728 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]). Expected version 1 got 0
I20260810 13:54:53.441490 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]). Expected version 1 got 0
I20260810 13:54:53.449697 16177 tablet_loader.cc:96] loaded metadata for tablet 213e54b67ee94d299345a3d1eabc9ae6 (table default.Table_88dee97116de4d0dac8a7af552b06f14 [id=0b34e431b94a4d24ad26858d4630420f])
I20260810 13:54:53.451799 13639 tablet_bootstrap.cc:654] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:53.464578 16177 tablet_loader.cc:96] loaded metadata for tablet 21e31826c3a94981b6a47bf9feee9f83 (table default.Table_d21ea3e2ede2490b963de16453e2ad9e [id=c34177c45eda4d9e892e77cc723efbf1])
I20260810 13:54:53.373484 13382 leader_election.cc:304] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.384378 13640 consensus_queue.cc:260] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.392915 18391 raft_consensus.cc:515] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.469868 18391 leader_election.cc:290] T 69ecda19e4f143c99654aff6058ad8bb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.470141 18364 raft_consensus.cc:493] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.470790 18364 raft_consensus.cc:515] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.471202 18420 raft_consensus.cc:493] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:53.473107 18364 leader_election.cc:290] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.473863 13261 raft_consensus.cc:2393] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:53.474781 16177 tablet_loader.cc:96] loaded metadata for tablet 22d96232e31f46e791d739643ffb9257 (table default.Table_7cb516aef022435db65d62c3231eba12 [id=ad025a7f2cba416c84c364ecb2d3e607])
I20260810 13:54:53.472400 18420 raft_consensus.cc:515] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.477038 18420 leader_election.cc:290] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.477329 18357 raft_consensus.cc:493] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.477809 18357 raft_consensus.cc:515] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.478590 16177 tablet_loader.cc:96] loaded metadata for tablet 26ca6ce1b13942f4af59ea1d38fd395c (table default.Table_734de53e103d480c93e2779ef687142e [id=23152d9b944747f89cd06ee3a569b5b3])
I20260810 13:54:53.479647 18357 leader_election.cc:290] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.480171 13268 raft_consensus.cc:1275] T 5f5cf3efa54b4344b04a87a87509d1f6 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 13:54:53.482720 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3119d63857480294dcb68ed0451bc0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:53.486133 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a373308fa4b039e8331d9a0a90d16" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:53.486514 13260 raft_consensus.cc:2468] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:53.486696 13268 raft_consensus.cc:2468] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:53.481328 13250 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 3.
I20260810 13:54:53.482795 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bf6a1f14bb4513b1addc4141b71373" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:53.487743 13252 raft_consensus.cc:3060] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:53.491871 13250 raft_consensus.cc:1240] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:53.493631 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce84eacbab61417a9497f8770b4da511" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.494457 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.496075 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0f39d7fa7e4cac9dda6ec101229efd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:53.496765 13260 raft_consensus.cc:2393] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:53.498042 13252 raft_consensus.cc:2468] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:53.470381 18392 raft_consensus.cc:2749] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:53.472364 13640 ts_tablet_manager.cc:1434] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.117s user 0.009s sys 0.010s
W20260810 13:54:53.472877 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 99451.6us
I20260810 13:54:53.481690 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:53.505160 13256 raft_consensus.cc:2393] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:53.502138 18424 raft_consensus.cc:493] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.506048 18424 raft_consensus.cc:515] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.485335 13638 tablet_bootstrap.cc:492] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
W20260810 13:54:53.509029 13382 leader_election.cc:343] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:53.509820 13382 leader_election.cc:304] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.510766 18357 raft_consensus.cc:493] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.511879 18357 raft_consensus.cc:515] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.513528 18356 raft_consensus.cc:493] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.513551 18424 leader_election.cc:290] T 213e54b67ee94d299345a3d1eabc9ae6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.513988 18356 raft_consensus.cc:515] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.515899 18392 raft_consensus.cc:2749] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:53.515763 18357 leader_election.cc:290] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.515857 18356 leader_election.cc:290] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.517050 18392 consensus_queue.cc:1048] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:53.519836 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc446acced34a6c87e459c5542c1c77" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.520601 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.508244 13638 ts_tablet_manager.cc:1403] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.451s user 0.010s sys 0.013s
I20260810 13:54:53.526556 18356 raft_consensus.cc:493] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:53.527079 18356 raft_consensus.cc:515] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:53.521379 13382 leader_election.cc:343] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:53.532920 13382 leader_election.cc:304] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.537724 18392 raft_consensus.cc:2749] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:53.539690 16177 tablet_loader.cc:96] loaded metadata for tablet 27036a9813b9404aa174f7af9d6e51e0 (table default.Table_e6a8052e39bb4d1fadce9b7ed7e72ac1 [id=e992c0b15e564af7a0722b50e969adf4])
I20260810 13:54:53.457286 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]). Expected version 1 got 0
I20260810 13:54:53.541251 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]). Expected version 1 got 0
I20260810 13:54:53.541606 16177 tablet_loader.cc:96] loaded metadata for tablet 27649cff0c5f4e6783e8a2f0a1f847ae (table default.Table_1668535b5107458a842c0def2c55461f [id=0cdd1449d5734d559f49933deef6bb19])
I20260810 13:54:53.543011 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]). Expected version 2 got 0
I20260810 13:54:53.543385 13382 leader_election.cc:304] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.543926 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]). Expected version 1 got 0
I20260810 13:54:53.545063 18392 raft_consensus.cc:2749] T c0e45366954740528fb37c7cfdc639c6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:53.546599 16177 tablet_loader.cc:96] loaded metadata for tablet 288debea4aa045d1898483cde1d4d3b1 (table default.Table_a8f5484f0ff14287be783696e6d8525d [id=06f3859cd5e748a3800b66ecf0a93c28])
I20260810 13:54:53.548132 18392 consensus_queue.cc:1048] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:53.549861 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.550303 13382 leader_election.cc:304] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:53.550519 13049 raft_consensus.cc:2468] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:53.553512 18420 consensus_queue.cc:1048] T cb4dcad38c1a4269b4740a8e5247a867 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:53.556627 16177 tablet_loader.cc:96] loaded metadata for tablet 29ace970eee349d6b669b5c531f91c8b (table default.Table_5b39c1bb4b614f97ab6eb4d521628013 [id=b69ad2b0c70949b98192ae056eb2cab0])
I20260810 13:54:53.557349 18392 raft_consensus.cc:2749] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:53.563339 16177 tablet_loader.cc:96] loaded metadata for tablet 2b88b4fa155d4364b4fa1b2c724755bb (table default.Table_856a1bf64ef9498890c9b6d98edcc8ad [id=60b4f30b701344d79b0c64b4e8127dbd])
I20260810 13:54:53.563469 13639 tablet_bootstrap.cc:492] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:53.563974 13639 ts_tablet_manager.cc:1403] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.167s user 0.008s sys 0.003s
I20260810 13:54:53.564491 18392 consensus_queue.cc:1059] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:53.565466 18424 raft_consensus.cc:3055] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:53.566069 18424 raft_consensus.cc:740] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:53.566886 18424 consensus_queue.cc:260] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.568495 18424 raft_consensus.cc:3060] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:53.577427 13640 tablet_bootstrap.cc:492] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:53.595124 13640 tablet_bootstrap.cc:654] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:53.596266 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]). Expected version 1 got 0
I20260810 13:54:53.597878 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]). Expected version 1 got 0
I20260810 13:54:53.599910 13343 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:53.600821 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]). Expected version 1 got 0
I20260810 13:54:53.609031 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]). Expected version 1 got 0
W20260810 13:54:53.609328 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 48258.8us
W20260810 13:54:53.610562 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 52548.1us
I20260810 13:54:53.610416 18392 consensus_queue.cc:1048] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260810 13:54:53.612236 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 50610.1us
I20260810 13:54:53.614120 18420 consensus_queue.cc:1048] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:53.616801 18420 consensus_queue.cc:1059] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:53.558476 18356 leader_election.cc:290] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.617904 18420 consensus_queue.cc:1243] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer 218e946161f64d1d92427684ac15e4fb log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260810 13:54:53.617877 18392 consensus_queue.cc:1048] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:53.618467 18415 raft_consensus.cc:3055] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:53.618791 18415 raft_consensus.cc:740] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:53.619593 18415 consensus_queue.cc:260] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.620283 16177 tablet_loader.cc:96] loaded metadata for tablet 2be6cc62ea1e4299b8b243b70700d064 (table default.Table_def78e8fb6b74845bf2ef24bcef6691b [id=42af124147fe44c1875a9803af2e97a9])
I20260810 13:54:53.623624 18415 raft_consensus.cc:3060] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:53.629961 18420 consensus_queue.cc:1059] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 13:54:53.631065 18420 consensus_queue.cc:1243] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer 218e946161f64d1d92427684ac15e4fb log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260810 13:54:53.631547 18273 raft_consensus.cc:3055] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:53.631893 18273 raft_consensus.cc:740] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:53.632716 18273 consensus_queue.cc:260] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:53.641983 18273 raft_consensus.cc:3060] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:53.658480 18392 consensus_queue.cc:1048] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:53.660033 13639 raft_consensus.cc:359] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:53.661178 13382 leader_election.cc:343] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:53.661665 13639 raft_consensus.cc:385] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:53.662019 13639 raft_consensus.cc:740] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
W20260810 13:54:53.662922 13382 leader_election.cc:343] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:53.663643 13382 leader_election.cc:343] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:53.673636 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 62357.4us
I20260810 13:54:53.683336 13640 tablet_bootstrap.cc:492] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:53.683903 13640 ts_tablet_manager.cc:1403] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.107s user 0.012s sys 0.029s
I20260810 13:54:53.690362 18407 consensus_queue.cc:1048] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:53.691572 18407 consensus_queue.cc:1048] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260810 13:54:53.708456 18392 raft_consensus.cc:493] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:53.709015 18392 raft_consensus.cc:515] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.709079 13638 raft_consensus.cc:359] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.709870 13638 raft_consensus.cc:385] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:53.710173 13638 raft_consensus.cc:740] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:53.710924 18392 leader_election.cc:290] T f764e91bb2c94bc3be425b65323764cb P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.710727 13638 consensus_queue.cc:260] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.662751 13639 consensus_queue.cc:260] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.714656 18295 consensus_queue.cc:1048] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:53.624605 16177 tablet_loader.cc:96] loaded metadata for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf])
I20260810 13:54:53.718425 13639 ts_tablet_manager.cc:1434] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.154s user 0.001s sys 0.005s
I20260810 13:54:53.725662 13639 tablet_bootstrap.cc:492] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:53.726380 13167 leader_election.cc:304] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.727030 18447 consensus_queue.cc:1048] T da664a1596554ee3890f58f0c54521a6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 13:54:53.730569 13640 raft_consensus.cc:359] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.727866 18399 raft_consensus.cc:2804] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:53.733866 18399 raft_consensus.cc:493] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.734302 18399 raft_consensus.cc:3060] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:53.737394 16177 tablet_loader.cc:96] loaded metadata for tablet 2e5616cea29148a49ac6db261351f460 (table default.Table_5967f54814d04534b6a591a3bf9a4e8e [id=fd3f5c353a584a6b9d955543762bb8c6])
I20260810 13:54:53.721192 12952 leader_election.cc:304] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.741240 18295 raft_consensus.cc:2804] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:53.741802 18295 raft_consensus.cc:697] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:53.742111 16177 tablet_loader.cc:96] loaded metadata for tablet 2e5ad84fe2604dd2959768db31f66e7c (table default.Table_e5c2c6ef6f4646a88704beb1cd464c47 [id=5dfc52d4cd2c46c784bb2d99146b4dd0])
I20260810 13:54:53.743274 16177 tablet_loader.cc:96] loaded metadata for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03])
I20260810 13:54:53.742841 18295 consensus_queue.cc:237] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.744349 16177 tablet_loader.cc:96] loaded metadata for tablet 3066b475871c45fdbe585947fd6800c9 (table default.Table_6c443ac64289437d8c7dcf5ea44469dd [id=9c99ad2364cc45fba0746cbae06deeeb])
I20260810 13:54:53.752483 12952 leader_election.cc:304] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.753904 18273 raft_consensus.cc:2804] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:53.754200 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]). Expected version 1 got 0
I20260810 13:54:53.755048 18273 raft_consensus.cc:697] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:53.755952 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]). Expected version 1 got 0
I20260810 13:54:53.755923 18273 consensus_queue.cc:237] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.737164 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:53.764830 13640 raft_consensus.cc:385] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:53.765149 13640 raft_consensus.cc:740] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:53.765372 13449 raft_consensus.cc:2393] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 3: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:53.745172 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.749913 13467 raft_consensus.cc:1275] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:53.751204 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.765834 13640 consensus_queue.cc:260] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.754112 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:53.767035 13474 raft_consensus.cc:3060] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:53.767362 13640 ts_tablet_manager.cc:1434] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.083s user 0.003s sys 0.000s
I20260810 13:54:53.778273 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafed58a5994479e91678ddbe74cd353" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:53.778554 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:53.778846 13244 raft_consensus.cc:3060] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:53.788635 13124 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:53.794507 13244 raft_consensus.cc:2468] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:53.728000 13167 leader_election.cc:304] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:53.797731 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 69803us
I20260810 13:54:53.799602 13167 leader_election.cc:304] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.800360 18356 raft_consensus.cc:2804] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:53.800805 18356 raft_consensus.cc:493] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:53.801204 16177 tablet_loader.cc:96] loaded metadata for tablet 30676a11ab60455aa4ccd22347beb80e (table default.Table_d8ab37a103a5426b81dcf295239ec9af [id=b7130fcdfcf54b76861fd9c87559beeb])
I20260810 13:54:53.801256 18356 raft_consensus.cc:3060] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:53.803421 18443 raft_consensus.cc:2804] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:53.804095 18443 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.804631 18443 raft_consensus.cc:3060] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:53.789350 18407 consensus_queue.cc:1048] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:53.827255 13638 ts_tablet_manager.cc:1434] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.304s user 0.008s sys 0.002s
W20260810 13:54:53.802424 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:53.828271 13638 tablet_bootstrap.cc:492] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:53.761090 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.829813 18443 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.759431 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.773263 13474 raft_consensus.cc:2468] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:53.796970 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.799155 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fde417598648968b4013c54f0bc854" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:53.831744 13467 raft_consensus.cc:3060] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:53.822500 12952 leader_election.cc:304] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.832255 18443 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.835964 12952 leader_election.cc:304] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.817198 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:53.837251 13477 raft_consensus.cc:2393] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:53.840122 13467 raft_consensus.cc:2468] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:53.841903 13639 tablet_bootstrap.cc:654] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:53.845111 18295 raft_consensus.cc:2804] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:53.845510 18295 raft_consensus.cc:493] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.845849 18295 raft_consensus.cc:3060] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:53.850868 16177 tablet_loader.cc:96] loaded metadata for tablet 30a5adc9446543eb91f5a1c0f0859c31 (table default.Table_b33cb4c7a80141c49d306885213f30a9 [id=7dff57e81c064728a8160d5c02c11de5])
I20260810 13:54:53.852615 16177 tablet_loader.cc:96] loaded metadata for tablet 30d9e5103fe644f38d969c64182f7cbb (table default.Table_215968e7ab2540ab8a35960795941543 [id=9bac646089c94e54b68ff14ce2a50793])
W20260810 13:54:53.855428 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 55897.5us
I20260810 13:54:53.855613 18295 raft_consensus.cc:515] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.857869 13167 leader_election.cc:304] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.858815 18439 raft_consensus.cc:2804] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:53.859164 18439 raft_consensus.cc:493] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.859498 18439 raft_consensus.cc:3060] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:53.860985 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.865465 18410 raft_consensus.cc:2804] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:53.865599 13467 raft_consensus.cc:1275] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260810 13:54:53.865828 18410 raft_consensus.cc:493] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.865973 13467 pending_rounds.cc:85] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting all ops after (but not including) 0
I20260810 13:54:53.866139 18410 raft_consensus.cc:3060] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:53.866223 13467 pending_rounds.cc:107] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260810 13:54:53.867226 13467 raft_consensus.cc:2889] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:53.870210 18439 raft_consensus.cc:515] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.871348 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.871909 13477 raft_consensus.cc:1275] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260810 13:54:53.872833 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.873353 13476 raft_consensus.cc:2468] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:53.871903 13462 raft_consensus.cc:2468] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:53.875420 18439 leader_election.cc:290] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:53.840279 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:53.864892 12952 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.878103 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]). Expected version 1 got 0
I20260810 13:54:53.879725 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]). Expected version 1 got 0
I20260810 13:54:53.880460 18415 raft_consensus.cc:2804] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260810 13:54:53.881064 18415 raft_consensus.cc:493] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:53.881484 18415 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Advancing to term 4
I20260810 13:54:53.886947 18410 raft_consensus.cc:515] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.887523 18392 raft_consensus.cc:493] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:53.888039 18392 raft_consensus.cc:515] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.889864 18392 leader_election.cc:290] T a4b1451bb8254fcb8c507a837d6b2fa4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.891824 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a745bc711004993830b40ca1c93c63b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.893364 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.893854 13470 raft_consensus.cc:2468] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:53.894845 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.895344 13261 raft_consensus.cc:1240] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:53.904480 18356 raft_consensus.cc:515] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.906656 18356 leader_election.cc:290] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.908106 12952 leader_election.cc:304] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:53.906610 18407 consensus_queue.cc:1059] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260810 13:54:53.910573 16177 tablet_loader.cc:96] loaded metadata for tablet 32905f89c1d3480abb007f8dd130e2de (table default.Table_7c263dc08783483d941121c9c3cafdc6 [id=fc5a0ae7f9074bfc89acd9077b020821])
I20260810 13:54:53.912531 18295 leader_election.cc:290] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.915234 13640 tablet_bootstrap.cc:492] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:53.921000 18392 raft_consensus.cc:493] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:53.921499 18392 raft_consensus.cc:515] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.923347 18392 leader_election.cc:290] T 587b591fb88a447b9bd5e071fa8c37e1 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.928879 18424 raft_consensus.cc:493] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:53.929329 18424 raft_consensus.cc:515] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.929437 18415 raft_consensus.cc:515] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.931867 18415 leader_election.cc:290] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 4 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.932518 18404 raft_consensus.cc:2804] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:53.932641 18424 leader_election.cc:290] T 6406062bb0934eadae901502806178b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.940014 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]). Expected version 1 got 0
I20260810 13:54:53.941754 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.942935 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]). Expected version 1 got 0
I20260810 13:54:53.943938 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]). Expected version 1 got 0
I20260810 13:54:53.948956 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.949832 13049 raft_consensus.cc:2393] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 4: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:53.951418 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a373308fa4b039e8331d9a0a90d16" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.952106 13049 raft_consensus.cc:2393] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:53.953265 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:53.954198 18273 raft_consensus.cc:493] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.954710 18273 raft_consensus.cc:515] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.956128 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.956544 13468 raft_consensus.cc:1240] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:53.960574 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bf6a1f14bb4513b1addc4141b71373" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:53.961584 18392 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:53.962021 18392 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.963975 18392 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.889501 18410 leader_election.cc:290] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.966459 13476 raft_consensus.cc:1275] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:53.970868 18392 raft_consensus.cc:493] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:53.971385 18392 raft_consensus.cc:515] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.973263 18392 leader_election.cc:290] T 3b7b408a9ad34ea39c912b33e26b49b6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:53.929044 18399 raft_consensus.cc:515] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:53.978789 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:54:53.965293 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 57255.1us
I20260810 13:54:53.989506 13640 tablet_bootstrap.cc:654] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:53.999781 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.539s (SENT)
I20260810 13:54:54.000168 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:53.916994 16177 tablet_loader.cc:96] loaded metadata for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef])
I20260810 13:54:53.957844 13638 tablet_bootstrap.cc:654] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:54.016990 18471 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:54.022348 18399 leader_election.cc:290] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.023041 18357 raft_consensus.cc:493] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:54.023329 13640 tablet_bootstrap.cc:492] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:54.023720 13640 ts_tablet_manager.cc:1403] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.109s user 0.007s sys 0.002s
I20260810 13:54:54.023679 18399 raft_consensus.cc:493] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:54.023491 18357 raft_consensus.cc:515] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.024117 18399 raft_consensus.cc:515] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.025898 18399 leader_election.cc:290] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.026160 18357 leader_election.cc:290] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.026309 18399 raft_consensus.cc:493] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.026729 18399 raft_consensus.cc:515] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.033298 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:54.034015 13041 raft_consensus.cc:2393] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 2: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:54.034063 18356 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:54.034802 18356 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.037158 18356 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:53.964654 18273 leader_election.cc:290] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.042594 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e88a52755140019a6d9f7041db0837" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.048249 18392 raft_consensus.cc:493] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:54.048828 18392 raft_consensus.cc:515] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.050750 18392 leader_election.cc:290] T 953f83dab3ca406f8638e446911614b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:54.051664 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafed58a5994479e91678ddbe74cd353" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.044391 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0f39d7fa7e4cac9dda6ec101229efd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:54.052259 13476 raft_consensus.cc:2468] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:54.053243 18392 raft_consensus.cc:493] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:54.054030 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:54.053928 18392 raft_consensus.cc:515] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.054855 13046 raft_consensus.cc:2393] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 2: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:54.055861 18424 raft_consensus.cc:493] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.056290 18424 raft_consensus.cc:515] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.058051 18424 leader_election.cc:290] T 918edf5d7b4f45009c5d476588399d0c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:54.058944 18392 leader_election.cc:290] T d321f9c075554ffcb299d02792a0662d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:54.061525 13476 raft_consensus.cc:1240] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:54.062954 13027 raft_consensus.cc:2393] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:54.064230 13476 raft_consensus.cc:1275] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260810 13:54:54.064584 13476 pending_rounds.cc:85] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting all ops after (but not including) 0
I20260810 13:54:54.064860 13476 pending_rounds.cc:107] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260810 13:54:54.065148 13476 raft_consensus.cc:2889] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:54.065846 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]). Expected version 2 got 0
I20260810 13:54:54.068500 18443 raft_consensus.cc:493] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:54.069099 18443 raft_consensus.cc:515] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.071478 18443 leader_election.cc:290] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.074877 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0f39d7fa7e4cac9dda6ec101229efd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.075471 13470 raft_consensus.cc:2468] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:54.020027 18404 raft_consensus.cc:697] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:54.084605 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.085698 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.086299 13476 raft_consensus.cc:2468] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:54.093560 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.093954 18439 raft_consensus.cc:493] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:54.094410 18439 raft_consensus.cc:515] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.094687 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.095312 13476 raft_consensus.cc:3060] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:54.095486 18295 raft_consensus.cc:3055] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:54.095969 18295 raft_consensus.cc:740] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:54.096318 18439 leader_election.cc:290] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.096966 18295 consensus_queue.cc:260] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.103518 18295 raft_consensus.cc:3060] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:54.103168 18404 consensus_queue.cc:237] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.103736 16177 tablet_loader.cc:96] loaded metadata for tablet 387ebbb8677c4fb082006585389c6582 (table default.Table_10638f441f654317829d436d2e7eb979 [id=4f21b5213a724ce5989d7684473d65e9])
I20260810 13:54:54.110356 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.110965 13470 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:54.112057 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.112560 13470 raft_consensus.cc:2468] T db50d31d0d6c45faa1eb138357d532b3 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 2.
I20260810 13:54:54.117589 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.118862 13467 raft_consensus.cc:1275] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260810 13:54:54.119481 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:54.120077 13056 raft_consensus.cc:3060] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:54.120213 13467 raft_consensus.cc:1240] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:54.121132 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]). Expected version 3 got 0
I20260810 13:54:54.121698 13467 raft_consensus.cc:1275] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260810 13:54:54.122692 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]). Expected version 1 got 0
I20260810 13:54:54.123283 13467 raft_consensus.cc:1275] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 1. (term mismatch)
I20260810 13:54:54.123728 13467 pending_rounds.cc:85] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting all ops after (but not including) 0
I20260810 13:54:54.123977 13467 pending_rounds.cc:107] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260810 13:54:54.124234 13467 raft_consensus.cc:2889] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:54.124277 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]). Expected version 1 got 0
I20260810 13:54:54.028445 18399 leader_election.cc:290] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.130272 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3119d63857480294dcb68ed0451bc0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.131114 13025 raft_consensus.cc:2393] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:54.131944 18399 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.132391 18399 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.132831 16177 tablet_loader.cc:96] loaded metadata for tablet 393e23a9c03049a280f3ef89bdca5011 (table default.Table_4f780597fcec4261acd040c8816826c4 [id=3e00d0fc074747809ebc1f6b3696649d])
I20260810 13:54:54.134655 18392 raft_consensus.cc:493] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:54.135255 18399 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.135201 18392 raft_consensus.cc:515] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.137178 18392 leader_election.cc:290] T 1c6686175347496093cb22ce8a3d4176 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:54.138159 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f4b863f701471ab173b68049b1a602" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.138844 13025 raft_consensus.cc:2468] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
W20260810 13:54:54.155732 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 146031us
I20260810 13:54:54.158087 13640 raft_consensus.cc:359] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.158919 13640 raft_consensus.cc:385] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:54.165609 13640 raft_consensus.cc:740] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:54.174451 13639 tablet_bootstrap.cc:492] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:54.175024 13639 ts_tablet_manager.cc:1403] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.450s user 0.009s sys 0.006s
I20260810 13:54:54.177356 16177 tablet_loader.cc:96] loaded metadata for tablet 39514e069d6841df9fced9e62981eac5 (table default.Table_f6d23e8eec824ef08b26dec8c7c6d010 [id=4d373c8f174b46e99209a83ab947b204])
I20260810 13:54:54.165485 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bf6a1f14bb4513b1addc4141b71373" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.166167 18392 raft_consensus.cc:493] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:54.167155 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a373308fa4b039e8331d9a0a90d16" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.190840 18392 raft_consensus.cc:515] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.193086 18392 leader_election.cc:290] T 094a3448b54c409281c31813e60dcb7f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:54.194730 13640 consensus_queue.cc:260] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.207209 13638 tablet_bootstrap.cc:492] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:54.207849 13638 ts_tablet_manager.cc:1403] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.380s user 0.005s sys 0.009s
I20260810 13:54:54.212808 13638 raft_consensus.cc:359] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.217561 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]). Expected version 1 got 0
I20260810 13:54:54.178117 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3119d63857480294dcb68ed0451bc0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.179311 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0f39d7fa7e4cac9dda6ec101229efd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.179986 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafed58a5994479e91678ddbe74cd353" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.229399 13462 raft_consensus.cc:3060] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:54.229421 13474 raft_consensus.cc:3060] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:54.230147 13640 ts_tablet_manager.cc:1434] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.206s user 0.007s sys 0.000s
I20260810 13:54:54.180928 13477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.231022 13640 tablet_bootstrap.cc:492] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:54.196869 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.231449 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.216023 13452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.232184 13452 raft_consensus.cc:2468] T ca4c0fea312c418f8ebd5c0619e7e220 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:54.217265 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.218464 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.219827 13480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c68d8171bf847eab37c505640b831fc" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.222862 13472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a059240c0f48ee958ef728acfcae92" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.235570 13480 raft_consensus.cc:2468] T 1c68d8171bf847eab37c505640b831fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:54.235913 13472 raft_consensus.cc:2468] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:54.224066 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.169443 13476 raft_consensus.cc:2468] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:54.225023 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.236579 13474 raft_consensus.cc:2468] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:54.225721 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.237151 13056 raft_consensus.cc:2468] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:54.237455 13475 raft_consensus.cc:2368] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3.
I20260810 13:54:54.237320 13468 raft_consensus.cc:2468] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.241607 13464 raft_consensus.cc:2468] T da664a1596554ee3890f58f0c54521a6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:54.243311 13462 raft_consensus.cc:2468] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:54.244024 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.244622 13464 raft_consensus.cc:2376] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1. Re-sending same reply.
I20260810 13:54:54.245676 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729ffbfd767f4aa0b95f6545011aae3d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.257160 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]). Expected version 1 got 0
I20260810 13:54:54.259750 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]). Expected version 1 got 0
I20260810 13:54:54.261032 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.261598 13474 raft_consensus.cc:2468] T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.260959 18410 raft_consensus.cc:493] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.263330 18410 raft_consensus.cc:515] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.265415 18410 leader_election.cc:290] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.273499 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec54cb915a54949871181763ad956d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.277240 13033 raft_consensus.cc:1275] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260810 13:54:54.277622 13033 pending_rounds.cc:85] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3: Aborting all ops after (but not including) 1
I20260810 13:54:54.277851 13033 pending_rounds.cc:107] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260810 13:54:54.278121 13033 raft_consensus.cc:2889] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:54.278434 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.279152 13037 raft_consensus.cc:2468] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.280385 18407 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:54.280980 18407 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.283107 18407 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:54.285329 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 108518us
I20260810 13:54:54.286757 13638 raft_consensus.cc:385] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:54.290776 13638 raft_consensus.cc:740] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:54.291813 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.296773 13050 raft_consensus.cc:1275] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260810 13:54:54.298849 13056 raft_consensus.cc:2468] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:54.299736 12952 leader_election.cc:304] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:54.307597 18273 consensus_queue.cc:1048] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260810 13:54:54.319077 16177 tablet_loader.cc:96] loaded metadata for tablet 3b7b408a9ad34ea39c912b33e26b49b6 (table default.Table_029a3ba2ee734a729e84a4482938ed5b [id=b437e76811d440ca817fca27a8dcbd45])
I20260810 13:54:54.313731 13638 consensus_queue.cc:260] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:54.325969 13426 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49514: Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:54.308607 18407 raft_consensus.cc:2804] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:54.335304 18420 consensus_queue.cc:1059] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260810 13:54:54.336088 18420 raft_consensus.cc:3055] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:54.336400 18420 raft_consensus.cc:740] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:54.348510 18420 consensus_queue.cc:260] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.349831 18420 raft_consensus.cc:3060] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:54.350390 13639 raft_consensus.cc:359] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.351840 13639 raft_consensus.cc:385] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:54.351301 18407 raft_consensus.cc:697] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:54.352926 13639 raft_consensus.cc:740] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:54.334764 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.359302 13261 raft_consensus.cc:2468] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:54.365170 13638 ts_tablet_manager.cc:1434] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.157s user 0.003s sys 0.002s
I20260810 13:54:54.366165 13638 tablet_bootstrap.cc:492] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:54.377324 18407 consensus_queue.cc:237] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.387383 18439 raft_consensus.cc:493] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.387835 18439 raft_consensus.cc:515] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.387152 13639 consensus_queue.cc:260] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.389772 18439 leader_election.cc:290] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.410908 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a373308fa4b039e8331d9a0a90d16" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:54.411329 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]). Expected version 2 got 0
I20260810 13:54:54.411502 13255 raft_consensus.cc:3060] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:54.412210 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]). Expected version 1 got 0
I20260810 13:54:54.419139 13255 raft_consensus.cc:2468] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:54.421308 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:54.423367 13261 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Advancing to term 4
I20260810 13:54:54.423445 16177 tablet_loader.cc:96] loaded metadata for tablet 419f1f8bae1c458f83d6be2978cb6ecc (table default.Table_347db13a1f7b4332b673b26332048bd1 [id=a0412eb9c5ca49479916b4c79f61643d])
I20260810 13:54:54.424409 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a059240c0f48ee958ef728acfcae92" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:54.425061 13049 raft_consensus.cc:3060] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:54.419673 13638 tablet_bootstrap.cc:654] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:54.434506 16177 tablet_loader.cc:96] loaded metadata for tablet 41b258122c6e4de982cd95ec04ffc3ae (table default.Table_802dbe2ed82d4d25962ab8ba68d22fa9 [id=f6ba2bd3294c4b49a617aee9388a1248])
I20260810 13:54:54.437427 16177 tablet_loader.cc:96] loaded metadata for tablet 420ee600a4174916827aa7b64bbcd8d2 (table default.Table_86dcc5d091024407b7e167806ec593a3 [id=c07ecd00b44e49c9b0a32e8710373471])
I20260810 13:54:54.438745 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.439481 13250 raft_consensus.cc:2468] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:54.440418 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3119d63857480294dcb68ed0451bc0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:54.441131 13255 raft_consensus.cc:3060] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:54.452736 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:54.453923 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:54.455295 13639 ts_tablet_manager.cc:1434] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.280s user 0.007s sys 0.000s
W20260810 13:54:54.456277 12471 catalog_manager.cc:5129] TS 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): alter failed for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]): Illegal state: replica 6f30dc72e9364eed80645b57ac7f0cb6 is not leader of this config: current role FOLLOWER
I20260810 13:54:54.458175 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:54.458737 13056 raft_consensus.cc:3060] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:54.416081 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:54.469650 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.470255 13465 raft_consensus.cc:3060] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:54.461467 13039 raft_consensus.cc:3060] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:54.475749 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.476325 13474 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:54.477675 13639 tablet_bootstrap.cc:492] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:54.484639 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.485201 13453 raft_consensus.cc:3060] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:54.482703 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.487444 13033 raft_consensus.cc:2468] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.484942 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.488294 13465 raft_consensus.cc:2468] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:54.486040 13046 raft_consensus.cc:1275] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260810 13:54:54.489113 13046 pending_rounds.cc:85] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3: Aborting all ops after (but not including) 1
I20260810 13:54:54.489378 13046 pending_rounds.cc:107] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260810 13:54:54.489627 13046 raft_consensus.cc:2889] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:54.488525 13037 raft_consensus.cc:2468] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.492504 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a373308fa4b039e8331d9a0a90d16" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.496397 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a0f39d7fa7e4cac9dda6ec101229efd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.497118 13476 raft_consensus.cc:2393] T 1a0f39d7fa7e4cac9dda6ec101229efd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:54.500523 13453 raft_consensus.cc:2468] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:54.503063 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.503827 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:54.504513 13027 raft_consensus.cc:3060] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:54.505299 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.506616 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.507193 13046 raft_consensus.cc:2468] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.509967 13025 raft_consensus.cc:1275] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260810 13:54:54.510360 13025 pending_rounds.cc:85] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: Aborting all ops after (but not including) 4
I20260810 13:54:54.510653 13025 pending_rounds.cc:107] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260810 13:54:54.510957 13025 raft_consensus.cc:2889] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:54.502185 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.515027 13464 raft_consensus.cc:2468] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:54.516196 13049 raft_consensus.cc:2468] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.516633 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e88a52755140019a6d9f7041db0837" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.517318 13462 raft_consensus.cc:2468] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:54.509449 13640 tablet_bootstrap.cc:654] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:54.526232 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.527079 13244 raft_consensus.cc:2468] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:54.535244 16177 tablet_loader.cc:96] loaded metadata for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd])
I20260810 13:54:54.537070 18392 raft_consensus.cc:493] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:54.537639 18392 raft_consensus.cc:515] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.540257 18392 leader_election.cc:290] T ebb1392a98aa4af199236e4b4b4ab3c5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:54.545929 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a99165463a43c78f4ccb6c5892f4b1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.551648 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd58cc128ce64f9abe1418b6093a1c2c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.533964 13261 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 4.
I20260810 13:54:54.559887 13255 raft_consensus.cc:2468] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
W20260810 13:54:54.568101 13167 leader_election.cc:343] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:54.583292 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]). Expected version 1 got 0
I20260810 13:54:54.589421 18392 raft_consensus.cc:493] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.590169 18392 raft_consensus.cc:515] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.548435 13639 tablet_bootstrap.cc:654] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:54.593947 18392 leader_election.cc:290] T 5f5cf3efa54b4344b04a87a87509d1f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:54.597084 13167 leader_election.cc:343] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:54.602847 13552 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:54.613454 18392 raft_consensus.cc:493] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:54.616344 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec54cb915a54949871181763ad956d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.616839 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.615775 13465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3119d63857480294dcb68ed0451bc0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.617508 13464 raft_consensus.cc:2468] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:54.618880 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420ee600a4174916827aa7b64bbcd8d2" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.619263 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f4b863f701471ab173b68049b1a602" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.619786 13449 raft_consensus.cc:2468] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:54.616963 13475 raft_consensus.cc:2468] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:54.614087 18392 raft_consensus.cc:515] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.621852 16177 tablet_loader.cc:96] loaded metadata for tablet 45530faa785a4642b4efc18733d0d9b1 (table default.Table_8eeb870902124e9696cfa7e98dfa0e88 [id=614fbd4b5dd440cb8f5a6fa4d994266d])
I20260810 13:54:54.622406 18392 leader_election.cc:290] T 674599456f9a49dc98d8d089c166ca89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:54.623860 16177 tablet_loader.cc:96] loaded metadata for tablet 4687f8fd44034ce28727c3b7e58e7fe9 (table default.Table_bd734d41b4c04e8fae8551c8d2f341dc [id=5b4eac88920044a7ba18bf40b8783a9d])
I20260810 13:54:54.577409 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:54.631963 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:54.637248 13037 raft_consensus.cc:2468] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.566893 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f37f4b2d04f84e119da2743234865baf" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:54.638231 13033 raft_consensus.cc:2468] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:54.565033 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:54.579612 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:54.579977 18485 raft_consensus.cc:493] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.644923 18485 raft_consensus.cc:515] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.647156 18485 leader_election.cc:290] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.566246 13025 raft_consensus.cc:1275] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260810 13:54:54.649256 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]). Expected version 1 got 0
I20260810 13:54:54.650360 18392 raft_consensus.cc:493] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.650848 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]). Expected version 1 got 0
I20260810 13:54:54.651336 18392 raft_consensus.cc:515] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.652070 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]). Expected version 3 got 0
I20260810 13:54:54.653295 18392 leader_election.cc:290] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:54.661870 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.664259 13167 leader_election.cc:304] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:54.665104 12952 leader_election.cc:304] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:54.666353 18467 raft_consensus.cc:2804] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:54.666774 18467 raft_consensus.cc:493] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:54.667217 18467 raft_consensus.cc:3060] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:54.669386 13449 raft_consensus.cc:1275] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260810 13:54:54.673102 13039 raft_consensus.cc:2468] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:54.672560 13056 raft_consensus.cc:2468] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:54.681818 13474 raft_consensus.cc:1275] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260810 13:54:54.694836 13474 raft_consensus.cc:1275] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260810 13:54:54.699864 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.700516 13474 raft_consensus.cc:3060] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:54.702071 18399 raft_consensus.cc:2804] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:54.702579 18399 raft_consensus.cc:493] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:54.703058 18399 raft_consensus.cc:3060] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:54.705690 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.705415 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a059240c0f48ee958ef728acfcae92" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.707808 13468 raft_consensus.cc:3060] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
W20260810 13:54:54.708268 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 44072.6us
I20260810 13:54:54.720099 13261 raft_consensus.cc:1275] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 13:54:54.716570 13468 raft_consensus.cc:2468] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.730398 13639 tablet_bootstrap.cc:492] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:54.730435 13475 raft_consensus.cc:1275] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260810 13:54:54.730520 16177 tablet_loader.cc:96] loaded metadata for tablet 4744dd484c3d4e0cb903840759ec532f (table default.Table_08e421ad9e1d4274b11c4cb314c36201 [id=f7546e5fae5641d0b1747c71934496ec])
I20260810 13:54:54.730733 13475 pending_rounds.cc:85] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting all ops after (but not including) 1
I20260810 13:54:54.730942 13475 pending_rounds.cc:107] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260810 13:54:54.731032 13639 ts_tablet_manager.cc:1403] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.254s user 0.012s sys 0.002s
I20260810 13:54:54.731165 13475 raft_consensus.cc:2889] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:54.731923 16177 tablet_loader.cc:96] loaded metadata for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2])
I20260810 13:54:54.748782 13167 leader_election.cc:304] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:54.749450 18528 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:54.749996 18528 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:54.752729 18415 raft_consensus.cc:493] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.753319 18415 raft_consensus.cc:515] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.758309 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.760130 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b335455cc01947a3a4ca6c368fea7bad" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:54.764673 13474 raft_consensus.cc:2468] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
W20260810 13:54:54.768326 12476 catalog_manager.cc:4832] Async tablet task AlterTable RPC for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d7ffb0f96e744a4bb734aba7f3d82995 consensus state has no leader
I20260810 13:54:54.770102 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 830 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:54.774430 13468 raft_consensus.cc:1275] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260810 13:54:54.775133 12484 catalog_manager.cc:5719] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 reported cstate change: term changed from 1 to 2, leader changed from 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3) to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 2 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:54.777246 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]). Expected version 2 got 0
I20260810 13:54:54.777868 13638 tablet_bootstrap.cc:492] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:54.777652 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.778347 13638 ts_tablet_manager.cc:1403] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.412s user 0.008s sys 0.010s
I20260810 13:54:54.778743 13449 raft_consensus.cc:2468] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:54.779208 12484 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet a04498da4fce45bb9a906e75594a023f (table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]). Expected version 1 got 0
I20260810 13:54:54.781018 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.781215 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.782198 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.783690 13638 raft_consensus.cc:359] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.784355 13638 raft_consensus.cc:385] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:54.784247 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.795954 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f37f4b2d04f84e119da2743234865baf" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.796542 13468 raft_consensus.cc:2468] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:54.796520 18532 raft_consensus.cc:2804] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:54.799467 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:54.800349 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:54.801167 13244 raft_consensus.cc:2393] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:54.806420 13474 raft_consensus.cc:2468] T 7529b349395a42ec96c7816f9e566079 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 3.
I20260810 13:54:54.809911 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.816469 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d647bf5c1ba42f48186661310065448" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.819762 13640 tablet_bootstrap.cc:492] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:54.820307 13640 ts_tablet_manager.cc:1403] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.589s user 0.015s sys 0.018s
I20260810 13:54:54.823089 13640 raft_consensus.cc:359] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.823882 13640 raft_consensus.cc:385] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:54.824226 13640 raft_consensus.cc:740] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:54.750269 13167 leader_election.cc:343] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:54.825493 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 75257.6us
I20260810 13:54:54.826562 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:54.827904 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 59283us
I20260810 13:54:54.828747 12952 leader_election.cc:304] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:54.829571 18485 raft_consensus.cc:2804] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:54.830649 18485 raft_consensus.cc:697] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:54.831566 18485 consensus_queue.cc:237] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.833389 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.835829 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.835867 18467 raft_consensus.cc:515] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.836575 13244 raft_consensus.cc:2393] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:54.837934 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.845871 16177 tablet_loader.cc:96] loaded metadata for tablet 48ff07074f4a4392adc6c3aa0360454f (table default.Table_da87a4b83c12422e999c5b88c825d890 [id=3064108a10bd4f76b2be6614ebed22fc])
I20260810 13:54:54.845824 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.847661 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.851020 18528 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:54.857213 18399 raft_consensus.cc:515] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.859719 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.864188 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.865991 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.866158 16177 tablet_loader.cc:96] loaded metadata for tablet 49bf6a1f14bb4513b1addc4141b71373 (table default.Table_d4a38708152b4705af7eaf9af6ddc436 [id=5edfc8942f7145adae70b892942fbd64])
I20260810 13:54:54.867184 18399 leader_election.cc:290] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.869007 16177 tablet_loader.cc:96] loaded metadata for tablet 4bd68cdc1322448292c481925ad33c79 (table default.Table_278ad8ed658b48d28fcc3aa3eec747b0 [id=d585e61cb61a4312ba2dbadbcae39899])
I20260810 13:54:54.881100 13640 consensus_queue.cc:260] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.883467 13640 ts_tablet_manager.cc:1434] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.063s user 0.005s sys 0.000s
I20260810 13:54:54.837788 18467 leader_election.cc:290] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:54.841277 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:54.839699 18415 leader_election.cc:290] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.850714 13639 raft_consensus.cc:359] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.888087 13639 raft_consensus.cc:385] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:54.888449 13639 raft_consensus.cc:740] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:54.889329 13639 consensus_queue.cc:260] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.891386 13639 ts_tablet_manager.cc:1434] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.160s user 0.006s sys 0.000s
I20260810 13:54:54.868180 12952 leader_election.cc:304] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:54.893762 18295 raft_consensus.cc:2804] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:54.894179 18295 raft_consensus.cc:493] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:54.894565 18295 raft_consensus.cc:3060] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:54.927627 18410 consensus_queue.cc:1048] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:54.868067 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.931890 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:54.932570 12951 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.36.3:36001 timed out after 3.352s (SENT)
I20260810 13:54:54.933183 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.869856 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a059240c0f48ee958ef728acfcae92" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.934971 13261 raft_consensus.cc:2393] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:54.935735 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.936764 13261 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.871017 13264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.871327 13256 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:54.872270 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 45429.9us
I20260810 13:54:54.938241 13256 raft_consensus.cc:2468] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:54.934304 13244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.941776 13167 leader_election.cc:304] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:54.875301 13260 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.876241 13265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.942644 13260 raft_consensus.cc:2393] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:54.876668 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.895474 13252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.881055 13240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.896231 13243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.896327 13254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.897346 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.905167 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.904448 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafed58a5994479e91678ddbe74cd353" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.945423 13268 raft_consensus.cc:2393] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:54.909667 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.911671 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:54.945935 18540 raft_consensus.cc:2804] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:54.910688 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.919767 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.946329 18540 raft_consensus.cc:493] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:54.912213 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.941700 18356 consensus_queue.cc:1048] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:54.784641 13638 raft_consensus.cc:740] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:54.947441 13638 consensus_queue.cc:260] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.946694 18540 raft_consensus.cc:3060] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:54.948237 18356 raft_consensus.cc:493] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:54.948820 18356 raft_consensus.cc:515] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.950886 18356 leader_election.cc:290] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:54.872745 18532 raft_consensus.cc:697] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:54.952099 18532 consensus_queue.cc:237] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:54.960095 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.964560 16177 tablet_loader.cc:96] loaded metadata for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279])
W20260810 13:54:54.985258 12953 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:54.994500 13638 ts_tablet_manager.cc:1434] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.216s user 0.006s sys 0.001s
I20260810 13:54:54.995674 13638 tablet_bootstrap.cc:492] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:54.996253 13242 raft_consensus.cc:1240] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:54.997866 13640 tablet_bootstrap.cc:492] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:54.998632 13242 raft_consensus.cc:1240] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:55.001871 13242 raft_consensus.cc:1240] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260810 13:54:55.003587 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:55.004281 13242 raft_consensus.cc:1240] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:55.005344 13167 leader_election.cc:304] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:55.015388 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 82831.7us
W20260810 13:54:55.019079 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 49557us
I20260810 13:54:55.021663 13639 tablet_bootstrap.cc:492] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:55.010289 13242 raft_consensus.cc:1240] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:55.031090 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.028935 18537 raft_consensus.cc:2804] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:55.033203 18537 raft_consensus.cc:493] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:55.033957 18537 raft_consensus.cc:3060] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:55.010466 18356 consensus_queue.cc:1048] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260810 13:54:55.038268 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.040026 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.041785 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:54.926709 13027 raft_consensus.cc:2468] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 2.
I20260810 13:54:55.059159 16177 tablet_loader.cc:96] loaded metadata for tablet 50d8651946d242feb9cf993aff99ba1b (table default.Table_2901b91576984ac4a165471a90e86a8b [id=a67f03853a964c2fbf175165ee422881])
I20260810 13:54:55.061067 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.062879 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.063649 18540 raft_consensus.cc:515] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.065734 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.067428 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.067478 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:55.075203 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 69942.7us
I20260810 13:54:55.067631 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.078692 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.083135 13255 raft_consensus.cc:1240] T 420ee600a4174916827aa7b64bbcd8d2 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:55.090955 18392 raft_consensus.cc:493] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.091593 18392 raft_consensus.cc:515] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:55.095135 18392 leader_election.cc:290] T 91e169a9bbc24a5196b1bdaf5bb06207 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:55.096102 18392 raft_consensus.cc:493] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.096843 18392 raft_consensus.cc:515] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.097371 18532 consensus_queue.cc:1048] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:55.101783 18392 leader_election.cc:290] T 7a490fcb16164f968335f069129b3d71 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:55.102612 18392 raft_consensus.cc:493] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.103376 18392 raft_consensus.cc:515] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.105852 16177 tablet_loader.cc:96] loaded metadata for tablet 515727ae51d94c009b4446c8b6e2c8f6 (table default.Table_5d42b950252445e0bf75ab4e88f08ff5 [id=173ce908d0a5419ea4d1fa9c3dbcfc68])
I20260810 13:54:55.106199 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.107661 16177 tablet_loader.cc:96] loaded metadata for tablet 51813605283e43f2b4efe6fb2fab652c (table default.Table_c631f6ff87f046ac8fcbc07f3f32209a [id=1895c144baac40e1a6726fc8eb56aa1d])
I20260810 13:54:55.108668 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.110113 13242 raft_consensus.cc:1240] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:55.119421 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf672d15f88c4f0dbdf2fdb6aefa1108" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.120028 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "674599456f9a49dc98d8d089c166ca89" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:55.123098 13640 tablet_bootstrap.cc:654] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:55.111109 18392 leader_election.cc:290] T 387ebbb8677c4fb082006585389c6582 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:55.128422 18392 raft_consensus.cc:493] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.128808 18557 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.129145 18392 raft_consensus.cc:515] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:55.130256 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 110442us
I20260810 13:54:55.131453 12952 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.133015 18392 leader_election.cc:290] T d6487d26c6524c38a313b54d5431b6f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:55.132179 12952 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.129559 18557 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.136423 18407 raft_consensus.cc:2804] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:55.137010 18407 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:55.137645 18410 raft_consensus.cc:493] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.138173 18410 raft_consensus.cc:515] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.128482 18295 raft_consensus.cc:515] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.137573 18407 raft_consensus.cc:3060] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.139020 18557 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:55.153575 12952 leader_election.cc:304] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.156261 18415 raft_consensus.cc:2804] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 4 FOLLOWER]: Leader election won for term 4
I20260810 13:54:55.158177 18485 raft_consensus.cc:2804] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:55.158257 18392 consensus_queue.cc:1059] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:55.158916 18485 raft_consensus.cc:697] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:55.160212 18557 consensus_queue.cc:1048] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:55.161480 18415 raft_consensus.cc:697] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [term 4 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:55.162930 18415 consensus_queue.cc:237] T 2f934006c34a4b18ab157dad01a1b41d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.160347 18485 consensus_queue.cc:237] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.157944 18560 raft_consensus.cc:493] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:55.167438 18560 raft_consensus.cc:515] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.170979 18560 leader_election.cc:290] T 00a4341f5d274a9eb54cb030b47c9a91 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:55.168520 13382 leader_election.cc:304] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.171473 18560 consensus_queue.cc:1048] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.176121 13382 leader_election.cc:304] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.177495 18557 raft_consensus.cc:2749] T 5f1df2c9593442afa84849da6874f0f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.178104 18557 consensus_queue.cc:1059] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.178817 18557 raft_consensus.cc:2749] T d891e763a1854b6a8bda1071448fd8e0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.179299 18557 raft_consensus.cc:3055] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:55.179603 18557 raft_consensus.cc:740] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:55.185606 18404 raft_consensus.cc:493] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:55.186280 18404 raft_consensus.cc:515] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.140594 18410 leader_election.cc:290] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.192677 18464 consensus_queue.cc:1048] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:55.194711 18563 raft_consensus.cc:3055] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:55.195267 18563 raft_consensus.cc:740] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:55.196038 18404 leader_election.cc:290] T cd3d4b038acb48ebaebef7a424f721c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.180246 18557 consensus_queue.cc:260] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.202140 13640 tablet_bootstrap.cc:492] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:55.203373 13640 ts_tablet_manager.cc:1403] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.206s user 0.016s sys 0.004s
I20260810 13:54:55.207614 13640 raft_consensus.cc:359] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.205037 18295 leader_election.cc:290] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.207929 18420 consensus_queue.cc:1048] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260810 13:54:55.213667 18549 log.cc:927] Time spent T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3: Append to log took a long time: real 0.173s user 0.000s sys 0.002s
I20260810 13:54:55.209702 13382 leader_election.cc:304] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.216820 18560 raft_consensus.cc:2749] T 98a59da23cfa4b5a9713b135d7fa4366 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:55.217224 13382 leader_election.cc:343] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:55.217701 13382 leader_election.cc:304] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.218444 18560 raft_consensus.cc:2749] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:55.218819 13382 leader_election.cc:304] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.219549 18560 raft_consensus.cc:2749] T 393e23a9c03049a280f3ef89bdca5011 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.219938 13382 leader_election.cc:304] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.220562 18560 raft_consensus.cc:2749] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:55.220956 13382 leader_election.cc:343] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:55.221314 13382 leader_election.cc:304] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.221957 18560 raft_consensus.cc:2749] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:55.222265 13382 leader_election.cc:304] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:55.223222 13382 leader_election.cc:343] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:55.223562 13382 leader_election.cc:304] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.223647 18560 raft_consensus.cc:2749] T 1ee6e694366543328526313d7018b5db P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.196651 18563 consensus_queue.cc:260] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.224640 18563 raft_consensus.cc:3060] T dd58cc128ce64f9abe1418b6093a1c2c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.202896 18557 raft_consensus.cc:3060] T 53a99165463a43c78f4ccb6c5892f4b1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.229449 13640 raft_consensus.cc:385] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:55.231319 13640 raft_consensus.cc:740] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:55.233233 13640 consensus_queue.cc:260] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:55.236876 12951 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:55.244565 18569 raft_consensus.cc:2749] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:55.245798 13382 leader_election.cc:304] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.249639 18392 raft_consensus.cc:2749] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 13:54:55.253275 13382 leader_election.cc:304] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:55.255159 18569 raft_consensus.cc:2804] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:55.255555 18569 raft_consensus.cc:493] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:55.255764 13640 ts_tablet_manager.cc:1434] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.052s user 0.001s sys 0.006s
I20260810 13:54:55.255875 18569 raft_consensus.cc:3060] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.256866 13640 tablet_bootstrap.cc:492] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:55.265542 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f934006c34a4b18ab157dad01a1b41d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:55.265630 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a373308fa4b039e8331d9a0a90d16" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:55.266062 13475 raft_consensus.cc:3060] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Advancing to term 4
I20260810 13:54:55.266564 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3119d63857480294dcb68ed0451bc0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:55.267567 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.268153 13449 raft_consensus.cc:2468] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:55.269016 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da664a1596554ee3890f58f0c54521a6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.269040 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.274794 13475 raft_consensus.cc:2468] T 2f934006c34a4b18ab157dad01a1b41d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 4.
I20260810 13:54:55.276379 13640 tablet_bootstrap.cc:654] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:55.277617 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:55.279441 18569 raft_consensus.cc:515] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.280077 18561 raft_consensus.cc:493] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:55.280584 18561 raft_consensus.cc:515] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.283730 18561 leader_election.cc:290] T a67cf93d78254f15a1b89c99048110c8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.286293 13639 tablet_bootstrap.cc:654] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:55.284575 18563 raft_consensus.cc:493] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.290403 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:55.292498 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.295631 18563 raft_consensus.cc:515] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.293905 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.294636 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.297531 18563 leader_election.cc:290] T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:55.299469 18569 leader_election.cc:290] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:55.299381 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc446acced34a6c87e459c5542c1c77" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.299976 13474 raft_consensus.cc:2468] T efc446acced34a6c87e459c5542c1c77 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:54:55.300828 12796 debug-util.cc:398] Leaking SignalData structure 0x7b08001070c0 after lost signal to thread 12681
W20260810 13:54:55.301541 12796 debug-util.cc:398] Leaking SignalData structure 0x7b0800115f80 after lost signal to thread 12801
I20260810 13:54:55.305167 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d147e624d4243b9b330c874e0f27f6c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.307752 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.311856 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:55.312711 13468 raft_consensus.cc:3060] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:55.312734 16177 tablet_loader.cc:96] loaded metadata for tablet 52900269b7f74b338d6f81480686a940 (table default.Table_ecb9a9595610488796d066d45e53880a [id=c478e4b06e604e5d8277d76680a5e8f8])
I20260810 13:54:55.315629 16177 tablet_loader.cc:96] loaded metadata for tablet 5577bf52bd794919986e2bfa3f708efb (table default.Table_a0e9339c31fa470380def2ad49326176 [id=3e51b3dca7144d7b8494e0a36e61706a])
I20260810 13:54:55.319780 13468 raft_consensus.cc:2468] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:55.324223 18552 raft_consensus.cc:493] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.246791 18537 raft_consensus.cc:515] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.340762 18552 raft_consensus.cc:515] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.346971 18407 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.350378 13638 tablet_bootstrap.cc:654] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:55.364657 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 43683.3us
I20260810 13:54:55.365947 18485 consensus_queue.cc:1048] T a008d393fcdf441eb17dbe0c1fa2393f P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:55.369195 18485 consensus_queue.cc:1048] T 7c57ca566cfe47f6a331bbbe5c344a89 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.373483 18537 leader_election.cc:290] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.375054 18540 leader_election.cc:290] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.377765 18552 leader_election.cc:290] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.382467 13638 tablet_bootstrap.cc:492] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:55.383026 13638 ts_tablet_manager.cc:1403] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.388s user 0.012s sys 0.004s
I20260810 13:54:55.385807 13638 raft_consensus.cc:359] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.391588 13639 tablet_bootstrap.cc:492] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:55.392050 13639 ts_tablet_manager.cc:1403] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.371s user 0.008s sys 0.008s
I20260810 13:54:55.394550 13639 raft_consensus.cc:359] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.396559 12951 leader_election.cc:304] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:55.397481 18467 raft_consensus.cc:2749] T fd22f04344954142922942fc4b7cb157 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.404835 13639 raft_consensus.cc:385] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:55.405705 13639 raft_consensus.cc:740] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:55.418465 18467 consensus_queue.cc:1048] T d7ffb0f96e744a4bb734aba7f3d82995 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.420151 18467 raft_consensus.cc:493] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.420632 18467 raft_consensus.cc:515] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.422717 18467 leader_election.cc:290] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.425629 18485 consensus_queue.cc:1048] T c793dedc5e714fe6bd36e507695e82d0 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.426321 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f4b863f701471ab173b68049b1a602" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
W20260810 13:54:55.426849 13382 leader_election.cc:343] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:55.427101 13468 raft_consensus.cc:3060] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:55.427651 18485 consensus_queue.cc:1048] T 613d7ddce24b45c886139bf68c3c9a4d P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.431824 12951 leader_election.cc:304] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:55.432564 18485 raft_consensus.cc:2804] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:55.433115 18485 raft_consensus.cc:493] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:55.433439 18485 raft_consensus.cc:3060] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.434930 18407 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.408812 13639 consensus_queue.cc:260] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.440106 13639 ts_tablet_manager.cc:1434] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.048s user 0.007s sys 0.000s
I20260810 13:54:55.429297 18569 raft_consensus.cc:493] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.445722 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:55.445652 18569 raft_consensus.cc:515] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.446296 13475 raft_consensus.cc:2468] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:55.448971 16177 tablet_loader.cc:96] loaded metadata for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224])
I20260810 13:54:55.449271 18569 leader_election.cc:290] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:55.443454 18485 raft_consensus.cc:515] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.451329 16177 tablet_loader.cc:96] loaded metadata for tablet 5797a5de96ad4c3c80741e6673a8f194 (table default.Table_210fb0797673402e8e79fcf4e3c293b6 [id=aa1bdb6bb7c04faabb47c1552cc4aaff])
I20260810 13:54:55.451314 12951 leader_election.cc:304] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:55.454013 13640 tablet_bootstrap.cc:492] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:55.454526 13640 ts_tablet_manager.cc:1403] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.198s user 0.017s sys 0.037s
I20260810 13:54:55.455353 13468 raft_consensus.cc:2468] T e3f4b863f701471ab173b68049b1a602 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:55.461089 18467 raft_consensus.cc:2749] T 7a745bc711004993830b40ca1c93c63b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.462904 18485 leader_election.cc:290] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.471062 18563 consensus_queue.cc:1048] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.473992 13639 tablet_bootstrap.cc:492] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:55.474592 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 50279.3us
I20260810 13:54:55.470795 18569 consensus_queue.cc:1048] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260810 13:54:55.472604 13382 leader_election.cc:304] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:55.480875 18569 raft_consensus.cc:2804] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:55.481328 18569 raft_consensus.cc:493] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:55.481758 18569 raft_consensus.cc:3060] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:55.497622 16177 tablet_loader.cc:96] loaded metadata for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d])
W20260810 13:54:55.498749 12952 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:55.499152 16177 tablet_loader.cc:96] loaded metadata for tablet 5836c2923aaf4c698e20b9652fcddc20 (table default.Table_fa5cf1b28a8849b8a511b17ee9213eca [id=a454e03bffcf4e06bbe01ad44ea9dc8f])
I20260810 13:54:55.503037 16177 tablet_loader.cc:96] loaded metadata for tablet 5e99055cb9814d4d9b22e7a99a9ca61e (table default.Table_4b2d4fca101f4cbc9f296c50ca183066 [id=35087d7e2d0642a59670773333dda055])
I20260810 13:54:55.507241 18563 consensus_queue.cc:1059] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.508270 18557 raft_consensus.cc:3055] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:55.508599 18557 raft_consensus.cc:740] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:55.509426 18557 consensus_queue.cc:260] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.510102 13640 raft_consensus.cc:359] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.510792 13640 raft_consensus.cc:385] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:55.511126 13640 raft_consensus.cc:740] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:55.513263 18557 raft_consensus.cc:3060] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.514569 13640 consensus_queue.cc:260] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.525274 18563 raft_consensus.cc:493] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.525393 13640 ts_tablet_manager.cc:1434] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.071s user 0.008s sys 0.000s
I20260810 13:54:55.525758 18563 raft_consensus.cc:515] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.527714 18563 leader_election.cc:290] T 7a5114911fdf4b19afec0c71ded5ef9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:55.529920 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 47651us
I20260810 13:54:55.537443 13639 tablet_bootstrap.cc:654] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:55.562809 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 55882.1us
I20260810 13:54:55.580421 18467 consensus_queue.cc:1048] T 5f5cf3efa54b4344b04a87a87509d1f6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:55.586038 18563 consensus_queue.cc:1059] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:55.587483 18560 raft_consensus.cc:3055] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:55.587844 18560 raft_consensus.cc:740] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:55.588754 18560 consensus_queue.cc:260] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.589717 18560 raft_consensus.cc:3060] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.594480 16177 tablet_loader.cc:96] loaded metadata for tablet 5f1df2c9593442afa84849da6874f0f4 (table default.Table_57828eb9ca764faf923e3e68fd0233a8 [id=3fff8bc92af84e59a10a592e85ad8503])
I20260810 13:54:55.595019 18485 consensus_queue.cc:1048] T 3610bc4f8a0742fdb69347b40a04f078 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:55.601409 18563 consensus_queue.cc:1059] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.602345 18557 raft_consensus.cc:3055] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:55.602692 18557 raft_consensus.cc:740] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:55.608464 13638 raft_consensus.cc:385] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:55.609174 13638 raft_consensus.cc:740] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:55.610292 13638 consensus_queue.cc:260] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.611297 18557 consensus_queue.cc:260] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.612427 18557 raft_consensus.cc:3060] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.617870 18569 raft_consensus.cc:515] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:55.624820 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:55.497259 13164 leader_election.cc:304] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:55.504750 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 424918us
I20260810 13:54:55.597393 12951 leader_election.cc:304] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:55.643363 18485 raft_consensus.cc:2804] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:55.643761 18485 raft_consensus.cc:493] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:55.644104 18485 raft_consensus.cc:3060] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:55.645073 16177 tablet_loader.cc:96] loaded metadata for tablet 5f518df5c1414edba15ad72983c7f362 (table default.Table_fe0baa9629ad42fbb05cfbc004e62688 [id=907a4591204d4db697b44488fef76406])
I20260810 13:54:55.646541 16177 tablet_loader.cc:96] loaded metadata for tablet 5f5cf3efa54b4344b04a87a87509d1f6 (table default.Table_e9bf94db05cb46279abaeba00681ab82 [id=a547ccb6c9c24877b0b8d81d52e1630a])
I20260810 13:54:55.647711 16177 tablet_loader.cc:96] loaded metadata for tablet 5f7cac512bcd48cfb6aaba4dc7e5681e (table default.Table_d460b63b63de413ebdeeb708b4be6b10 [id=3d7325460d7842658631298c2538a71c])
I20260810 13:54:55.651487 13639 tablet_bootstrap.cc:492] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:55.651962 13639 ts_tablet_manager.cc:1403] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.178s user 0.006s sys 0.009s
W20260810 13:54:55.653059 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 55741.3us
I20260810 13:54:55.653769 12951 leader_election.cc:304] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:55.670441 18467 raft_consensus.cc:2749] T 53a99165463a43c78f4ccb6c5892f4b1 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.677093 18569 leader_election.cc:290] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:55.675390 12951 leader_election.cc:304] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
W20260810 13:54:55.681483 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 184616us
I20260810 13:54:55.682626 13640 tablet_bootstrap.cc:492] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:55.684568 13167 leader_election.cc:304] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.687785 13167 leader_election.cc:304] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.689967 13640 tablet_bootstrap.cc:654] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:55.684584 13164 leader_election.cc:304] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.691674 18420 raft_consensus.cc:2804] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:55.692078 18420 raft_consensus.cc:493] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:55.692463 18420 raft_consensus.cc:3060] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:55.695279 13639 raft_consensus.cc:359] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.712836 13639 raft_consensus.cc:385] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:55.713234 13639 raft_consensus.cc:740] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:55.709029 18464 consensus_queue.cc:1048] T 213e54b67ee94d299345a3d1eabc9ae6 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.710105 12951 leader_election.cc:304] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:55.703956 18420 raft_consensus.cc:515] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.705505 18485 raft_consensus.cc:515] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.718530 18485 leader_election.cc:290] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.719112 18464 raft_consensus.cc:2749] T dd58cc128ce64f9abe1418b6093a1c2c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.719947 18464 raft_consensus.cc:493] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:55.720363 18464 raft_consensus.cc:515] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.722378 18464 leader_election.cc:290] T ff1229ebe9304f19ab84d5a172aba937 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.723951 18464 consensus_queue.cc:1048] T 7529b349395a42ec96c7816f9e566079 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:55.724884 18563 consensus_queue.cc:1059] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.725165 18420 leader_election.cc:290] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.725268 18560 raft_consensus.cc:493] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.725762 18563 consensus_queue.cc:1243] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer 218e946161f64d1d92427684ac15e4fb log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260810 13:54:55.726198 18564 raft_consensus.cc:3055] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:55.725827 18560 raft_consensus.cc:515] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.726147 13639 consensus_queue.cc:260] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.726513 18564 raft_consensus.cc:740] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:55.727702 13639 ts_tablet_manager.cc:1434] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.075s user 0.007s sys 0.000s
I20260810 13:54:55.727267 18564 consensus_queue.cc:260] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.727849 18560 leader_election.cc:290] T 7c57ca566cfe47f6a331bbbe5c344a89 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
W20260810 13:54:55.731549 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 49315.4us
I20260810 13:54:55.731369 18540 consensus_queue.cc:1048] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:55.733040 18564 raft_consensus.cc:3060] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.733536 18540 raft_consensus.cc:2749] T cd3d4b038acb48ebaebef7a424f721c5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.734315 18356 raft_consensus.cc:2804] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:55.734791 18356 raft_consensus.cc:493] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:55.735275 18356 raft_consensus.cc:3060] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.730505 18399 raft_consensus.cc:2804] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260810 13:54:55.737133 18399 raft_consensus.cc:493] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:55.737493 18399 raft_consensus.cc:3060] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:55.741408 18532 raft_consensus.cc:2804] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:55.741868 18532 raft_consensus.cc:493] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:55.742230 18532 raft_consensus.cc:3060] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:55.742255 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 78394.8us
I20260810 13:54:55.743696 18464 consensus_queue.cc:1048] T ca4c0fea312c418f8ebd5c0619e7e220 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:55.744302 18563 consensus_queue.cc:1059] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:55.744354 18561 consensus_queue.cc:1048] T d1ec72a86a08452fb8b390b62f8c6dec P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:55.745429 18569 raft_consensus.cc:3055] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:55.745846 18569 raft_consensus.cc:740] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
W20260810 13:54:55.746785 12951 leader_election.cc:343] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:55.746701 18569 consensus_queue.cc:260] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.749980 13638 ts_tablet_manager.cc:1434] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.367s user 0.011s sys 0.009s
I20260810 13:54:55.757936 13167 leader_election.cc:304] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.765147 18589 raft_consensus.cc:2804] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:55.765492 18589 raft_consensus.cc:493] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:55.765815 18589 raft_consensus.cc:3060] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.769558 18532 raft_consensus.cc:515] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.773016 18591 consensus_queue.cc:1048] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260810 13:54:55.775913 13164 leader_election.cc:400] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001) with higher term. Message: Invalid argument: T c793dedc5e714fe6bd36e507695e82d0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3.
I20260810 13:54:55.785912 13638 tablet_bootstrap.cc:492] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:55.788605 13343 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:55.796293 18569 raft_consensus.cc:3060] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.797408 13167 leader_election.cc:304] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.799897 18595 raft_consensus.cc:2804] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:55.801720 18532 leader_election.cc:290] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.803294 13167 leader_election.cc:304] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.800420 18595 raft_consensus.cc:697] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:55.813396 13640 tablet_bootstrap.cc:492] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:55.795782 13639 tablet_bootstrap.cc:492] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:55.814028 13640 ts_tablet_manager.cc:1403] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.132s user 0.012s sys 0.000s
I20260810 13:54:55.748651 12951 leader_election.cc:304] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:55.816493 13640 raft_consensus.cc:359] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.817270 16177 tablet_loader.cc:96] loaded metadata for tablet 6187783a473a42488fabf362f9a156cf (table default.Table_fd80397e5f4247339b3e3d483a671afa [id=3f7a51368fe34ca6b66f5c810e94ae60])
I20260810 13:54:55.817369 13640 raft_consensus.cc:385] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:55.817457 18485 raft_consensus.cc:2749] T 729ffbfd767f4aa0b95f6545011aae3d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.817625 13640 raft_consensus.cc:740] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:55.818361 13640 consensus_queue.cc:260] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.819547 16177 tablet_loader.cc:96] loaded metadata for tablet 62aabe97aca9485fb2b40d67c989c210 (table default.Table_ee42df273bce4386bbf8edb282c2059a [id=8d115ba01bfd4ed7b90f6531e9ef66c2])
I20260810 13:54:55.819994 13640 ts_tablet_manager.cc:1434] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260810 13:54:55.821024 13640 tablet_bootstrap.cc:492] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
W20260810 13:54:55.825768 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 77200.2us
W20260810 13:54:55.808542 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 64861.5us
W20260810 13:54:55.827040 12951 leader_election.cc:343] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
W20260810 13:54:55.827066 13382 leader_election.cc:343] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:55.834223 18595 consensus_queue.cc:237] T 48a059240c0f48ee958ef728acfcae92 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.836654 13639 tablet_bootstrap.cc:654] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:55.839376 12951 leader_election.cc:304] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:55.841578 18420 raft_consensus.cc:2804] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:55.842011 18420 raft_consensus.cc:697] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:55.842664 18399 raft_consensus.cc:515] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.842854 18420 consensus_queue.cc:237] T 1a0f39d7fa7e4cac9dda6ec101229efd P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.844837 18540 raft_consensus.cc:2804] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:55.845217 18540 raft_consensus.cc:493] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:55.845577 18540 raft_consensus.cc:3060] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:55.849327 13164 leader_election.cc:304] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.851045 18554 raft_consensus.cc:2749] T 729ffbfd767f4aa0b95f6545011aae3d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.852502 18467 consensus_queue.cc:1048] T 82848ef8dc904879854929de47db1e50 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 13:54:55.854672 12951 leader_election.cc:343] T ad6a373308fa4b039e8331d9a0a90d16 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:55.854899 13167 leader_election.cc:304] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.872659 13638 tablet_bootstrap.cc:654] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:55.875213 13382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:55.879982 13640 tablet_bootstrap.cc:654] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:55.884352 12951 leader_election.cc:343] T bd3119d63857480294dcb68ed0451bc0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:55.819268 18356 raft_consensus.cc:515] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.888976 18591 raft_consensus.cc:2804] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:55.889362 18591 raft_consensus.cc:493] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:55.889669 18591 raft_consensus.cc:3060] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:55.888578 12951 leader_election.cc:304] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:55.934212 13164 leader_election.cc:304] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:55.934849 13167 leader_election.cc:304] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:55.935673 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 43580.3us
I20260810 13:54:55.933919 18580 consensus_queue.cc:1048] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260810 13:54:55.937769 18532 raft_consensus.cc:2804] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:55.938139 18580 raft_consensus.cc:2804] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:55.938632 18580 raft_consensus.cc:697] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
W20260810 13:54:55.877291 13382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:55.936448 13167 leader_election.cc:304] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.939586 18564 raft_consensus.cc:493] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:55.940057 18564 raft_consensus.cc:515] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.942111 18564 leader_election.cc:290] T f425739a239144048975fb15a26d197e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:55.890583 18356 leader_election.cc:290] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.873684 18399 leader_election.cc:290] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.835546 18589 raft_consensus.cc:515] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.958858 18589 leader_election.cc:290] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:55.938165 18532 raft_consensus.cc:493] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:55.960131 18532 raft_consensus.cc:3060] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:55.966894 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 48123.5us
I20260810 13:54:55.918071 18410 raft_consensus.cc:2749] T da664a1596554ee3890f58f0c54521a6 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 13:54:55.969563 13640 tablet_bootstrap.cc:492] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:55.970038 13640 ts_tablet_manager.cc:1403] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.149s user 0.009s sys 0.001s
I20260810 13:54:55.968252 12951 leader_election.cc:304] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:55.973783 12951 leader_election.cc:304] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.967597 18464 consensus_queue.cc:1048] T c1510cd3523646eba9333f7e6d85a5e8 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260810 13:54:55.967597 18295 consensus_queue.cc:1048] T 82fde417598648968b4013c54f0bc854 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260810 13:54:55.977228 18485 raft_consensus.cc:2749] T 452978fbf3b74e3c9b16756b9f394be7 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.978814 12951 leader_election.cc:304] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:55.974642 13640 raft_consensus.cc:359] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.980355 12951 leader_election.cc:304] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:55.980921 18410 raft_consensus.cc:2804] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:55.987921 18410 raft_consensus.cc:493] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:55.988288 18410 raft_consensus.cc:3060] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:55.990267 18464 raft_consensus.cc:2804] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:55.990741 18464 raft_consensus.cc:697] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Running, Role: LEADER
I20260810 13:54:55.991575 18464 consensus_queue.cc:237] T baa17cc9fd524b0981cb2368a7265df1 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.992336 13639 tablet_bootstrap.cc:492] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:55.981364 18561 raft_consensus.cc:2749] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:55.992766 13639 ts_tablet_manager.cc:1403] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.197s user 0.018s sys 0.004s
I20260810 13:54:55.994138 18540 raft_consensus.cc:515] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.995445 18554 raft_consensus.cc:2804] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:55.996521 18540 leader_election.cc:290] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.000267 16177 tablet_loader.cc:96] loaded metadata for tablet 62e88a52755140019a6d9f7041db0837 (table default.Table_9f48e93a010b4fc5b43124a1f8248ddf [id=011f63bf5ea44f918070a9ead229fa95])
I20260810 13:54:56.000838 13167 leader_election.cc:304] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
W20260810 13:54:55.992362 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:55.940222 18580 consensus_queue.cc:237] T 97015b4984c74a4682b6dedd47dc6650 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:55.982045 13640 raft_consensus.cc:385] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.002321 13640 raft_consensus.cc:740] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.003253 13640 consensus_queue.cc:260] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.004189 18532 raft_consensus.cc:515] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.020911 13027 raft_consensus.cc:1240] T e7553445e6124227872c0f2306940225 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:56.024549 13638 tablet_bootstrap.cc:492] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:56.025156 13640 ts_tablet_manager.cc:1434] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.054s user 0.005s sys 0.001s
I20260810 13:54:56.026292 13640 tablet_bootstrap.cc:492] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:56.017736 18591 raft_consensus.cc:515] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.031046 16177 tablet_loader.cc:96] loaded metadata for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5])
I20260810 13:54:56.035440 16177 tablet_loader.cc:96] loaded metadata for tablet 67ec9aba240b49e6a78c268b20dc901b (table default.Table_32a20912aef145aabc1b19b2b796c682 [id=6180bc58d52049fa82f92dc5e5a6b891])
I20260810 13:54:56.045814 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:56.046936 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d647bf5c1ba42f48186661310065448" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.047587 13049 raft_consensus.cc:2468] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:56.049494 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.056905 16177 tablet_loader.cc:96] loaded metadata for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f])
W20260810 13:54:56.040849 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 104586us
W20260810 13:54:56.060179 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 95294.4us
I20260810 13:54:56.060324 18595 raft_consensus.cc:2804] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election won for term 2
I20260810 13:54:56.061086 18595 raft_consensus.cc:697] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:56.062041 18595 consensus_queue.cc:237] T b335455cc01947a3a4ca6c368fea7bad P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.058007 18554 raft_consensus.cc:697] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:56.066543 13638 ts_tablet_manager.cc:1403] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.281s user 0.020s sys 0.003s
I20260810 13:54:56.067561 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.068313 18564 raft_consensus.cc:493] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.068774 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.068864 18564 raft_consensus.cc:515] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.070187 13039 raft_consensus.cc:1240] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:56.070987 18564 leader_election.cc:290] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:56.071238 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.071894 13056 raft_consensus.cc:2393] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:56.072535 16177 tablet_loader.cc:96] loaded metadata for tablet 6ad53d1da7b34194b4b7a78c52870c6b (table default.Table_75b64bcbee9441d3ad167d9bd6c4a6a3 [id=766aaf50fb2f4fbca53416a8e853f9c1])
I20260810 13:54:56.072587 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b54b73458a4c4201bc3b44259bc12436" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.075778 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.077088 13033 raft_consensus.cc:1240] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:56.079886 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.081184 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61169145c539464fa9cf62eaaf8168e5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.039896 18532 leader_election.cc:290] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.082557 16177 tablet_loader.cc:96] loaded metadata for tablet 6d19fba564324475a790174b4033ab1b (table default.Table_eebc498aa5734ab8b23c00b74d896ba9 [id=9756f3d17c15460e84863e49504d8349])
I20260810 13:54:56.083845 16177 tablet_loader.cc:96] loaded metadata for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64])
I20260810 13:54:56.089699 18564 raft_consensus.cc:493] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.090025 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.090261 18564 raft_consensus.cc:515] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.089694 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.091504 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.092429 18564 leader_election.cc:290] T 3db559714d84493ebaf7d3b51719d81c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:56.094900 16177 tablet_loader.cc:96] loaded metadata for tablet 6ec1f506c6cd4222b4bd6176ccd54e56 (table default.Table_e16662a9b5514b04b2d2fad48ad3d82f [id=51cc3d6cb6d248fc94d93654adfc72c0])
I20260810 13:54:56.100528 13039 raft_consensus.cc:1240] T 0d147e624d4243b9b330c874e0f27f6c P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:56.101308 16177 tablet_loader.cc:96] loaded metadata for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a])
I20260810 13:54:56.102634 16177 tablet_loader.cc:96] loaded metadata for tablet 73749dd3ba784553b316d2f70ae34073 (table default.Table_0cd1166b3e534639918d41544e409ec7 [id=631d4e81ac6b445183e988a0821e0e61])
I20260810 13:54:56.103951 16177 tablet_loader.cc:96] loaded metadata for tablet 73a7e7c310e24d8caca5756fe67631ce (table default.Table_3c8a09c1dfda4797918bd6715bdfebce [id=9656e3a9a8f6431cb7b42ea64ae16159])
I20260810 13:54:56.112190 16177 tablet_loader.cc:96] loaded metadata for tablet 73bc868e3bba4d8c80ac234e4be6b3a4 (table default.Table_7e2df1474a324a139e9e31ca581a4f34 [id=5b1484c8fdc64ee6a07bd203fa140fcb])
I20260810 13:54:56.030383 18591 leader_election.cc:290] T f37f4b2d04f84e119da2743234865baf P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.114881 13039 raft_consensus.cc:1240] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [term 2 LEADER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:56.116474 16177 tablet_loader.cc:96] loaded metadata for tablet 73c03f98d7804d22acbba72da63c121b (table default.Table_5fc84c8a61ad484e925fb92300a57223 [id=3362bc2f1ec147468f9605f59e00615c])
I20260810 13:54:56.082564 18554 consensus_queue.cc:237] T 0d147e624d4243b9b330c874e0f27f6c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.118122 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48a059240c0f48ee958ef728acfcae92" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.119001 13039 raft_consensus.cc:2393] T 48a059240c0f48ee958ef728acfcae92 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:56.118934 18410 raft_consensus.cc:515] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.125036 16177 tablet_loader.cc:96] loaded metadata for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311])
I20260810 13:54:56.126410 16177 tablet_loader.cc:96] loaded metadata for tablet 7529b349395a42ec96c7816f9e566079 (table default.Table_dddc44815f0c48f2ab1b3afc7ce9a316 [id=7a54639f4e1a4f1a82278d5d64b347b8])
I20260810 13:54:56.129638 13639 raft_consensus.cc:359] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.130383 13639 raft_consensus.cc:385] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.130661 13639 raft_consensus.cc:740] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.131357 13639 consensus_queue.cc:260] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.133322 13639 ts_tablet_manager.cc:1434] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.140s user 0.006s sys 0.000s
I20260810 13:54:56.134331 13639 tablet_bootstrap.cc:492] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:56.136101 13638 raft_consensus.cc:359] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.136862 13638 raft_consensus.cc:385] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.137282 18410 leader_election.cc:290] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 election: Requested vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.137178 13638 raft_consensus.cc:740] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.138411 13638 consensus_queue.cc:260] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.140499 13638 ts_tablet_manager.cc:1434] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.047s user 0.006s sys 0.000s
I20260810 13:54:56.144984 13638 tablet_bootstrap.cc:492] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:56.145215 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.668s (SENT)
I20260810 13:54:56.145439 13640 tablet_bootstrap.cc:654] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.145617 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:56.160698 18564 raft_consensus.cc:493] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.161258 18564 raft_consensus.cc:515] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.167840 18540 raft_consensus.cc:493] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.170161 18564 leader_election.cc:290] T bd3119d63857480294dcb68ed0451bc0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:56.168391 18540 raft_consensus.cc:515] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.183023 18540 leader_election.cc:290] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.128479 16177 tablet_loader.cc:96] loaded metadata for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa])
I20260810 13:54:56.192936 13164 leader_election.cc:304] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.193759 18540 raft_consensus.cc:2764] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260810 13:54:56.194286 16177 tablet_loader.cc:96] loaded metadata for tablet 760914a47cc744b7bdf3b40a85b3369c (table default.Table_7cbcdca887724284a33c681c9574ea82 [id=8a8a45a7ac264648b3810d9c69a36751])
I20260810 13:54:56.195513 16177 tablet_loader.cc:96] loaded metadata for tablet 7685f9b4b25541d98cfdaba36cd0276c (table default.Table_f0a8373b96114e0c896e54dcb940f74d [id=0c70c375ac604d158df38f374fc3c1d1])
I20260810 13:54:56.196854 16177 tablet_loader.cc:96] loaded metadata for tablet 7800f588f3d64230b759c8814d169dbe (table default.Table_6ac40be3cf9b4f9d8a8f29bec786be18 [id=3fa9cd2a62034a4d81a0b740d5c31447])
I20260810 13:54:56.201357 13638 tablet_bootstrap.cc:654] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.206466 18618 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260810 13:54:56.208247 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 63076.6us
W20260810 13:54:56.227211 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:56.236292 16177 tablet_loader.cc:96] loaded metadata for tablet 788ac374894c437fa8644493b7678747 (table default.Table_c752da6252ce4541be9cef2bce47bfe3 [id=178f273145a74eb2a2de7da53f248126])
I20260810 13:54:56.238279 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:56.245028 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:56.247213 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:56.255406 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.254958 16177 tablet_loader.cc:96] loaded metadata for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343])
I20260810 13:54:56.256546 13039 raft_consensus.cc:2468] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:56.262054 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.265789 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.266902 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.267988 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4ecf9abd60848f993234e98284974e8" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.268805 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd127b3e02b54ba2a802877233c18247" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.269179 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.270256 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.271381 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafed58a5994479e91678ddbe74cd353" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.272526 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4687f8fd44034ce28727c3b7e58e7fe9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.274556 13164 leader_election.cc:304] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.276149 18595 raft_consensus.cc:2804] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:56.276898 16177 tablet_loader.cc:96] loaded metadata for tablet 7967a22850ae48a58fbcb8cb17f189e9 (table default.Table_d5c509cabbb84883a9a911c2f4e04c88 [id=865c0ec036ca45caaec23fe2cf899d1d])
I20260810 13:54:56.277455 18595 raft_consensus.cc:697] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:56.278563 18595 consensus_queue.cc:237] T a27bf786a8274954afc2b2d8cfb34bf0 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.281844 18622 raft_consensus.cc:493] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.278321 16177 tablet_loader.cc:96] loaded metadata for tablet 7a07cf0ebb0f4bc6816c119a4b2af17f (table default.Table_51b05316075a49bc898ede0e35031c70 [id=359af78e1c844299a56756c90613d641])
I20260810 13:54:56.288327 16177 tablet_loader.cc:96] loaded metadata for tablet 7a5114911fdf4b19afec0c71ded5ef9a (table default.Table_8a8233c099eb45dba66c3d0f9bdbe18b [id=d9a327f6557d42bb998964e1d594cb1c])
I20260810 13:54:56.291086 13640 tablet_bootstrap.cc:492] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:56.291775 13640 ts_tablet_manager.cc:1403] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.266s user 0.011s sys 0.000s
I20260810 13:54:56.294817 13640 raft_consensus.cc:359] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.295584 13640 raft_consensus.cc:385] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.295904 13640 raft_consensus.cc:740] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.282414 18622 raft_consensus.cc:515] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.303413 16177 tablet_loader.cc:96] loaded metadata for tablet 7a7bddc8e6374437a37aeb755389d91f (table default.Table_3ffb4babc30c4b76ae97168cb6dbdeee [id=66920d867573408d811d1fa6b877d355])
I20260810 13:54:56.306135 18622 leader_election.cc:290] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:56.322618 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 46864.2us
I20260810 13:54:56.323298 18537 raft_consensus.cc:493] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:56.323477 13164 leader_election.cc:343] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:56.323832 18537 raft_consensus.cc:515] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.324183 13164 leader_election.cc:304] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.326004 18537 leader_election.cc:290] T b7a45cb763a84c7aa557fde815a92c07 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.275435 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b67e5a2b5334147b9d25f2ddc73de31" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.275704 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.273666 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.296643 13640 consensus_queue.cc:260] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.331924 13640 ts_tablet_manager.cc:1434] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.040s user 0.004s sys 0.000s
I20260810 13:54:56.332727 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ec72a86a08452fb8b390b62f8c6dec" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:56.335297 16177 tablet_loader.cc:96] loaded metadata for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480])
I20260810 13:54:56.338842 16177 tablet_loader.cc:96] loaded metadata for tablet 7ca9ab174bc8461a9fccdc7a7d11b486 (table default.Table_230d8010fef046048e532692ee7681c8 [id=01dba6a69dec44aeb2f402dddb3e0cae])
I20260810 13:54:56.339334 18540 raft_consensus.cc:2749] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:56.340469 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1122dcf7bcea4654bf29ff01fc4a350d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.342116 13164 leader_election.cc:304] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.346859 18464 raft_consensus.cc:493] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:56.347415 18464 raft_consensus.cc:515] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.350366 18464 leader_election.cc:290] T 61fd4d043c354ad79d79c32498a469b4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.351037 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3066b475871c45fdbe585947fd6800c9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.353508 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.356662 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.358805 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.360574 13639 tablet_bootstrap.cc:654] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.361567 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.362890 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]). Expected version 1 got 0
I20260810 13:54:56.364151 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6]). Expected version 1 got 0
I20260810 13:54:56.365252 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 35317d87beb24a01b8df52b1cbba375c (table default.Table_faddfbc6bc0c46e48418e182f2f9d9e8 [id=1af9cba54811465b92dea0126a1367ef]). Expected version 1 got 0
I20260810 13:54:56.367319 12481 catalog_manager.cc:5719] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1). New cstate: current_term: 1 leader_uuid: "88ed04d733ec447583fc897e233dd4b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } }
I20260810 13:54:56.368508 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1]). Expected version 1 got 0
I20260810 13:54:56.369472 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f764e91bb2c94bc3be425b65323764cb (table default.Table_aa7cf0f5ab7641819ef6d1ae10fcd202 [id=fe86ae518e3342539033ead65bdb93c8]). Expected version 1 got 0
I20260810 13:54:56.373157 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 6453dd9e48244c87b339ec515898bb0c (table default.Table_dc897ab302154802b021987cd5daf577 [id=e4eadf37ae6346738d1b0ca016f03ac5]). Expected version 1 got 0
I20260810 13:54:56.373802 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.374140 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1c6686175347496093cb22ce8a3d4176 (table default.Table_313e0e31754047dea43eccf3a2e8b3c6 [id=cb18564fa3e448818427fa7e8597605e]). Expected version 1 got 0
I20260810 13:54:56.375124 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01]). Expected version 2 got 0
I20260810 13:54:56.376053 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162]). Expected version 1 got 0
I20260810 13:54:56.376873 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.377543 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751]). Expected version 1 got 0
I20260810 13:54:56.378623 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe]). Expected version 2 got 0
I20260810 13:54:56.379091 16177 tablet_loader.cc:96] loaded metadata for tablet 815f4333c441441ca8e857df66a0263e (table default.Table_8606de06b2994b3291a5ee1e28ad7100 [id=7162bee4392749a38057f272df172987])
I20260810 13:54:56.379220 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f764e91bb2c94bc3be425b65323764cb" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.379315 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f668f6b35dc044a1a79f1d5852d39497 (table default.Table_7f2a0ec7817644299f02aabaf3f8b0a3 [id=c18879491d6c486f9efc439e3d239810]). Expected version 1 got 0
I20260810 13:54:56.380409 16177 tablet_loader.cc:96] loaded metadata for tablet 81de7fcb3bc745a5b0ea7ffb45dbcfce (table default.Table_96cdf642a68642ce9fe947569577b42a [id=667ccf7ba20c49b2be82e167aa212ecd])
I20260810 13:54:56.381110 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.381870 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 75b8030450554de3b97266f348329ea6 (table default.Table_5747b50b5c334f3aa7aa899f363bad0a [id=924550c187ce43b4940231335048eefa]). Expected version 2 got 0
I20260810 13:54:56.383276 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6406062bb0934eadae901502806178b5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.383901 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.384274 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.385739 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb]). Expected version 1 got 0
I20260810 13:54:56.386385 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.386452 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3]). Expected version 1 got 0
I20260810 13:54:56.387723 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7]). Expected version 1 got 0
I20260810 13:54:56.388199 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.388619 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e]). Expected version 1 got 0
I20260810 13:54:56.390030 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 6d2d209f801b4aa0aff3137a51fc7556 (table default.Table_59f9e0ad8f2e4f1f9f8dec27fb564bc5 [id=8ad7f793f5494d0091f42aed3d345e64]). Expected version 4 got 0
I20260810 13:54:56.393400 13640 tablet_bootstrap.cc:492] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:56.398770 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582]). Expected version 1 got 0
I20260810 13:54:56.401224 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee]). Expected version 1 got 0
I20260810 13:54:56.404997 13639 tablet_bootstrap.cc:492] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:56.405514 13639 ts_tablet_manager.cc:1403] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.271s user 0.011s sys 0.000s
I20260810 13:54:56.405400 18622 raft_consensus.cc:2749] T 1a0f39d7fa7e4cac9dda6ec101229efd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:56.409195 13639 raft_consensus.cc:359] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:56.409873 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 67838.3us
I20260810 13:54:56.410072 13639 raft_consensus.cc:385] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.410419 13639 raft_consensus.cc:740] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.417932 16177 tablet_loader.cc:96] loaded metadata for tablet 82848ef8dc904879854929de47db1e50 (table default.Table_229c64c5f5804f6c8a3047ec7858322b [id=f8aaac66943a4d9d8d2bf15d12a18009])
I20260810 13:54:56.419334 16177 tablet_loader.cc:96] loaded metadata for tablet 82fde417598648968b4013c54f0bc854 (table default.Table_8054f93e82de4c898987acb86f25e5d0 [id=0685b3b0945a493db836d29e5993e447])
I20260810 13:54:56.420581 16177 tablet_loader.cc:96] loaded metadata for tablet 82fe5ef58d9a49389a201ea7c51faad5 (table default.Table_77e30d5f98584b9e9711faa0b7a824df [id=6afc4e9a485640dda167bbaa0d6b347e])
I20260810 13:54:56.421258 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f600e14cc2a64f6bb5cf8d4057ad45b5 (table default.Table_03969f7d41104ba7bfd4d97a511eae52 [id=8002eabb2979433ab1c98eafdbe23470]). Expected version 1 got 0
I20260810 13:54:56.422250 13639 consensus_queue.cc:260] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.423513 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4da9b26ef40e4f7a8f9dfdc8f7ccfc8f (table default.Table_c29041511caa4b378bfc1284cfc550be [id=285a3bf81f67425a9f37fb89d795a279]). Expected version 2 got 0
I20260810 13:54:56.427330 13640 tablet_bootstrap.cc:654] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.428407 13638 tablet_bootstrap.cc:492] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:56.429195 13164 leader_election.cc:304] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.430061 18537 raft_consensus.cc:2804] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:56.430421 18537 raft_consensus.cc:493] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:56.430529 13164 leader_election.cc:304] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.430765 18537 raft_consensus.cc:3060] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:56.432655 16177 tablet_loader.cc:96] loaded metadata for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b])
I20260810 13:54:56.434341 13164 leader_election.cc:304] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.435067 18540 raft_consensus.cc:2804] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader election won for term 3
I20260810 13:54:56.435545 18540 raft_consensus.cc:697] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [term 3 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:56.436873 18595 raft_consensus.cc:2804] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:56.437242 18595 raft_consensus.cc:493] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:56.436357 18540 consensus_queue.cc:237] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.437582 18595 raft_consensus.cc:3060] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:56.438499 13638 ts_tablet_manager.cc:1403] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.294s user 0.007s sys 0.011s
I20260810 13:54:56.444406 13639 ts_tablet_manager.cc:1434] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.039s user 0.003s sys 0.003s
I20260810 13:54:56.444190 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "918edf5d7b4f45009c5d476588399d0c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.445547 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.446565 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "094a3448b54c409281c31813e60dcb7f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.447592 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.448529 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.448676 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5cf3efa54b4344b04a87a87509d1f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.449234 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf672d15f88c4f0dbdf2fdb6aefa1108" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.449538 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.452803 13037 raft_consensus.cc:2468] T 91e169a9bbc24a5196b1bdaf5bb06207 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 3.
I20260810 13:54:56.449820 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.454183 13049 raft_consensus.cc:2468] T 7a490fcb16164f968335f069129b3d71 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:56.450121 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.455349 13033 raft_consensus.cc:2468] T d6487d26c6524c38a313b54d5431b6f6 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 3.
I20260810 13:54:56.456255 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.456861 13027 raft_consensus.cc:2468] T 387ebbb8677c4fb082006585389c6582 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 3.
I20260810 13:54:56.461447 16177 tablet_loader.cc:96] loaded metadata for tablet 83c7a8e941ea433d890fdbea2b754f22 (table default.Table_0dd7b499a7f548c08269cf1858c67aeb [id=0eb0b4069592419abf43b72e6c4df751])
I20260810 13:54:56.462842 16177 tablet_loader.cc:96] loaded metadata for tablet 8473def35a97492a9172b483c2d670d9 (table default.Table_312808fed3bf45e8923e2b1be7f4d9fa [id=4de804595a6142819c0ea2f64fd1e34c])
I20260810 13:54:56.443608 18537 raft_consensus.cc:515] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.474255 13638 raft_consensus.cc:359] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.475041 13638 raft_consensus.cc:385] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.475322 13638 raft_consensus.cc:740] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.476475 18537 leader_election.cc:290] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.477072 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d321f9c075554ffcb299d02792a0662d (table default.Table_da3e46db73d44e2cb3b90775b78c2a15 [id=5270e00901e54049b16f185df852ad49]). Expected version 1 got 0
I20260810 13:54:56.478076 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055]). Expected version 1 got 0
I20260810 13:54:56.460179 13639 tablet_bootstrap.cc:492] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:56.478377 13164 leader_election.cc:304] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.483322 18537 raft_consensus.cc:493] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.485452 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 009307ae14cf4e7db54b2146c0c4d143 (table default.Table_021012dfc1b243daae27555cf7c6f486 [id=6b29d52bd21640b8be94cad6027e5fcd]). Expected version 1 got 0
I20260810 13:54:56.485824 18554 raft_consensus.cc:2749] T 53a99165463a43c78f4ccb6c5892f4b1 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:56.488142 18537 raft_consensus.cc:515] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.487035 18622 raft_consensus.cc:493] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.486611 18605 raft_consensus.cc:493] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.489899 18605 raft_consensus.cc:515] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:56.492120 18605 leader_election.cc:290] T fe5796052fd94c1e8fce159a6a90830c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.489018 18622 raft_consensus.cc:515] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.492944 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 729ffbfd767f4aa0b95f6545011aae3d (table default.Table_2449eba54b934f32b8c0063459e57139 [id=3044ffdea20441adb12ccfcc4219520a]). Expected version 1 got 0
I20260810 13:54:56.493598 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 691aac16d50745d6965bebe94831b67b (table default.Table_e87df72c6b134d5cbfd146205ab6f1bb [id=205fbfef06484d8e854f6ef7f471944f]). Expected version 1 got 0
I20260810 13:54:56.494341 18622 leader_election.cc:290] T 1d78892783474b329e31bf2df7d2952c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.494757 18622 raft_consensus.cc:493] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.495173 18622 raft_consensus.cc:515] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.496318 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734]). Expected version 1 got 0
I20260810 13:54:56.497931 13552 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:56.498498 18622 leader_election.cc:290] T 121d7abf368a4cf99fd045b8c8ba4b69 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.499444 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.504333 13639 tablet_bootstrap.cc:654] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.507339 16177 tablet_loader.cc:96] loaded metadata for tablet 8d860c257b794cce8f215ca7e871d6b0 (table default.Table_004ad2bd15214f94a0c183ec75f725ca [id=240ee1976c8f40c59438f7f22839e297])
I20260810 13:54:56.508796 18537 leader_election.cc:290] T 69ecda19e4f143c99654aff6058ad8bb P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.483748 13638 consensus_queue.cc:260] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.511003 13638 ts_tablet_manager.cc:1434] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.072s user 0.005s sys 0.000s
I20260810 13:54:56.511886 13638 tablet_bootstrap.cc:492] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:56.523761 13164 leader_election.cc:304] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.525118 18622 raft_consensus.cc:2749] T dd58cc128ce64f9abe1418b6093a1c2c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260810 13:54:56.527616 13640 tablet_bootstrap.cc:492] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:56.533329 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 57fc6408d6664e9887b150d1cb934a8d (table default.Table_2750add756654c54aaf63edfb3f51b3c [id=0865aeb0877147babbc3f19c5efb175d]). Expected version 1 got 0
I20260810 13:54:56.517071 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a4341f5d274a9eb54cb030b47c9a91" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.485512 18595 raft_consensus.cc:515] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.518474 13056 raft_consensus.cc:1240] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:56.519238 13027 raft_consensus.cc:1240] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260810 13:54:56.519481 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9ccbe2b9e3466dbc5fd23b2ea5a6a4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.519764 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.535269 13037 raft_consensus.cc:2468] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:56.520362 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:56.521016 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5114911fdf4b19afec0c71ded5ef9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.508600 16177 tablet_loader.cc:96] loaded metadata for tablet 8e11d3197c5146e19dcbc2ca5015d224 (table default.Table_dd910306a7864aeb9230c62730dc3ff4 [id=ee077cecabdd48809356d55acc5604a6])
I20260810 13:54:56.536803 18595 leader_election.cc:290] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.521518 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c57ca566cfe47f6a331bbbe5c344a89" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.521689 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:56.537428 13040 raft_consensus.cc:3060] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:56.538219 16177 tablet_loader.cc:96] loaded metadata for tablet 8e82c1366b534a11b7d615c3602406af (table default.Table_9ec2734c1c43472ca16731c99911a350 [id=b5072df8be3e4cc58980380d089942e2])
I20260810 13:54:56.523322 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f425739a239144048975fb15a26d197e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.523921 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a373308fa4b039e8331d9a0a90d16" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.545722 13040 raft_consensus.cc:2468] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:56.549825 13640 ts_tablet_manager.cc:1403] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.157s user 0.011s sys 0.000s
I20260810 13:54:56.549193 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 0be536894b164edfb4310ff521e2fb42 (table default.Table_2be31928f14c44f5a3916dbb4201225b [id=6708e032457744e299b929d795585c2c]). Expected version 2 got 0
I20260810 13:54:56.550623 16177 tablet_loader.cc:96] loaded metadata for tablet 91e169a9bbc24a5196b1bdaf5bb06207 (table default.Table_383bd937c51942a1b124430d2b5086af [id=82f67714ca3b4e6aab8557bd0f53d264])
I20260810 13:54:56.551249 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18]). Expected version 1 got 0
I20260810 13:54:56.555946 12481 catalog_manager.cc:5719] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 1 to 2, leader changed from 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1) to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 2 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:56.558158 13640 raft_consensus.cc:359] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.559859 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet d7ffb0f96e744a4bb734aba7f3d82995 (table default.Table_a59b3f3ad0b748d4a4fb33551877207c [id=a76911e4f6db4081b810faa3521fc694]). Expected version 1 got 0
I20260810 13:54:56.561806 13640 raft_consensus.cc:385] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.566074 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.566735 13043 raft_consensus.cc:2468] T 3db559714d84493ebaf7d3b51719d81c P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 3.
I20260810 13:54:56.568796 13640 raft_consensus.cc:740] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
W20260810 13:54:56.569423 13164 leader_election.cc:343] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001): Illegal state: must be running to vote when last-logged opid is not known
I20260810 13:54:56.570184 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3119d63857480294dcb68ed0451bc0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:56.572911 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:56.573474 13640 consensus_queue.cc:260] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.575480 13640 ts_tablet_manager.cc:1434] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260810 13:54:56.576727 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ee6e694366543328526313d7018b5db" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:56.577154 12481 catalog_manager.cc:5719] T 73a7e7c310e24d8caca5756fe67631ce P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 1 to 2, leader changed from 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1) to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 2 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:56.579677 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98ce3cccca464b938fd45afe292b4ad8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:56.578773 12481 catalog_manager.cc:5719] T 288debea4aa045d1898483cde1d4d3b1 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 1 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:56.583876 13164 leader_election.cc:304] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.587069 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:56.588097 13638 tablet_bootstrap.cc:654] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.589129 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:56.589877 13453 raft_consensus.cc:2410] T e7553445e6124227872c0f2306940225 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260810 13:54:56.594805 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82fde417598648968b4013c54f0bc854" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:56.595304 13453 raft_consensus.cc:2376] T 82fde417598648968b4013c54f0bc854 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1. Re-sending same reply.
I20260810 13:54:56.597183 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:56.598096 13453 raft_consensus.cc:2393] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:56.603346 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:56.592933 18605 raft_consensus.cc:2749] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:56.603879 13468 raft_consensus.cc:2376] T 3610bc4f8a0742fdb69347b40a04f078 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1. Re-sending same reply.
I20260810 13:54:56.601402 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:56.606304 13453 raft_consensus.cc:2376] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1. Re-sending same reply.
I20260810 13:54:56.611207 13468 raft_consensus.cc:1275] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260810 13:54:56.611503 13468 pending_rounds.cc:85] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting all ops after (but not including) 0
I20260810 13:54:56.611701 13468 pending_rounds.cc:107] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260810 13:54:56.611637 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970]). Expected version 1 got 0
I20260810 13:54:56.611902 13468 raft_consensus.cc:2889] T 49bf6a1f14bb4513b1addc4141b71373 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:56.620128 13468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:56.621516 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 7c57ca566cfe47f6a331bbbe5c344a89 (table default.Table_b1334223999b4a9398587fee71103d62 [id=e777a5cbd2464ee7a8dbbb4b2eef6480]). Expected version 1 got 0
I20260810 13:54:56.622263 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7]). Expected version 1 got 0
I20260810 13:54:56.626268 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414]). Expected version 1 got 0
I20260810 13:54:56.627493 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet ebb1392a98aa4af199236e4b4b4ab3c5 (table default.Table_7417382a79834243946b1020f4399428 [id=2eb26210a5744aa5bbff1c1d39790f80]). Expected version 1 got 0
I20260810 13:54:56.630193 13638 tablet_bootstrap.cc:492] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:56.630662 13638 ts_tablet_manager.cc:1403] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.119s user 0.007s sys 0.003s
I20260810 13:54:56.633456 13638 raft_consensus.cc:359] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.635092 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3]). Expected version 1 got 0
I20260810 13:54:56.637481 13639 tablet_bootstrap.cc:492] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:56.638034 13639 ts_tablet_manager.cc:1403] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.178s user 0.009s sys 0.005s
I20260810 13:54:56.641103 13639 raft_consensus.cc:359] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.641913 13639 raft_consensus.cc:385] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.643425 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4520d51666b04814814fbaa8b71430fc (table default.Table_bbd75dd66aa8416d924106d384b46ed7 [id=3ee39e801f0245a8b38bd2c44ee239cd]). Expected version 1 got 0
I20260810 13:54:56.644068 13638 raft_consensus.cc:385] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.644245 16177 tablet_loader.cc:96] loaded metadata for tablet 9334ba72cfd94fa4a7062a29445c69f9 (table default.Table_276835c42e5a48309351dd4e441cc62f [id=4d5771db00ae42b9957c6453d83f81ae])
I20260810 13:54:56.645781 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1a82b2b44e0247f982294e5180842db3 (table default.Table_a065ba49538e42ecb5640fb5fedcc382 [id=56bf1840eb56445d82664d41b663ecc6]). Expected version 1 got 0
I20260810 13:54:56.646325 13638 raft_consensus.cc:740] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.646890 16177 tablet_loader.cc:96] loaded metadata for tablet 9467e5c106b14619a7bf1f3e1f4f9c72 (table default.Table_6d071c01702c4d3cb0e693f02ef8a90f [id=20edfa4b7c00446bae121b000f8faf5f])
I20260810 13:54:56.647360 13638 consensus_queue.cc:260] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.651008 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 5579f4f12fb9495390d8261d24d120d8 (table default.Table_fbd2d824d17949508201413ec47a331f [id=b5552da41a544323a596c1d9715a7224]). Expected version 1 got 0
I20260810 13:54:56.653134 13638 ts_tablet_manager.cc:1434] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260810 13:54:56.653446 13474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:56.654160 13474 raft_consensus.cc:2393] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:56.667366 13640 tablet_bootstrap.cc:492] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:56.667045 12481 catalog_manager.cc:5719] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb reported cstate change: term changed from 1 to 2, leader changed from 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1) to 218e946161f64d1d92427684ac15e4fb (127.12.36.2). New cstate: current_term: 2 leader_uuid: "218e946161f64d1d92427684ac15e4fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } health_report { overall_health: UNKNOWN } } }
I20260810 13:54:56.669580 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet e3f4b863f701471ab173b68049b1a602 (table default.Table_47f2e1756c654cdeb68df0cedb31fc1e [id=c6ed8601e0a247318e4b9177c74b1391]). Expected version 2 got 0
I20260810 13:54:56.670261 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet dd58cc128ce64f9abe1418b6093a1c2c (table default.Table_ef4ac07aac5d4bc7993e09b22003497a [id=84fa9b446459413fbc0b1c72e262acec]). Expected version 3 got 0
I20260810 13:54:56.671542 13638 tablet_bootstrap.cc:492] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:56.673583 13640 tablet_bootstrap.cc:654] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.674464 13639 raft_consensus.cc:740] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.675328 13639 consensus_queue.cc:260] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.630666 13164 leader_election.cc:304] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.677042 13639 ts_tablet_manager.cc:1434] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260810 13:54:56.677222 18595 raft_consensus.cc:2804] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:56.677656 18595 raft_consensus.cc:493] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:56.677992 18595 raft_consensus.cc:3060] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:56.680240 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:56.680899 13462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
W20260810 13:54:56.685029 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 54458.2us
I20260810 13:54:56.690572 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f425739a239144048975fb15a26d197e (table default.Table_568e3a24b182478ab6205746311d5725 [id=b41bc79022ca450faafad8b504afe6ea]). Expected version 1 got 0
W20260810 13:54:56.690765 13382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:56.686563 18595 raft_consensus.cc:515] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.699700 18595 leader_election.cc:290] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.701193 18622 consensus_queue.cc:1048] T d6487d26c6524c38a313b54d5431b6f6 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:56.703181 16177 tablet_loader.cc:96] loaded metadata for tablet 953f83dab3ca406f8638e446911614b0 (table default.Table_d51002366e9948b1a840425abef8cef8 [id=c09b5ac2aeb74f1eaae14574cb8fe582])
I20260810 13:54:56.697687 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 006c7409946a4122a95468288ed3aef0 (table default.Table_4af17ad5784a4e52b2dbd660bde940e0 [id=4382337c7dcd4747b3e6abb01c288085]). Expected version 1 got 0
I20260810 13:54:56.709421 18605 consensus_queue.cc:1048] T 3db559714d84493ebaf7d3b51719d81c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:56.710815 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:56.712420 18605 consensus_queue.cc:1048] T 91e169a9bbc24a5196b1bdaf5bb06207 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260810 13:54:56.715657 13638 tablet_bootstrap.cc:654] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.719010 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1bbee4f9a50342599434a2b05c0740bd (table default.Table_fb06dafcfccb4167954aa3010890df4f [id=53f4e0e75cee4b53a7ba2b30f19025cc]). Expected version 3 got 0
I20260810 13:54:56.722195 18605 consensus_queue.cc:1048] T a42d57a7f6e2424998f5aebf0c8407d5 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:56.723080 18564 raft_consensus.cc:493] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.723568 18564 raft_consensus.cc:515] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.725322 13639 tablet_bootstrap.cc:492] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:56.726612 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 78e70ef9f0b642ab92d866cac1263cf8 (table default.Table_b0a69610e50f4a43b2582f0cbfb2c87a [id=5746ef7caeef407f98af956e742d7343]). Expected version 1 got 0
I20260810 13:54:56.734155 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 4793f262a5e44f9e804c27092b110921 (table default.Table_d805dec488a54cf98f2630fbc15a1be4 [id=b034ec9d1f604beb8ec0b15c3a3cc1a2]). Expected version 1 got 0
I20260810 13:54:56.734835 18605 consensus_queue.cc:1048] T 7a490fcb16164f968335f069129b3d71 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:56.737438 18605 consensus_queue.cc:1048] T 387ebbb8677c4fb082006585389c6582 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260810 13:54:56.738996 16177 tablet_loader.cc:96] loaded metadata for tablet 95ad70febdef4f59b252bc5f1bf6d25e (table default.Table_ea7f41d802964936a967be553d7418fe [id=96574627e23442ebb0323b065423efae])
I20260810 13:54:56.740118 13452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:56.741752 16177 tablet_loader.cc:96] loaded metadata for tablet 96f66a5c6837404b96e1937a73aa1f19 (table default.Table_dfe0fd41b106448e8a729e593ac63e5a [id=342af46254364715a3eb6166299c7275])
I20260810 13:54:56.743266 16177 tablet_loader.cc:96] loaded metadata for tablet 97015b4984c74a4682b6dedd47dc6650 (table default.Table_f037ea1532b04d68bf8d49f557b2e258 [id=c2257ea8197743dcaa568bfa151a5cfe])
I20260810 13:54:56.743551 13164 leader_election.cc:304] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.747016 18605 raft_consensus.cc:2804] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:56.747525 18605 raft_consensus.cc:493] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.748051 18605 raft_consensus.cc:3060] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:56.756063 13164 leader_election.cc:304] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb; no voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.757851 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:56.766117 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 74427ad2017c46cd909973a4b8a83d04 (table default.Table_544dff9fafd242b687272b507aafbd47 [id=1517a4d06f184f4f9df211f1d47e3311]). Expected version 1 got 0
I20260810 13:54:56.772281 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f3d299c668c444908ccdc2f36873ad24 (table default.Table_ba01d0c61c5e48c8a9e4a12b5739a568 [id=944d7f0374e343c39b2d2fb4aa5744b1]). Expected version 2 got 0
I20260810 13:54:56.778028 13639 tablet_bootstrap.cc:654] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.797416 18595 raft_consensus.cc:2749] T 61fd4d043c354ad79d79c32498a469b4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:56.800208 13164 leader_election.cc:304] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:56.801126 18595 raft_consensus.cc:2804] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260810 13:54:56.801559 18595 raft_consensus.cc:493] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.802007 18595 raft_consensus.cc:3060] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Advancing to term 4
I20260810 13:54:56.813725 18595 raft_consensus.cc:515] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.815657 18595 leader_election.cc:290] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 4 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.816129 18540 raft_consensus.cc:493] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.816614 18540 raft_consensus.cc:515] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.818524 18540 leader_election.cc:290] T ac9e3d3430044a5e85e2d812b7e221f5 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.823393 18605 raft_consensus.cc:515] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.825103 13639 tablet_bootstrap.cc:492] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:56.827461 16177 tablet_loader.cc:96] loaded metadata for tablet 97127b08237c4d2e81f9966db12d3fdb (table default.Table_abd953d9dc7945f78043250fc2ba2cde [id=4cb43a7a936a4d23b6f072ff384532b1])
I20260810 13:54:56.828590 16177 tablet_loader.cc:96] loaded metadata for tablet 9752c50dac794b3f9e6430e982d9cbe2 (table default.Table_f835565354f042368700f4252335e8eb [id=84ca48404db8439697f8035aa3bc34d3])
I20260810 13:54:56.829945 16177 tablet_loader.cc:96] loaded metadata for tablet 98a59da23cfa4b5a9713b135d7fa4366 (table default.Table_434a11c94e0d4745aaf9a178ac49b127 [id=ff65e1ef699a4b6384f45675b49e344e])
I20260810 13:54:56.831001 13639 ts_tablet_manager.cc:1403] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.106s user 0.010s sys 0.003s
I20260810 13:54:56.831303 16177 tablet_loader.cc:96] loaded metadata for tablet 98ce3cccca464b938fd45afe292b4ad8 (table default.Table_4f7895e8b4164093b5fa194d7f828d2a [id=f492b2e2f4cf4205a7d147ddad56af40])
I20260810 13:54:56.838764 13638 tablet_bootstrap.cc:492] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:56.839300 13638 ts_tablet_manager.cc:1403] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.168s user 0.004s sys 0.010s
I20260810 13:54:56.841899 13638 raft_consensus.cc:359] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.842594 13638 raft_consensus.cc:385] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.842878 13638 raft_consensus.cc:740] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.840823 13639 raft_consensus.cc:359] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.849331 13639 raft_consensus.cc:385] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.850158 13639 raft_consensus.cc:740] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.852375 18540 raft_consensus.cc:493] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.852169 13639 consensus_queue.cc:260] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.852893 18540 raft_consensus.cc:515] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.855260 13639 ts_tablet_manager.cc:1434] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260810 13:54:56.855305 18540 leader_election.cc:290] T 8d647bf5c1ba42f48186661310065448 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.858872 13639 tablet_bootstrap.cc:492] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:56.798172 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:56.864804 18640 log.cc:927] Time spent T 613d7ddce24b45c886139bf68c3c9a4d P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.064s user 0.000s sys 0.000s
I20260810 13:54:56.872541 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 1a575515446d4e7db38c75820908b743 (table default.Table_e0fd5e88d6824a4d85e9c9f5e9afbb8d [id=4747556e31c14e13b32ab1185728166e]). Expected version 1 got 0
I20260810 13:54:56.876116 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 83239e6cbf1c431fb2fb2a2dae105d61 (table default.Table_03c25c1a5c044fe7b7f9fe7275551c5c [id=2f32987b467647d1855c8d231c3a215b]). Expected version 1 got 0
W20260810 13:54:56.877075 13164 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 76961us
I20260810 13:54:56.877873 13164 leader_election.cc:304] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:56.878629 18540 raft_consensus.cc:2804] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 13:54:56.879011 18540 raft_consensus.cc:493] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:56.879184 13639 tablet_bootstrap.cc:654] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.879396 18540 raft_consensus.cc:3060] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:56.889479 18659 raft_consensus.cc:493] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.900087 18659 raft_consensus.cc:515] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.903716 18439 raft_consensus.cc:493] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.904250 18439 raft_consensus.cc:515] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.906239 18439 leader_election.cc:290] T cb4dcad38c1a4269b4740a8e5247a867 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.909780 18659 leader_election.cc:290] T 7a7bddc8e6374437a37aeb755389d91f P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:56.914701 13639 tablet_bootstrap.cc:492] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:56.915158 13639 ts_tablet_manager.cc:1403] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.057s user 0.012s sys 0.002s
I20260810 13:54:56.916332 18605 leader_election.cc:290] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.917227 13164 leader_election.cc:304] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6; no voters:
I20260810 13:54:56.917490 18564 leader_election.cc:290] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:56.918454 13640 tablet_bootstrap.cc:492] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:56.918869 13640 ts_tablet_manager.cc:1403] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.252s user 0.009s sys 0.000s
I20260810 13:54:56.919338 18595 raft_consensus.cc:2804] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election won for term 1
I20260810 13:54:56.919854 18595 raft_consensus.cc:697] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Leader. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:56.920750 18595 consensus_queue.cc:237] T e3f4b863f701471ab173b68049b1a602 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.931535 18605 raft_consensus.cc:493] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.932195 18605 raft_consensus.cc:515] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.935235 18605 leader_election.cc:290] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.918303 13639 raft_consensus.cc:359] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.937309 13639 raft_consensus.cc:385] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.937597 13639 raft_consensus.cc:740] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.938177 13638 consensus_queue.cc:260] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.938552 13639 consensus_queue.cc:260] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.940356 13639 ts_tablet_manager.cc:1434] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.025s user 0.005s sys 0.001s
I20260810 13:54:56.940933 13638 ts_tablet_manager.cc:1434] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.101s user 0.004s sys 0.002s
I20260810 13:54:56.942063 13638 tablet_bootstrap.cc:492] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:56.943382 16177 tablet_loader.cc:96] loaded metadata for tablet 9b1cfcc6b1834ebbb0d5cd4a7967e2cd (table default.Table_51d643dcb2a5451e9cff367f2b3649c5 [id=46372d6eedfe4d56b2f2ce9a85f7f1fc])
I20260810 13:54:56.945034 16177 tablet_loader.cc:96] loaded metadata for tablet 9c4ff1185d2848808cbd92760e595830 (table default.Table_2cf24f2161a14bc7a86b4863247c740c [id=d569cba77a074771a9b4384660793da1])
I20260810 13:54:56.946557 16177 tablet_loader.cc:96] loaded metadata for tablet 9dc6395b50b2458fa2d3877eb7ec2ade (table default.Table_297f20c45c0045bc96a148c22d2753d3 [id=1925c63c131740328ad71f06d9f19ba3])
I20260810 13:54:56.947012 18407 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.947477 18407 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.949582 18407 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.950022 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet f1dd212fa9cc4ce388968cc236201a39 (table default.Table_0bd82ba0347a4d84b6f9e1d434bc9f42 [id=24d83ed87348421e9eed6f5fe761b31a]). Expected version 1 got 0
I20260810 13:54:56.952771 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2f934006c34a4b18ab157dad01a1b41d (table default.Table_9feb9759744149f69e0a5d3358bd4880 [id=79e3547a36c040aa91292a3dfe754b03]). Expected version 2 got 0
I20260810 13:54:56.960968 13639 tablet_bootstrap.cc:492] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:56.968107 13639 tablet_bootstrap.cc:654] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:56.986563 13639 tablet_bootstrap.cc:492] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:56.948966 18439 raft_consensus.cc:493] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.987200 13639 ts_tablet_manager.cc:1403] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.010s
I20260810 13:54:56.987321 18439 raft_consensus.cc:515] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.989895 18439 leader_election.cc:290] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.989828 13639 raft_consensus.cc:359] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.990531 13639 raft_consensus.cc:385] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:56.990798 13639 raft_consensus.cc:740] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:56.991459 13639 consensus_queue.cc:260] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.892277 18648 raft_consensus.cc:493] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:56.995457 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet 2def1317e7bc4c5eae5c93264da6d3c9 (table default.Table_3aad155393f44ed3b89b9ac05910d12f [id=d82b9da4e69741b69ecde504f1f33cdf]). Expected version 1 got 0
I20260810 13:54:56.995929 13640 raft_consensus.cc:359] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.997874 18407 raft_consensus.cc:493] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:56.998318 18407 raft_consensus.cc:515] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:56.970770 18540 raft_consensus.cc:515] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.000957 18407 leader_election.cc:290] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:56.996626 13640 raft_consensus.cc:385] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:57.001612 13640 raft_consensus.cc:740] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:57.002665 18540 leader_election.cc:290] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.003106 13640 consensus_queue.cc:260] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.009717 16177 tablet_loader.cc:96] loaded metadata for tablet 9f3485a1b77a4b80acbf48de92b5cf33 (table default.Table_63c62e8b83fd4f0ebf03d3fd1f3bec68 [id=d8943f60b8e3464087c954a42ff795ba])
I20260810 13:54:57.010978 16177 tablet_loader.cc:96] loaded metadata for tablet 9f3e50e523354dd7898ff1768ae824bb (table default.Table_54ea5af3ae44427eb0031a29dd62e663 [id=834d810fa56c49de9d97b91dabab82f1])
I20260810 13:54:57.021582 12481 catalog_manager.cc:5811] TS 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799) does not have the latest schema for tablet a04498da4fce45bb9a906e75594a023f (table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f]). Expected version 1 got 0
I20260810 13:54:57.023906 13639 ts_tablet_manager.cc:1434] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.036s user 0.007s sys 0.000s
I20260810 13:54:57.026628 13640 ts_tablet_manager.cc:1434] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.107s user 0.007s sys 0.005s
I20260810 13:54:57.036007 13470 raft_consensus.cc:3060] T ad6a373308fa4b039e8331d9a0a90d16 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:57.039934 16177 tablet_loader.cc:96] loaded metadata for tablet a008d393fcdf441eb17dbe0c1fa2393f (table default.Table_78c6761fe1e748bf8bea32e7a13650f3 [id=d855b11b57bd447a9285b0945f28219d])
I20260810 13:54:57.041785 18540 raft_consensus.cc:493] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.042361 18540 raft_consensus.cc:515] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.042907 18407 raft_consensus.cc:493] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.043462 18407 raft_consensus.cc:515] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.045143 18410 raft_consensus.cc:493] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.045635 18410 raft_consensus.cc:515] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.047529 18410 leader_election.cc:290] T aa0567b908974da5817ed62aafecee35 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.049898 18407 leader_election.cc:290] T bc5b9e218c1f4f4083acc59a651f0cb6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.055306 16177 tablet_loader.cc:96] loaded metadata for tablet a04498da4fce45bb9a906e75594a023f (table default.Table_56ff9d041639490089431e67e55e741c [id=02ff2d9014a54cee88cbd54f8541b61f])
I20260810 13:54:57.077068 16177 tablet_loader.cc:96] loaded metadata for tablet a0bfa7b61a334886b0bc1583c7d7fee9 (table default.Table_cc339254bace4b5e87544b721a6493a5 [id=685e6bce7ba5467693e2b0e1c739897b])
I20260810 13:54:57.078330 18540 leader_election.cc:290] T c1510cd3523646eba9333f7e6d85a5e8 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.080904 13639 tablet_bootstrap.cc:492] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:57.088990 13639 tablet_bootstrap.cc:654] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:57.053442 13638 tablet_bootstrap.cc:654] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:57.105500 18407 raft_consensus.cc:493] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.105989 18407 raft_consensus.cc:515] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.108163 18407 leader_election.cc:290] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.111035 13639 tablet_bootstrap.cc:492] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:57.111656 13639 ts_tablet_manager.cc:1403] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.007s
I20260810 13:54:57.111814 18407 raft_consensus.cc:493] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.112385 18407 raft_consensus.cc:515] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.114900 18407 leader_election.cc:290] T 350b68f6c1cf48ff8e5f8521e5a4dad6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.115765 13639 raft_consensus.cc:359] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.116643 13639 raft_consensus.cc:385] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:57.119086 16177 tablet_loader.cc:96] loaded metadata for tablet a10f8466fc2844608eec8e781fc2e8a0 (table default.Table_a74e3c8045af416794a1ae89194e4eff [id=6e90d1effcf2446982739abe04249eee])
I20260810 13:54:57.119573 13639 raft_consensus.cc:740] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:57.120620 13639 consensus_queue.cc:260] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.122774 13639 ts_tablet_manager.cc:1434] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.011s user 0.004s sys 0.002s
I20260810 13:54:57.124347 18690 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader d9666026fb7e4c85b46c6aab952932fb)
I20260810 13:54:57.106113 18652 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.126266 18652 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.128535 13639 tablet_bootstrap.cc:492] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:57.131282 18636 raft_consensus.cc:493] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.132252 18636 raft_consensus.cc:515] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.005308 18648 raft_consensus.cc:515] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:57.143137 13382 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:57.144655 13638 tablet_bootstrap.cc:492] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:57.145215 13638 ts_tablet_manager.cc:1403] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.203s user 0.010s sys 0.001s
I20260810 13:54:57.153376 13640 tablet_bootstrap.cc:492] T 5579f4f12fb9495390d8261d24d120d8 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:57.162034 16177 tablet_loader.cc:96] loaded metadata for tablet a27bf786a8274954afc2b2d8cfb34bf0 (table default.Table_f91581b601a14c6da9ad184fbd2ddbfc [id=27b5aa40c6b548a7ba9e9fab15807055])
I20260810 13:54:57.163897 18439 raft_consensus.cc:493] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f30dc72e9364eed80645b57ac7f0cb6)
I20260810 13:54:57.164727 18439 raft_consensus.cc:515] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.172962 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.168164 18439 leader_election.cc:290] T f19e7aa805bd417eae45fb43ac18a66d P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.131937 18407 raft_consensus.cc:493] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.134807 18410 raft_consensus.cc:493] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.178640 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.179349 13475 raft_consensus.cc:2393] T baa17cc9fd524b0981cb2368a7265df1 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:57.179054 18410 raft_consensus.cc:515] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.181195 18407 raft_consensus.cc:515] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.184389 18690 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:57.185623 18410 leader_election.cc:290] T 393e23a9c03049a280f3ef89bdca5011 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.187649 18407 leader_election.cc:290] T 587b591fb88a447b9bd5e071fa8c37e1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.173632 18692 raft_consensus.cc:493] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.189272 18692 raft_consensus.cc:515] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.194689 18636 leader_election.cc:290] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.166658 18656 raft_consensus.cc:493] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.195747 18648 leader_election.cc:290] T 1330bcef6f234943b6b935b54aa3edfd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237)
I20260810 13:54:57.175897 18695 raft_consensus.cc:493] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.196388 18656 raft_consensus.cc:515] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.197113 18695 raft_consensus.cc:515] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.200855 18656 leader_election.cc:290] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
W20260810 13:54:57.202575 18671 log.cc:927] Time spent T d7ffb0f96e744a4bb734aba7f3d82995 P 6f30dc72e9364eed80645b57ac7f0cb6: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
I20260810 13:54:57.203650 18669 raft_consensus.cc:493] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.205822 18410 raft_consensus.cc:493] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.205981 18669 raft_consensus.cc:515] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.206640 18410 raft_consensus.cc:515] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.178143 18691 raft_consensus.cc:493] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.209805 18691 raft_consensus.cc:515] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:57.212090 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:57.218019 13475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.218899 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.219700 16177 tablet_loader.cc:96] loaded metadata for tablet a2a2e00edb244e54b04a511dd0e76c9f (table default.Table_5022f9898a2b4343b457ad28e07a933f [id=a31aa9b4d20f46b4bd283aca2d2b446c])
I20260810 13:54:57.220993 16177 tablet_loader.cc:96] loaded metadata for tablet a4159387c6364989bc5f8bfef7f8458c (table default.Table_e9c73c2f54b54ea485cdcadc15b0a420 [id=41772225716845f794c8c7d1ab21fd32])
I20260810 13:54:57.220425 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.222321 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.223589 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f37f4b2d04f84e119da2743234865baf" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.224090 13470 raft_consensus.cc:3060] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:57.224040 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbee4f9a50342599434a2b05c0740bd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.224568 16177 tablet_loader.cc:96] loaded metadata for tablet a42d57a7f6e2424998f5aebf0c8407d5 (table default.Table_bb6d2c6934d94530af3f3a674b1f0f7f [id=2d33e5d6a1544c008937912b78d2f970])
I20260810 13:54:57.225071 13453 raft_consensus.cc:2468] T 1bbee4f9a50342599434a2b05c0740bd P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:57.226513 16177 tablet_loader.cc:96] loaded metadata for tablet a43ea90fc236424489a4981c32087d81 (table default.Table_c4a8958ee94a4a98b584204430a9546d [id=4422409c30914eefa1029029111dbfd7])
I20260810 13:54:57.226722 13464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.227664 16177 tablet_loader.cc:96] loaded metadata for tablet a46ee6471e914b63afddc7d6dc967b9a (table default.Table_921fde42e0214ef58181c03785687004 [id=828ce62882b949d6887e75923229655e])
I20260810 13:54:57.229557 18695 leader_election.cc:290] T a4b1451bb8254fcb8c507a837d6b2fa4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.212921 18692 leader_election.cc:290] T 8b82b59b066c4240a387e7de48de9c70 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.232239 13470 raft_consensus.cc:2468] T f37f4b2d04f84e119da2743234865baf P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:57.232236 18690 leader_election.cc:290] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017)
I20260810 13:54:57.234084 13124 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:57.236548 13638 raft_consensus.cc:359] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.237380 13638 raft_consensus.cc:385] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:57.237725 13638 raft_consensus.cc:740] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:57.244246 18691 leader_election.cc:290] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.245589 18410 leader_election.cc:290] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:57.248631 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:57.250027 18605 raft_consensus.cc:493] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.250327 18622 raft_consensus.cc:493] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.250864 18622 raft_consensus.cc:515] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.250821 18605 raft_consensus.cc:515] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.253598 18622 leader_election.cc:290] T a43ea90fc236424489a4981c32087d81 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.254330 18605 leader_election.cc:290] T 1330bcef6f234943b6b935b54aa3edfd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.254374 18622 raft_consensus.cc:493] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.256433 18622 raft_consensus.cc:515] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.260226 18622 leader_election.cc:290] T d36f17094e504d80a2443dc12855c744 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.261229 13639 tablet_bootstrap.cc:654] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:57.260860 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:57.268312 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a490fcb16164f968335f069129b3d71" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.268594 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "387ebbb8677c4fb082006585389c6582" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.269266 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.268067 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e169a9bbc24a5196b1bdaf5bb06207" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.271314 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6487d26c6524c38a313b54d5431b6f6" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.271585 13638 consensus_queue.cc:260] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.260667 18664 raft_consensus.cc:493] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.273102 18664 raft_consensus.cc:515] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.274403 13638 ts_tablet_manager.cc:1434] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.129s user 0.002s sys 0.005s
W20260810 13:54:57.275408 12473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 73024.2us
I20260810 13:54:57.277299 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2928f7d4503145b182d99007d240334d" candidate_term: 7 candidate_status { last_received { term: 6 index: 831 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:57.278023 18692 raft_consensus.cc:493] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.278755 13467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.279325 18622 raft_consensus.cc:493] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.278903 18692 raft_consensus.cc:515] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.280021 18622 raft_consensus.cc:515] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.281576 18695 raft_consensus.cc:493] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.281816 18664 leader_election.cc:290] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.282403 18695 raft_consensus.cc:515] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.284188 18622 leader_election.cc:290] T 41b258122c6e4de982cd95ec04ffc3ae P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.284926 18691 raft_consensus.cc:493] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.285676 18691 raft_consensus.cc:515] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.276494 18410 raft_consensus.cc:493] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.289765 18410 raft_consensus.cc:515] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.302331 18691 leader_election.cc:290] T 5836c2923aaf4c698e20b9652fcddc20 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:57.313234 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:57.314921 18622 raft_consensus.cc:493] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.315742 18622 raft_consensus.cc:515] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.308652 18692 leader_election.cc:290] T 51813605283e43f2b4efe6fb2fab652c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.335969 18692 raft_consensus.cc:493] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.319010 18695 leader_election.cc:290] T 6ec1f506c6cd4222b4bd6176ccd54e56 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.340250 16177 tablet_loader.cc:96] loaded metadata for tablet a4b1451bb8254fcb8c507a837d6b2fa4 (table default.Table_8600457273c64f1297922ee566a298bd [id=ae54f98270b548a7833996d63fc50cc4])
I20260810 13:54:57.326686 18410 leader_election.cc:290] T 0be536894b164edfb4310ff521e2fb42 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.336984 18714 raft_consensus.cc:493] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.327244 18407 raft_consensus.cc:493] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.329289 18691 raft_consensus.cc:493] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.333551 18712 raft_consensus.cc:493] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.346884 18407 raft_consensus.cc:515] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:57.352944 18410 raft_consensus.cc:493] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.353713 18695 raft_consensus.cc:493] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.353688 18410 raft_consensus.cc:515] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.347723 18692 raft_consensus.cc:515] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.354507 18695 raft_consensus.cc:515] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.350525 18691 raft_consensus.cc:515] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.356703 18692 leader_election.cc:290] T 15149232bd7645be840c1d223a829eb4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.357290 18692 raft_consensus.cc:493] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.357929 18691 leader_election.cc:290] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.357766 18692 raft_consensus.cc:515] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.360555 18410 leader_election.cc:290] T ebb1392a98aa4af199236e4b4b4ab3c5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.321179 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:57.321067 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00a4341f5d274a9eb54cb030b47c9a91" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.322093 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:57.321072 13257 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.338413 13638 tablet_bootstrap.cc:492] T ac27a168faad4542967097f909ce3997 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:57.366777 16177 tablet_loader.cc:96] loaded metadata for tablet a4cca967e70b4164ba13c139d9610c73 (table default.Table_5388dd61e30949a5a2b9c07a35637080 [id=9fe82107b8344dfdae308a0d7091488d])
I20260810 13:54:57.375653 16177 tablet_loader.cc:96] loaded metadata for tablet a67cf93d78254f15a1b89c99048110c8 (table default.Table_ed026dd607ea4b2e8b1f22bee438879d [id=5b919872756647048ea2e4fecbe78537])
I20260810 13:54:57.337569 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5114911fdf4b19afec0c71ded5ef9a" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.376621 13268 raft_consensus.cc:2468] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:57.380271 13253 raft_consensus.cc:2393] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:57.377007 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9ccbe2b9e3466dbc5fd23b2ea5a6a4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.381557 13242 raft_consensus.cc:2468] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:57.386950 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9ccbe2b9e3466dbc5fd23b2ea5a6a4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.387388 13450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.387743 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.388072 13450 raft_consensus.cc:2468] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:57.387939 13449 raft_consensus.cc:2468] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:57.389206 13454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.390923 13474 raft_consensus.cc:1240] T 9dc6395b50b2458fa2d3877eb7ec2ade P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Rejecting Update request from peer 218e946161f64d1d92427684ac15e4fb for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:57.391299 13470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.393215 13470 raft_consensus.cc:2393] T 8473def35a97492a9172b483c2d670d9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:57.394477 13242 raft_consensus.cc:1240] T 29ace970eee349d6b669b5c531f91c8b P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:57.395826 13257 raft_consensus.cc:1240] T fd22f04344954142922942fc4b7cb157 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:57.395696 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad6a373308fa4b039e8331d9a0a90d16" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.396369 13268 raft_consensus.cc:2393] T ad6a373308fa4b039e8331d9a0a90d16 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:57.396855 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd3119d63857480294dcb68ed0451bc0" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.397230 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c57ca566cfe47f6a331bbbe5c344a89" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.397552 13269 raft_consensus.cc:2393] T bd3119d63857480294dcb68ed0451bc0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f30dc72e9364eed80645b57ac7f0cb6 in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:57.398384 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3db559714d84493ebaf7d3b51719d81c" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.398609 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f425739a239144048975fb15a26d197e" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.400367 13253 raft_consensus.cc:2468] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 0.
I20260810 13:54:57.398615 18605 raft_consensus.cc:493] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.401314 18605 raft_consensus.cc:515] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.402379 13258 raft_consensus.cc:1240] T 452978fbf3b74e3c9b16756b9f394be7 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:57.403611 18605 leader_election.cc:290] T 9453eab70fa04df8b0c89e6caf54c894 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.405138 18595 raft_consensus.cc:493] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.405604 18595 raft_consensus.cc:515] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.405827 18439 raft_consensus.cc:493] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.407228 18540 raft_consensus.cc:493] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.406598 18439 raft_consensus.cc:515] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.409135 18537 raft_consensus.cc:493] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.409945 13245 raft_consensus.cc:1240] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:57.409698 18537 raft_consensus.cc:515] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.412189 18537 leader_election.cc:290] T f922c9ca51044dcda08b245010ab06b0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:57.412425 13130 tablet.cc:2406] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 13:54:57.412869 18537 raft_consensus.cc:493] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.412786 18439 leader_election.cc:290] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.414428 18537 raft_consensus.cc:515] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.414850 18439 raft_consensus.cc:493] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.407915 18540 raft_consensus.cc:515] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.416448 18439 raft_consensus.cc:515] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:57.393193 13456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e88a52755140019a6d9f7041db0837" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.425499 13476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec54cb915a54949871181763ad956d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.426110 13476 raft_consensus.cc:3060] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:57.426287 18407 leader_election.cc:290] T c0e45366954740528fb37c7cfdc639c6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.428526 18695 leader_election.cc:290] T 6d2d209f801b4aa0aff3137a51fc7556 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.430769 13456 raft_consensus.cc:3060] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:57.361287 18712 raft_consensus.cc:515] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.432919 13382 leader_election.cc:304] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6, 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb
I20260810 13:54:57.434829 18712 leader_election.cc:290] T 81de7fcb3bc745a5b0ea7ffb45dbcfce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.435111 13382 leader_election.cc:304] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:57.377696 18714 raft_consensus.cc:515] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:57.440349 18714 leader_election.cc:290] T 5f1df2c9593442afa84849da6874f0f4 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.442849 16177 tablet_loader.cc:96] loaded metadata for tablet a75054766c894d78bfa6d7f565700dce (table default.Table_83164f9e96c540f58a5af47229b70854 [id=3f7f1db8228e4efa9b34bc33cb13be40])
I20260810 13:54:57.435606 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.393378 13457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.448066 13242 raft_consensus.cc:1240] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 6f30dc72e9364eed80645b57ac7f0cb6 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:57.450206 18595 leader_election.cc:290] T 049416892e964159a06d5817932bbd7a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.450230 13457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.451412 13457 raft_consensus.cc:2468] T cb4dcad38c1a4269b4740a8e5247a867 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:57.451864 18537 leader_election.cc:290] T 9c4ff1185d2848808cbd92760e595830 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.452360 18537 raft_consensus.cc:493] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.452780 18537 raft_consensus.cc:515] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.448120 13461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.455156 18537 leader_election.cc:290] T e7553445e6124227872c0f2306940225 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.460573 18595 raft_consensus.cc:493] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.461423 18595 raft_consensus.cc:515] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.467981 18537 raft_consensus.cc:493] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.468542 18537 raft_consensus.cc:515] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.470033 18605 raft_consensus.cc:493] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.475586 18605 raft_consensus.cc:515] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.472386 18595 leader_election.cc:290] T 6ad53d1da7b34194b4b7a78c52870c6b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.470944 18537 leader_election.cc:290] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.434631 18656 raft_consensus.cc:2804] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:57.491305 16177 tablet_loader.cc:96] loaded metadata for tablet a9721201403f458b92613d0c12fd3eba (table default.Table_96ae0c2b399a48b18829481ceaee950d [id=8fe74f067d8d46f1aa7eb3bbaa25c414])
I20260810 13:54:57.492112 18653 raft_consensus.cc:493] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.468641 18439 leader_election.cc:290] T fe4755e4fcfd4af087ce5831a4e02022 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.455724 18622 leader_election.cc:290] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.477869 18540 leader_election.cc:290] T 247fb8b09c12407d8535c07c5d0687fe P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.493139 18653 raft_consensus.cc:515] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.480510 18669 leader_election.cc:290] T f668f6b35dc044a1a79f1d5852d39497 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.482369 18656 raft_consensus.cc:493] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260810 13:54:57.509141 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 74118.8us
I20260810 13:54:57.512840 18656 raft_consensus.cc:3060] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:57.513124 18595 raft_consensus.cc:493] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.513700 18595 raft_consensus.cc:515] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.515452 18636 raft_consensus.cc:493] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.516021 18636 raft_consensus.cc:515] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.522842 18636 leader_election.cc:290] T 15149232bd7645be840c1d223a829eb4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.443645 18695 raft_consensus.cc:493] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.525727 18695 raft_consensus.cc:515] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.530211 18695 leader_election.cc:290] T cab5c35fa6b440a7bc4ebe2709fbfc60 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.471474 18719 raft_consensus.cc:493] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.531373 13382 leader_election.cc:304] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:57.532076 18636 raft_consensus.cc:2749] T 82848ef8dc904879854929de47db1e50 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260810 13:54:57.532003 18719 raft_consensus.cc:515] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.533591 13382 leader_election.cc:304] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:57.535219 18653 leader_election.cc:290] T 7a745bc711004993830b40ca1c93c63b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.486248 18712 raft_consensus.cc:493] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.538129 16177 tablet_loader.cc:96] loaded metadata for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879])
I20260810 13:54:57.537993 18712 raft_consensus.cc:515] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.539141 18636 raft_consensus.cc:2749] T 6ad53d1da7b34194b4b7a78c52870c6b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:57.511142 18705 raft_consensus.cc:493] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.540365 18705 raft_consensus.cc:515] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.546818 16177 tablet_loader.cc:96] loaded metadata for tablet ab9d43e8868c420ea0801d395ff9c102 (table default.Table_e317f4e20e124c60bbed5450c6c3ca07 [id=01638b930a5e4b46925cdbfd23f204ea])
I20260810 13:54:57.543771 13454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6"
I20260810 13:54:57.550410 13043 raft_consensus.cc:1240] T db50d31d0d6c45faa1eb138357d532b3 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Rejecting Update request from peer 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:57.551800 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3f4b863f701471ab173b68049b1a602" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:57.552592 13023 raft_consensus.cc:3060] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:57.556571 18407 raft_consensus.cc:493] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.557144 18407 raft_consensus.cc:515] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.558399 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:57.559623 18407 leader_election.cc:290] T 73a7e7c310e24d8caca5756fe67631ce P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.562582 18410 raft_consensus.cc:493] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.563146 18410 raft_consensus.cc:515] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.566931 18410 leader_election.cc:290] T 288debea4aa045d1898483cde1d4d3b1 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.541076 13382 leader_election.cc:304] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:57.523587 13639 tablet_bootstrap.cc:492] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:57.569938 13639 ts_tablet_manager.cc:1403] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.442s user 0.016s sys 0.006s
I20260810 13:54:57.457791 18692 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.570420 13382 leader_election.cc:304] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:57.573060 18410 raft_consensus.cc:493] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.574066 18410 raft_consensus.cc:515] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:57.577582 18648 raft_consensus.cc:2749] T 9c4ff1185d2848808cbd92760e595830 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:57.581001 18692 raft_consensus.cc:493] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.581967 13023 raft_consensus.cc:2468] T e3f4b863f701471ab173b68049b1a602 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:57.581913 18692 raft_consensus.cc:515] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:57.585129 18648 consensus_queue.cc:1059] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260810 13:54:57.585825 18653 raft_consensus.cc:2749] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:57.586410 18707 raft_consensus.cc:493] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.587337 13382 leader_election.cc:304] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:57.587302 18707 raft_consensus.cc:515] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.592841 16177 tablet_loader.cc:96] loaded metadata for tablet ac27a168faad4542967097f909ce3997 (table default.Table_b392780f45ab4b899ddb12eefbcdd556 [id=0a7b7ff4685e4a8884b4aab7a835890d])
I20260810 13:54:57.604489 18712 leader_election.cc:290] T 3b7b408a9ad34ea39c912b33e26b49b6 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.604408 18649 raft_consensus.cc:3055] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:57.605911 13640 tablet_bootstrap.cc:654] T 5579f4f12fb9495390d8261d24d120d8 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:57.608516 18736 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.609367 18736 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9666026fb7e4c85b46c6aab952932fb" member_type: VOTER last_known_addr { host: "127.12.36.62" port: 33317 } } peers { permanent_uuid: "2928f7d4503145b182d99007d240334d" member_type: VOTER last_known_addr { host: "127.12.36.61" port: 35861 } } peers { permanent_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" member_type: VOTER last_known_addr { host: "127.12.36.60" port: 38017 } }
I20260810 13:54:57.610451 18705 leader_election.cc:290] T 30d9e5103fe644f38d969c64182f7cbb P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.596457 16177 tablet_loader.cc:96] loaded metadata for tablet ad6a373308fa4b039e8331d9a0a90d16 (table default.Table_c76b1dec93c74830b7a89900defb8cb7 [id=9f7549a9604c496b934fdac98cdae2cb])
I20260810 13:54:57.617981 18695 raft_consensus.cc:493] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.618605 18695 raft_consensus.cc:515] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.620141 13476 raft_consensus.cc:2468] T bec54cb915a54949871181763ad956d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:57.619680 18669 raft_consensus.cc:2749] T b54b73458a4c4201bc3b44259bc12436 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 13:54:57.605162 18649 raft_consensus.cc:740] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:57.622773 18407 raft_consensus.cc:493] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.623734 18407 raft_consensus.cc:515] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.619508 16177 tablet_loader.cc:96] loaded metadata for tablet ae74d69055ee4aa395c0f628864242e3 (table default.Table_6964fe82ae0c4d96a86d800f82062b3e [id=83fc760e794d422d8614bf728e3e47df])
I20260810 13:54:57.626484 18714 raft_consensus.cc:493] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.627452 18714 raft_consensus.cc:515] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.628916 16177 tablet_loader.cc:96] loaded metadata for tablet af106f431764457bbeb43691f5b0a46a (table default.Table_5eabd6d8208e4b28abd01f35c3fdfba0 [id=19cf8ac217b34ed1b6ceccb40508fd56])
I20260810 13:54:57.631026 18714 leader_election.cc:290] T d321f9c075554ffcb299d02792a0662d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.598578 13449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d647bf5c1ba42f48186661310065448" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.649143 18649 consensus_queue.cc:260] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.654922 18649 raft_consensus.cc:3060] T e839b2604ad640419fc845b54706cd4d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:57.670573 18669 raft_consensus.cc:493] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.670790 13453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf672d15f88c4f0dbdf2fdb6aefa1108" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" is_pre_election: true
I20260810 13:54:57.671458 18669 raft_consensus.cc:515] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.671830 13453 raft_consensus.cc:2468] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:57.674175 13453 raft_consensus.cc:1275] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260810 13:54:57.675107 13453 pending_rounds.cc:85] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting all ops after (but not including) 0
I20260810 13:54:57.675655 13453 pending_rounds.cc:107] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260810 13:54:57.676467 13453 raft_consensus.cc:2889] T 420ee600a4174916827aa7b64bbcd8d2 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:57.675453 18669 leader_election.cc:290] T 4520d51666b04814814fbaa8b71430fc P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.689101 18540 raft_consensus.cc:493] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.689688 18540 raft_consensus.cc:515] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.690294 12498 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "d9666026fb7e4c85b46c6aab952932fb" is_pre_election: true
I20260810 13:54:57.691843 18540 leader_election.cc:290] T 75b8030450554de3b97266f348329ea6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.694864 18439 raft_consensus.cc:493] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.695360 15213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1298bde14cec4cd3a9d6338c7d47f0b7" candidate_term: 7 candidate_status { last_received { term: 5 index: 821 } } ignore_live_leader: false dest_uuid: "2928f7d4503145b182d99007d240334d" is_pre_election: true
I20260810 13:54:57.696888 18537 raft_consensus.cc:493] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.698464 18605 leader_election.cc:290] T e9840da46a92439f8c96bc3714650f17 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.697801 18537 raft_consensus.cc:515] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.700086 18595 leader_election.cc:290] T 691aac16d50745d6965bebe94831b67b P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.701892 13245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.702486 13245 raft_consensus.cc:2468] T 7a7bddc8e6374437a37aeb755389d91f P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in term 1.
I20260810 13:54:57.702919 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba5b835c1bf44c59a4ea7ab4b9ea93f4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.704022 13245 raft_consensus.cc:1240] T 7529b349395a42ec96c7816f9e566079 P 218e946161f64d1d92427684ac15e4fb [term 4 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 3. Current term is 4. Ops: []
I20260810 13:54:57.704486 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.692376 18725 raft_consensus.cc:493] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.706614 18732 raft_consensus.cc:493] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.706142 18725 raft_consensus.cc:515] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.714442 13258 raft_consensus.cc:1240] T 3610bc4f8a0742fdb69347b40a04f078 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:57.707337 18732 raft_consensus.cc:515] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.716902 13254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:57.719137 18732 leader_election.cc:290] T c793dedc5e714fe6bd36e507695e82d0 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.695825 18439 raft_consensus.cc:515] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:57.726817 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.726838 18622 raft_consensus.cc:493] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.728556 18439 leader_election.cc:290] T 9334ba72cfd94fa4a7062a29445c69f9 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.728444 18622 raft_consensus.cc:515] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.735605 18439 raft_consensus.cc:493] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.736581 18439 raft_consensus.cc:515] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:57.724277 18595 raft_consensus.cc:493] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.736701 18537 leader_election.cc:290] T 515727ae51d94c009b4446c8b6e2c8f6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.738970 18595 raft_consensus.cc:515] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.750156 18622 leader_election.cc:290] T 34b2314b771f41188bc8101c5ddffaf4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.756209 18439 leader_election.cc:290] T b0b88e6d9f77487f8ed2cfafd702a753 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.691933 18736 leader_election.cc:290] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers d9666026fb7e4c85b46c6aab952932fb (127.12.36.62:33317), 2928f7d4503145b182d99007d240334d (127.12.36.61:35861)
I20260810 13:54:57.712769 12728 leader_election.cc:304] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1298bde14cec4cd3a9d6338c7d47f0b7; no voters: 2928f7d4503145b182d99007d240334d, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:57.740350 18725 leader_election.cc:290] T d7ffb0f96e744a4bb734aba7f3d82995 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.741611 18540 raft_consensus.cc:493] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.762135 16177 tablet_loader.cc:96] loaded metadata for tablet afe75b90aa5548d8a6c35cf6db42bb25 (table default.Table_3abcbf71e2004a07888fe131143e8e76 [id=ab67527f31ce42d7a92bb0cba8f69ff6])
I20260810 13:54:57.762087 18736 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1298bde14cec4cd3a9d6338c7d47f0b7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:57.762483 18540 raft_consensus.cc:515] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.763738 16177 tablet_loader.cc:96] loaded metadata for tablet b09ec8ef75e94a83a155d901235e7ce0 (table default.Table_699797a1320b40709d0bf25947241900 [id=f656a6598c1145d89230d014ba6873a6])
I20260810 13:54:57.772727 13253 raft_consensus.cc:1240] T 613d7ddce24b45c886139bf68c3c9a4d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:57.748320 18595 leader_election.cc:290] T f668f6b35dc044a1a79f1d5852d39497 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:57.785076 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:57.786739 13638 tablet_bootstrap.cc:654] T ac27a168faad4542967097f909ce3997 P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:57.790458 13269 raft_consensus.cc:1240] T 82848ef8dc904879854929de47db1e50 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260810 13:54:57.792618 12728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 79988.2us
I20260810 13:54:57.683416 13476 raft_consensus.cc:1275] T 97015b4984c74a4682b6dedd47dc6650 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 13:54:57.798241 13476 raft_consensus.cc:1275] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260810 13:54:57.798561 13476 pending_rounds.cc:85] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting all ops after (but not including) 0
I20260810 13:54:57.798797 13476 pending_rounds.cc:107] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260810 13:54:57.799145 13476 raft_consensus.cc:2889] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260810 13:54:57.800859 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 200387us
I20260810 13:54:57.801836 13382 leader_election.cc:304] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:57.679695 18652 leader_election.cc:290] T a42d57a7f6e2424998f5aebf0c8407d5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.793571 18648 raft_consensus.cc:493] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.776932 18540 leader_election.cc:290] T 213e54b67ee94d299345a3d1eabc9ae6 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:57.827260 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:57.828959 13269 raft_consensus.cc:1240] T ca4c0fea312c418f8ebd5c0619e7e220 P 218e946161f64d1d92427684ac15e4fb [term 3 FOLLOWER]: Rejecting Update request from peer 88ed04d733ec447583fc897e233dd4b3 for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:57.831646 18540 raft_consensus.cc:493] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.832791 18540 raft_consensus.cc:515] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.839425 18652 consensus_queue.cc:1059] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260810 13:54:57.841636 18653 raft_consensus.cc:3055] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:57.842180 18653 raft_consensus.cc:740] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Running, Role: LEADER
I20260810 13:54:57.836933 18648 raft_consensus.cc:515] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.843464 18653 consensus_queue.cc:260] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.851223 13456 raft_consensus.cc:2468] T 62e88a52755140019a6d9f7041db0837 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:57.851881 18669 raft_consensus.cc:2749] T f922c9ca51044dcda08b245010ab06b0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:57.854740 16177 tablet_loader.cc:96] loaded metadata for tablet b0b88e6d9f77487f8ed2cfafd702a753 (table default.Table_6ded227a454f419d937bfd5c1bfd240a [id=31645557bd8d4f85bdb388d98b0afc0f])
I20260810 13:54:57.855715 18595 raft_consensus.cc:493] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:57.856403 18595 raft_consensus.cc:515] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.859872 18595 leader_election.cc:290] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.862403 18648 leader_election.cc:290] T aa0567b908974da5817ed62aafecee35 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.631786 18705 raft_consensus.cc:493] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 218e946161f64d1d92427684ac15e4fb)
I20260810 13:54:57.886358 18705 raft_consensus.cc:515] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.887959 13027 raft_consensus.cc:1240] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Rejecting Update request from peer 218e946161f64d1d92427684ac15e4fb for earlier term 2. Current term is 3. Ops: []
I20260810 13:54:57.633886 18719 leader_election.cc:290] T f425739a239144048975fb15a26d197e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.641078 18692 leader_election.cc:290] T 2e5ad84fe2604dd2959768db31f66e7c P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.662811 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:57.664005 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ace970eee349d6b669b5c531f91c8b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:57.838637 18707 leader_election.cc:290] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.596319 13639 raft_consensus.cc:359] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.891428 13639 raft_consensus.cc:385] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:57.891799 13639 raft_consensus.cc:740] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:57.892573 13639 consensus_queue.cc:260] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:57.895931 13639 ts_tablet_manager.cc:1434] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.326s user 0.005s sys 0.002s
W20260810 13:54:57.920837 13477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s user 0.005s sys 0.034s
W20260810 13:54:57.921380 13477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s user 0.005s sys 0.034s
I20260810 13:54:57.928244 16177 tablet_loader.cc:96] loaded metadata for tablet b0f98604d43049ac9b2befe5041a2bda (table default.Table_acc827f97bb244f59d2eed071cc9bd55 [id=7b4d23c35bc14f8598821f2838a18148])
W20260810 13:54:57.902374 13472 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.744s user 0.003s sys 0.023s
I20260810 13:54:57.937224 18725 raft_consensus.cc:493] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 88ed04d733ec447583fc897e233dd4b3)
I20260810 13:54:57.937888 18725 raft_consensus.cc:515] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } }
I20260810 13:54:57.942790 16177 tablet_loader.cc:96] loaded metadata for tablet b2d9bca9a4e74f3aa7ea0a11c7906a09 (table default.Table_890e94f5e2914f4e9e3994ab8bc4075c [id=d08463e955564de898a2af8457a26457])
I20260810 13:54:57.943156 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc446acced34a6c87e459c5542c1c77" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:57.944139 16177 tablet_loader.cc:96] loaded metadata for tablet b2f2b53b984441e4baee332183e4c5c3 (table default.Table_87c087a440044f9483716cce60bb4777 [id=4777400951884e84a747cbc635b6a087])
W20260810 13:54:57.890547 13452 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s user 0.013s sys 0.010s
I20260810 13:54:57.865840 18407 leader_election.cc:290] T 953f83dab3ca406f8638e446911614b0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.622249 18695 leader_election.cc:290] T 1c6686175347496093cb22ce8a3d4176 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.873972 13043 raft_consensus.cc:1240] T 9dc6395b50b2458fa2d3877eb7ec2ade P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Rejecting Update request from peer 218e946161f64d1d92427684ac15e4fb for earlier term 1. Current term is 2. Ops: []
I20260810 13:54:57.944322 13258 raft_consensus.cc:2468] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:54:57.934989 13472 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.786s user 0.004s sys 0.024s
W20260810 13:54:57.965086 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260810 13:54:57.965749 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 71089.8us
I20260810 13:54:57.944026 18725 leader_election.cc:290] T b449377349514576874b6c295ead5e9a P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.977583 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:57.978432 13269 raft_consensus.cc:2393] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:57.878463 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbee4f9a50342599434a2b05c0740bd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:57.577896 18410 leader_election.cc:290] T 98a59da23cfa4b5a9713b135d7fa4366 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:57.987229 18540 leader_election.cc:290] T cafed58a5994479e91678ddbe74cd353 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
W20260810 13:54:57.991127 13462 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.984s user 0.011s sys 0.013s
W20260810 13:54:57.991703 13462 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.985s user 0.011s sys 0.013s
W20260810 13:54:57.953116 13452 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s user 0.014s sys 0.010s
I20260810 13:54:57.996096 13472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.1:45353 (request call id 1029) took 1131 ms. Trace:
I20260810 13:54:57.897475 18705 leader_election.cc:290] T a17d73c65f544b7c8566fd874ee87a25 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:57.999300 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd3d4b038acb48ebaebef7a424f721c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.012742 16177 tablet_loader.cc:96] loaded metadata for tablet b335455cc01947a3a4ca6c368fea7bad (table default.Table_a232694e27574131946f967d95a292f4 [id=fec6784b9d334a72907abaf252914033])
I20260810 13:54:58.014529 16177 tablet_loader.cc:96] loaded metadata for tablet b3bbe54b2ba947a4a8b2d908f44c0db5 (table default.Table_4f02931df6b0437a9cb7869b14b73084 [id=b8289db1d29241f3815ff2da32fcfc1a])
W20260810 13:54:58.015563 12473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.61:35861, user_credentials={real_user=slave}} blocked reactor thread for 85438.2us
I20260810 13:54:58.024118 13639 tablet_bootstrap.cc:492] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:58.027667 13345 tablet.cc:2406] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 13:54:57.965073 13464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s user 0.002s sys 0.016s
I20260810 13:54:58.043726 13638 tablet_bootstrap.cc:492] T ac27a168faad4542967097f909ce3997 P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:58.044247 13638 ts_tablet_manager.cc:1403] T ac27a168faad4542967097f909ce3997 P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.721s user 0.006s sys 0.016s
I20260810 13:54:58.047310 16177 tablet_loader.cc:96] loaded metadata for tablet b3cbbc9bee4843dea818b514d42d42df (table default.Table_2416e07beb8d42a6a48de9dab42936cf [id=39551fb5d1804467bb58d5b00de27be4])
I20260810 13:54:58.061161 13462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.1:45353 (request call id 1017) took 1360 ms. Trace:
W20260810 13:54:58.041646 13464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s user 0.003s sys 0.016s
W20260810 13:54:58.044763 13475 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s user 0.008s sys 0.008s
I20260810 13:54:58.064639 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca4c0fea312c418f8ebd5c0619e7e220" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.039690 18648 raft_consensus.cc:493] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260810 13:54:58.064527 13468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.959s user 0.018s sys 0.022s
W20260810 13:54:58.064896 13475 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s user 0.008s sys 0.009s
W20260810 13:54:58.044238 18656 consensus_meta.cc:287] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent flushing consensus metadata: real 0.531s user 0.004s sys 0.012s
I20260810 13:54:58.067683 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452978fbf3b74e3c9b16756b9f394be7" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.024603 13023 raft_consensus.cc:2468] T 1bbee4f9a50342599434a2b05c0740bd P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:58.098687 18695 raft_consensus.cc:493] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:58.099484 18695 raft_consensus.cc:515] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.101586 18695 leader_election.cc:290] T 39514e069d6841df9fced9e62981eac5 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:58.102474 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.106258 16177 tablet_loader.cc:96] loaded metadata for tablet b427309e4db942bd920539274bffe7cd (table default.Table_819cbf37633d4c75ba529b0d037cb8db [id=8d2ee7c5b732405c804aec9f79e98038])
I20260810 13:54:58.110800 16177 tablet_loader.cc:96] loaded metadata for tablet b449377349514576874b6c295ead5e9a (table default.Table_2695264893564646a621e76ff6443e84 [id=147b038d3de54c8d85e666747153cb7d])
I20260810 13:54:58.069260 18664 raft_consensus.cc:2749] T 98ce3cccca464b938fd45afe292b4ad8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.127704 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.128458 13040 raft_consensus.cc:2393] T e839b2604ad640419fc845b54706cd4d P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 2: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:58.108853 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd22f04344954142922942fc4b7cb157" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.098250 18648 raft_consensus.cc:515] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.098497 18656 raft_consensus.cc:515] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.139453 13638 raft_consensus.cc:359] T ac27a168faad4542967097f909ce3997 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.140205 13638 raft_consensus.cc:385] T ac27a168faad4542967097f909ce3997 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:58.140475 13638 raft_consensus.cc:740] T ac27a168faad4542967097f909ce3997 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:58.158584 13639 tablet_bootstrap.cc:654] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:58.178117 16177 tablet_loader.cc:96] loaded metadata for tablet b4be757a47e3434081eef61dfd746be1 (table default.Table_dfe60ded8ca240529710962e7f530298 [id=b4ce0aca49834e698812644caf8b8a94])
I20260810 13:54:58.181339 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dc6395b50b2458fa2d3877eb7ec2ade" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:58.182998 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e839b2604ad640419fc845b54706cd4d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:58.184213 13253 raft_consensus.cc:2393] T e839b2604ad640419fc845b54706cd4d P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:58.185360 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.186451 13242 raft_consensus.cc:2393] T 8473def35a97492a9172b483c2d670d9 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:58.196023 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.196877 13033 raft_consensus.cc:2393] T 22d96232e31f46e791d739643ffb9257 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 2: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:58.198001 16177 tablet_loader.cc:96] loaded metadata for tablet b4fa1a60b6dc4dc8a5fae3cbeb3dce1d (table default.Table_670f5f1855c14840917ede9ad5abd859 [id=a18b953f33b14259a0b180987321ebe7])
I20260810 13:54:58.198618 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f37f4b2d04f84e119da2743234865baf" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.199210 13049 raft_consensus.cc:3060] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:58.200181 16177 tablet_loader.cc:96] loaded metadata for tablet b54b73458a4c4201bc3b44259bc12436 (table default.Table_457f03cd1b7f460a927385ae6f5b25e6 [id=a16e491cb9894186863d4e55b6e41d7b])
I20260810 13:54:58.201517 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613d7ddce24b45c886139bf68c3c9a4d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.204253 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf672d15f88c4f0dbdf2fdb6aefa1108" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.204892 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff9ccbe2b9e3466dbc5fd23b2ea5a6a4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.205603 13046 raft_consensus.cc:2468] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:58.205476 13033 raft_consensus.cc:2468] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:58.206636 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a45cb763a84c7aa557fde815a92c07" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.207348 13023 raft_consensus.cc:2468] T b7a45cb763a84c7aa557fde815a92c07 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:58.208330 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8473def35a97492a9172b483c2d670d9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.209214 13027 raft_consensus.cc:2393] T 8473def35a97492a9172b483c2d670d9 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:58.216578 13049 raft_consensus.cc:2468] T f37f4b2d04f84e119da2743234865baf P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:58.222884 13639 tablet_bootstrap.cc:492] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:58.223501 13639 ts_tablet_manager.cc:1403] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.200s user 0.011s sys 0.003s
I20260810 13:54:58.226274 13639 raft_consensus.cc:359] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.227083 13639 raft_consensus.cc:385] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:58.227494 13639 raft_consensus.cc:740] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:58.228461 13639 consensus_queue.cc:260] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.154788 13638 consensus_queue.cc:260] T ac27a168faad4542967097f909ce3997 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.234551 16177 tablet_loader.cc:96] loaded metadata for tablet b7a45cb763a84c7aa557fde815a92c07 (table default.Table_0bcbbc9c839346a08bc9a2333ef0cd7f [id=cb722d559fe647018b6c959f6a93a037])
I20260810 13:54:58.234478 13638 ts_tablet_manager.cc:1434] T ac27a168faad4542967097f909ce3997 P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.190s user 0.005s sys 0.005s
I20260810 13:54:58.242376 16177 tablet_loader.cc:96] loaded metadata for tablet b8fcd43569dd49b38d3227b312b896c4 (table default.Table_fa1b154c008a4bceb6b8e7f6fb650ddb [id=dea63931a83f494b8fa574685cd4ff24])
I20260810 13:54:58.268885 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db50d31d0d6c45faa1eb138357d532b3" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
W20260810 13:54:58.288625 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 485006us
I20260810 13:54:58.291213 13382 leader_election.cc:304] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.294539 13382 leader_election.cc:304] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.296664 13382 leader_election.cc:304] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.299774 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae0c1bb5bf6b4a97b49e2eea18d4ae9c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:58.233645 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ecda19e4f143c99654aff6058ad8bb" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.305814 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "213e54b67ee94d299345a3d1eabc9ae6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.307171 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7ffb0f96e744a4bb734aba7f3d82995" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.307265 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff1229ebe9304f19ab84d5a172aba937" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.236243 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "121d7abf368a4cf99fd045b8c8ba4b69" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.309408 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "247fb8b09c12407d8535c07c5d0687fe" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.310323 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4ff1185d2848808cbd92760e595830" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.310393 13449 raft_consensus.cc:2393] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 6f30dc72e9364eed80645b57ac7f0cb6 in this term.
I20260810 13:54:58.311185 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ea90fc236424489a4981c32087d81" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.236904 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e88a52755140019a6d9f7041db0837" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.237565 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec54cb915a54949871181763ad956d5" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.238332 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d78892783474b329e31bf2df7d2952c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.241055 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5796052fd94c1e8fce159a6a90830c" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.248512 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d647bf5c1ba42f48186661310065448" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.249320 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7529b349395a42ec96c7816f9e566079" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.312330 13056 raft_consensus.cc:3060] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:58.313796 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9840da46a92439f8c96bc3714650f17" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.315110 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce84eacbab61417a9497f8770b4da511" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.315665 13046 raft_consensus.cc:2468] T ce84eacbab61417a9497f8770b4da511 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:58.250427 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3610bc4f8a0742fdb69347b40a04f078" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
W20260810 13:54:58.043025 13450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s user 0.008s sys 0.011s
W20260810 13:54:58.316964 13450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s user 0.009s sys 0.011s
I20260810 13:54:58.253472 13040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5114911fdf4b19afec0c71ded5ef9a" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.254541 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb4dcad38c1a4269b4740a8e5247a867" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.248792 13023 raft_consensus.cc:1275] T 420ee600a4174916827aa7b64bbcd8d2 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 13:54:58.261436 13033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc446acced34a6c87e459c5542c1c77" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.261839 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82848ef8dc904879854929de47db1e50" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3"
I20260810 13:54:58.312960 13039 raft_consensus.cc:2468] T 8d647bf5c1ba42f48186661310065448 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:58.319814 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b449377349514576874b6c295ead5e9a" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.320588 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75b8030450554de3b97266f348329ea6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.265020 13035 raft_consensus.cc:1275] T b335455cc01947a3a4ca6c368fea7bad P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 13:54:58.321466 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330bcef6f234943b6b935b54aa3edfd" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.263331 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1510cd3523646eba9333f7e6d85a5e8" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.270671 13028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f19e7aa805bd417eae45fb43ac18a66d" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.313465 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49bf6a1f14bb4513b1addc4141b71373" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.321800 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "515727ae51d94c009b4446c8b6e2c8f6" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.265480 13057 raft_consensus.cc:1275] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 13:54:58.324070 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f668f6b35dc044a1a79f1d5852d39497" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.317891 13040 raft_consensus.cc:2468] T 7a5114911fdf4b19afec0c71ded5ef9a P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 0.
I20260810 13:54:58.325228 13033 raft_consensus.cc:2393] T efc446acced34a6c87e459c5542c1c77 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 218e946161f64d1d92427684ac15e4fb in current term 1: Already voted for candidate 88ed04d733ec447583fc897e233dd4b3 in this term.
I20260810 13:54:58.283416 13054 raft_consensus.cc:1275] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Refusing update from remote peer 218e946161f64d1d92427684ac15e4fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260810 13:54:58.312570 13027 raft_consensus.cc:3060] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:58.318537 13050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9453eab70fa04df8b0c89e6caf54c894" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.324131 13041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f922c9ca51044dcda08b245010ab06b0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.319327 13023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "049416892e964159a06d5817932bbd7a" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.327714 13026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9334ba72cfd94fa4a7062a29445c69f9" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.313378 13025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7553445e6124227872c0f2306940225" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.328056 13452 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.1:45353 (request call id 1028) took 1485 ms. Trace:
I20260810 13:54:58.326014 13054 pending_rounds.cc:85] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3: Aborting all ops after (but not including) 1
I20260810 13:54:58.329000 13054 pending_rounds.cc:107] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260810 13:54:58.317440 13042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.329300 13054 raft_consensus.cc:2889] T a27bf786a8274954afc2b2d8cfb34bf0 P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260810 13:54:58.275565 13048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36f17094e504d80a2443dc12855c744" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.332615 13049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "691aac16d50745d6965bebe94831b67b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.332871 13057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41b258122c6e4de982cd95ec04ffc3ae" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.333405 13057 raft_consensus.cc:2468] T 41b258122c6e4de982cd95ec04ffc3ae P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
W20260810 13:54:58.065804 13474 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s user 0.009s sys 0.039s
W20260810 13:54:58.334921 13457 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.802s user 0.002s sys 0.020s
W20260810 13:54:58.335423 13457 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s user 0.002s sys 0.020s
W20260810 13:54:58.335449 13474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s user 0.010s sys 0.040s
W20260810 13:54:58.335734 13470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s user 0.009s sys 0.009s
W20260810 13:54:58.336189 13470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s user 0.009s sys 0.009s
W20260810 13:54:58.335498 13454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s user 0.000s sys 0.016s
W20260810 13:54:58.337102 13454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s user 0.001s sys 0.016s
W20260810 13:54:58.337213 13467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s user 0.007s sys 0.018s
I20260810 13:54:58.321837 13039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe4755e4fcfd4af087ce5831a4e02022" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:58.337658 13467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s user 0.007s sys 0.018s
I20260810 13:54:58.312049 13043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34b2314b771f41188bc8101c5ddffaf4" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.324555 13028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c793dedc5e714fe6bd36e507695e82d0" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.339154 13638 tablet_bootstrap.cc:492] T 67ec9aba240b49e6a78c268b20dc901b P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
W20260810 13:54:58.339300 13461 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s user 0.000s sys 0.017s
I20260810 13:54:58.339381 13035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0b88e6d9f77487f8ed2cfafd702a753" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:58.339646 13461 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s user 0.000s sys 0.017s
I20260810 13:54:58.316650 13046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bab4d93f7dc4c88bbed9cb83961bb2e" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
W20260810 13:54:58.066877 13468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s user 0.019s sys 0.022s
I20260810 13:54:58.340363 13028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cafed58a5994479e91678ddbe74cd353" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.308525 13037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ad53d1da7b34194b4b7a78c52870c6b" candidate_uuid: "218e946161f64d1d92427684ac15e4fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.341478 13468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.1:45353 (request call id 1038) took 1420 ms. Trace:
I20260810 13:54:57.996677 13472 rpcz_store.cc:276] 0810 13:54:56.864738 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:56.865126 (+ 388us) service_pool.cc:224] Handling call
0810 13:54:56.896765 (+ 31639us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5800000f98. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb87ad0d981 00007fb87ae4d521 00007fb87ae4d3d2 00007fb883d91fb9 00007fb882fd3640 00007fb88309bebb 00007fb88309bf41 00007fb88305ddd0 00007fb883048739 00007fb8830481e2 00007fb8816c6d34
0810 13:54:56.901505 (+ 4740us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:56.903431 (+ 1926us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:56.903469 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:56.903966 (+ 497us) log.cc:844] Serialized 26 byte log entry
0810 13:54:57.025837 (+121871us) raft_consensus.cc:1645] Marking committed up to 1
0810 13:54:57.204147 (+178310us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4800002dd8. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb882fae211 00007fb882fa52a7 00007fb882fa513a 00007fb88309c07f 00007fb88309bd47 00007fb8830b036c 00007fb8830b0318 00007fb8830b0298 00007fb8830b0253 00007fb8830af4fc 00007fb88244e046
0810 13:54:57.994261 (+790114us) log.cc:844] Serialized 14 byte log entry
0810 13:54:57.995485 (+ 1224us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:57.995592 (+ 107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:57.995649 (+ 57us) raft_consensus.cc:1685] finished
0810 13:54:57.995676 (+ 27us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:57.995911 (+ 235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60783,"prepare.queue_time_us":92256,"prepare.run_cpu_time_us":18,"prepare.run_wall_time_us":18,"raft.queue_time_us":20058,"raft.run_cpu_time_us":2236,"raft.run_wall_time_us":298350,"spinlock_wait_cycles":65536000,"thread_start_us":930493,"threads_started":2,"wal-append.queue_time_us":260660}
W20260810 13:54:58.345618 13465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s user 0.009s sys 0.006s
W20260810 13:54:58.346060 13465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s user 0.009s sys 0.006s
I20260810 13:54:58.344650 13056 raft_consensus.cc:2468] T 62e88a52755140019a6d9f7041db0837 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:58.328486 13452 rpcz_store.cc:276] 0810 13:54:56.842784 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:56.842910 (+ 126us) service_pool.cc:224] Handling call
0810 13:54:56.880964 (+ 38054us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:56.900750 (+ 19786us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b18001e95e0. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb883d79c01 00007fb883d86581 00007fb87ae84d33 00007fb87ae87121 00007fb87ae870d9 00007fb87ae87069 00007fb87ae87031 00007fb87ae8632d 00000000005bd8c4 00000000005bd6f9 00007fb87ae681ea
0810 13:54:57.009001 (+108251us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:57.012432 (+ 3431us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:57.110464 (+ 98032us) log.cc:844] Serialized 26 byte log entry
0810 13:54:57.993122 (+882658us) raft_consensus.cc:1645] Marking committed up to 2
0810 13:54:57.993709 (+ 587us) log.cc:844] Serialized 14 byte log entry
0810 13:54:57.993985 (+ 276us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:57.994090 (+ 105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:58.327386 (+333296us) raft_consensus.cc:1685] finished
0810 13:54:58.327546 (+ 160us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.327823 (+ 277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9211,"prepare.queue_time_us":50423,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":11339,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":428,"spinlock_wait_cycles":16949120,"thread_start_us":983865,"threads_started":2,"wal-append.queue_time_us":932289}
I20260810 13:54:58.348309 13027 raft_consensus.cc:2468] T bec54cb915a54949871181763ad956d5 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 218e946161f64d1d92427684ac15e4fb in term 1.
I20260810 13:54:58.341827 13468 rpcz_store.cc:276] 0810 13:54:57.025187 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.034937 (+ 9750us) service_pool.cc:224] Handling call
0810 13:54:57.035300 (+ 363us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:57.038730 (+ 3430us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:57.038762 (+ 32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:57.081180 (+ 42418us) log.cc:844] Serialized 26 byte log entry
0810 13:54:58.340944 (+1259764us) raft_consensus.cc:1645] Marking committed up to 0
0810 13:54:58.341011 (+ 67us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.341089 (+ 78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:58.341131 (+ 42us) raft_consensus.cc:1685] finished
0810 13:54:58.341142 (+ 11us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.341289 (+ 147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43508,"raft.queue_time_us":38225,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":188,"thread_start_us":1234702,"threads_started":1,"wal-append.queue_time_us":1051250}
I20260810 13:54:58.061570 13462 rpcz_store.cc:276] 0810 13:54:56.701061 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:56.701193 (+ 132us) service_pool.cc:224] Handling call
0810 13:54:56.734776 (+ 33583us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:56.891943 (+157167us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b1800200980. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb883d79c01 00007fb883d86581 00007fb881dc86ac 00007fb87ae67e3b 00000000005adb39 00007fb87ae83fdb 00007fb87ae822db 00007fb87ae81e05 00007fb881fe2440 00007fb881fe2fdb 00007fb881feda2b
0810 13:54:56.892066 (+ 123us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:56.892093 (+ 27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:56.892551 (+ 458us) log.cc:844] Serialized 26 byte log entry
0810 13:54:56.994952 (+102401us) raft_consensus.cc:1645] Marking committed up to 1
0810 13:54:57.992313 (+997361us) log.cc:844] Serialized 14 byte log entry
0810 13:54:57.992674 (+ 361us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.011248 (+ 18574us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:58.025159 (+ 13911us) raft_consensus.cc:1685] finished
0810 13:54:58.043565 (+ 18406us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.061095 (+ 17530us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140470,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":1745,"raft.queue_time_us":52207,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":36694,"spinlock_wait_cycles":61048064,"thread_start_us":1171435,"threads_started":3,"wal-append.queue_time_us":101626}
I20260810 13:54:58.361449 13639 ts_tablet_manager.cc:1434] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.138s user 0.006s sys 0.000s
I20260810 13:54:58.364008 13639 tablet_bootstrap.cc:492] T ac27a168faad4542967097f909ce3997 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:58.371568 16177 tablet_loader.cc:96] loaded metadata for tablet baa17cc9fd524b0981cb2368a7265df1 (table default.Table_a80ad2cc0680447898f832a3da957607 [id=b7e44fb60b9b401db5517c2fd7e8c70b])
I20260810 13:54:58.375764 16177 tablet_loader.cc:96] loaded metadata for tablet bc5b9e218c1f4f4083acc59a651f0cb6 (table default.Table_6794f1878ad14711ac8e25b0b4962ab8 [id=3765b3af1ce6416fb8e3d79c7a4aa86e])
I20260810 13:54:58.387746 18540 consensus_queue.cc:1059] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260810 13:54:58.388636 18540 raft_consensus.cc:3055] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:58.389003 18540 raft_consensus.cc:740] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:58.389765 18540 consensus_queue.cc:260] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.390792 18540 raft_consensus.cc:3060] T db50d31d0d6c45faa1eb138357d532b3 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
W20260810 13:54:58.407248 12472 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:58.416674 16177 tablet_loader.cc:96] loaded metadata for tablet bcac39f031b44408bdbe043720dcae57 (table default.Table_86221744224e4ac4aeebf77dbd274d49 [id=fe2f8409777b4c94b59159a106e77e7f])
I20260810 13:54:58.420529 13639 tablet_bootstrap.cc:654] T ac27a168faad4542967097f909ce3997 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
W20260810 13:54:58.420797 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 124282us
I20260810 13:54:58.453306 16177 tablet_loader.cc:96] loaded metadata for tablet bd127b3e02b54ba2a802877233c18247 (table default.Table_c349ffe18d0d43bdb7bcb14939f9d6db [id=3015a76d1c2047ce9ef39782f8fe2734])
I20260810 13:54:58.455070 16177 tablet_loader.cc:96] loaded metadata for tablet bd3119d63857480294dcb68ed0451bc0 (table default.Table_5af5c57f6f844b67abe1ec29d66a1f28 [id=69ab247d257c42e89ed2ebe36dde8c01])
I20260810 13:54:58.456835 16177 tablet_loader.cc:96] loaded metadata for tablet bec54cb915a54949871181763ad956d5 (table default.Table_7ca4f403487544ddbcdae3db90d957f1 [id=3c48af978c0d4b7994adfff5f583a162])
I20260810 13:54:58.460233 18656 leader_election.cc:290] T 8d647bf5c1ba42f48186661310065448 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:58.461777 18669 raft_consensus.cc:2749] T 515727ae51d94c009b4446c8b6e2c8f6 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.462623 18669 raft_consensus.cc:2749] T 61169145c539464fa9cf62eaaf8168e5 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.462913 18648 leader_election.cc:290] T a27bf786a8274954afc2b2d8cfb34bf0 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:58.463445 18669 raft_consensus.cc:2749] T b449377349514576874b6c295ead5e9a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.465232 13461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.2:50939 (request call id 1148) took 1041 ms. Trace:
I20260810 13:54:58.465657 13461 rpcz_store.cc:276] 0810 13:54:57.423346 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.499913 (+ 76567us) service_pool.cc:224] Handling call
0810 13:54:57.500494 (+ 581us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:57.501033 (+ 539us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:57.501062 (+ 29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:57.501535 (+ 473us) log.cc:844] Serialized 26 byte log entry
0810 13:54:58.340136 (+838601us) raft_consensus.cc:1645] Marking committed up to 1
0810 13:54:58.340214 (+ 78us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.340299 (+ 85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:58.464975 (+124676us) raft_consensus.cc:1685] finished
0810 13:54:58.465002 (+ 27us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.465162 (+ 160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1025,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":18022,"thread_start_us":838147,"threads_started":1,"wal-append.queue_time_us":950995}
I20260810 13:54:58.470810 18653 raft_consensus.cc:3060] T 22d96232e31f46e791d739643ffb9257 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Advancing to term 2
W20260810 13:54:58.480155 13387 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:58.486639 18732 consensus_queue.cc:1059] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260810 13:54:58.487604 18595 raft_consensus.cc:3055] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Stepping down as leader of term 2
I20260810 13:54:58.487924 18595 raft_consensus.cc:740] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:58.488649 18595 consensus_queue.cc:260] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.489519 18595 raft_consensus.cc:3060] T ae0c1bb5bf6b4a97b49e2eea18d4ae9c P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Advancing to term 3
I20260810 13:54:58.497157 16177 tablet_loader.cc:96] loaded metadata for tablet bf9beaff9d5245f8b0e8606ed0d888c6 (table default.Table_b5e6f89f8d854f7e991193036d4d8321 [id=5d59e07d6bc5465eaaf40d68610bc154])
I20260810 13:54:58.498471 16177 tablet_loader.cc:96] loaded metadata for tablet bfc9c907fe50470ca860728883fb6d9e (table default.Table_c4942145f1414e939000a9b7443c0d29 [id=b88902dec1e34475b3ae470c1c17f777])
I20260810 13:54:58.500439 13639 tablet_bootstrap.cc:492] T ac27a168faad4542967097f909ce3997 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:58.500943 13639 ts_tablet_manager.cc:1403] T ac27a168faad4542967097f909ce3997 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.137s user 0.011s sys 0.001s
I20260810 13:54:58.504061 13639 raft_consensus.cc:359] T ac27a168faad4542967097f909ce3997 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.507143 18732 consensus_queue.cc:1059] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:58.507918 18732 raft_consensus.cc:3055] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Stepping down as leader of term 1
I20260810 13:54:58.479276 13382 leader_election.cc:304] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.516340 13470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.2:50939 (request call id 1149) took 1092 ms. Trace:
I20260810 13:54:58.516821 13470 rpcz_store.cc:276] 0810 13:54:57.423588 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.508598 (+ 85010us) service_pool.cc:224] Handling call
0810 13:54:57.509062 (+ 464us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:57.509513 (+ 451us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:57.509551 (+ 38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:57.538116 (+ 28565us) log.cc:844] Serialized 26 byte log entry
0810 13:54:57.545824 (+ 7708us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4800002dd8. stack: 00007fb87ae52cf3 00007fb87ae52bf0 00007fb87aa00574 0000000000516de4 0000000000516d79 00007fb882fae211 00007fb882fa52a7 00007fb882fa513a 00007fb88309c07f 00007fb88309bd47 00007fb8830b036c 00007fb8830b0318 00007fb8830b0298 00007fb8830b0253 00007fb8830af4fc 00007fb88244e046
0810 13:54:58.336958 (+791134us) raft_consensus.cc:1645] Marking committed up to 1
0810 13:54:58.337093 (+ 135us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.337228 (+ 135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:58.515712 (+178484us) raft_consensus.cc:1685] finished
0810 13:54:58.515733 (+ 21us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.516251 (+ 518us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":888,"raft.queue_time_us":177,"raft.run_cpu_time_us":2386,"raft.run_wall_time_us":36509,"spinlock_wait_cycles":27228032,"thread_start_us":795869,"threads_started":1,"wal-append.queue_time_us":927904}
I20260810 13:54:58.518682 13454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.2:50939 (request call id 1154) took 1093 ms. Trace:
I20260810 13:54:58.521749 18732 raft_consensus.cc:740] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Running, Role: LEADER
I20260810 13:54:58.519356 13454 rpcz_store.cc:276] 0810 13:54:57.424924 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.590594 (+165670us) service_pool.cc:224] Handling call
0810 13:54:57.647119 (+ 56525us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:57.649634 (+ 2515us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:57.649720 (+ 86us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:57.655058 (+ 5338us) log.cc:844] Serialized 26 byte log entry
0810 13:54:58.337688 (+682630us) raft_consensus.cc:1645] Marking committed up to 1
0810 13:54:58.337772 (+ 84us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.337897 (+ 125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:58.518162 (+180265us) raft_consensus.cc:1685] finished
0810 13:54:58.518223 (+ 61us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.518539 (+ 316us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":555,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":405,"thread_start_us":681692,"threads_started":1,"wal-append.queue_time_us":816675}
I20260810 13:54:58.521414 13343 heartbeater.cc:499] Master 127.12.36.62:33317 was elected leader, sending a full tablet report...
I20260810 13:54:58.525858 13465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.2:50939 (request call id 1152) took 1101 ms. Trace:
I20260810 13:54:58.523617 13255 raft_consensus.cc:1275] T 2f934006c34a4b18ab157dad01a1b41d P 218e946161f64d1d92427684ac15e4fb [term 4 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260810 13:54:58.526397 13465 rpcz_store.cc:276] 0810 13:54:57.424359 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.524020 (+ 99661us) service_pool.cc:224] Handling call
0810 13:54:57.539431 (+ 15411us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:57.547699 (+ 8268us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:57.547826 (+ 127us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:57.598168 (+ 50342us) log.cc:844] Serialized 26 byte log entry
0810 13:54:58.346631 (+748463us) raft_consensus.cc:1645] Marking committed up to 1
0810 13:54:58.346704 (+ 73us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.346821 (+ 117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:58.525485 (+178664us) raft_consensus.cc:1685] finished
0810 13:54:58.525532 (+ 47us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.525779 (+ 247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4800,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":40871,"thread_start_us":747793,"threads_started":1,"wal-append.queue_time_us":883759}
I20260810 13:54:58.529881 13480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.2:50939 (request call id 1153) took 1105 ms. Trace:
I20260810 13:54:58.530614 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efc446acced34a6c87e459c5542c1c77" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:58.530844 13167 leader_election.cc:304] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:58.531160 13268 raft_consensus.cc:3060] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:58.530270 13480 rpcz_store.cc:276] 0810 13:54:57.424599 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.586047 (+161448us) service_pool.cc:224] Handling call
0810 13:54:57.586413 (+ 366us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:57.586873 (+ 460us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:57.586896 (+ 23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:57.587271 (+ 375us) log.cc:844] Serialized 26 byte log entry
0810 13:54:58.048987 (+461716us) raft_consensus.cc:1645] Marking committed up to 0
0810 13:54:58.049024 (+ 37us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.049199 (+ 175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:58.529218 (+480019us) raft_consensus.cc:1685] finished
0810 13:54:58.529260 (+ 42us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.529476 (+ 216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98,"raft.queue_time_us":1031,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":13549,"thread_start_us":461412,"threads_started":1,"wal-append.queue_time_us":933725}
I20260810 13:54:58.532203 18725 raft_consensus.cc:2804] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 13:54:58.532658 18725 raft_consensus.cc:493] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 13:54:58.533146 18725 raft_consensus.cc:3060] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Advancing to term 1
I20260810 13:54:58.538733 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27bf786a8274954afc2b2d8cfb34bf0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.540943 13457 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.2:50939 (request call id 1150) took 1117 ms. Trace:
I20260810 13:54:58.542511 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61fd4d043c354ad79d79c32498a469b4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.529958 18732 consensus_queue.cc:260] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.545104 18732 raft_consensus.cc:3060] T 9dc6395b50b2458fa2d3877eb7ec2ade P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Advancing to term 2
I20260810 13:54:58.541594 13457 rpcz_store.cc:276] 0810 13:54:57.423832 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.529111 (+105279us) service_pool.cc:224] Handling call
0810 13:54:57.529681 (+ 570us) raft_consensus.cc:1471] Updating replica for 1 ops
0810 13:54:57.530449 (+ 768us) raft_consensus.cc:1534] Early marking committed up to index 0
0810 13:54:57.530516 (+ 67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0810 13:54:57.531531 (+ 1015us) log.cc:844] Serialized 26 byte log entry
0810 13:54:58.412802 (+881271us) raft_consensus.cc:1645] Marking committed up to 4
0810 13:54:58.412949 (+ 147us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.413091 (+ 142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0810 13:54:58.540481 (+127390us) raft_consensus.cc:1685] finished
0810 13:54:58.540532 (+ 51us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.540851 (+ 319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":351,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":341,"spinlock_wait_cycles":6912,"thread_start_us":803047,"threads_started":1,"wal-append.queue_time_us":986680}
I20260810 13:54:58.550421 13464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.2:50939 (request call id 1143) took 1157 ms. Trace:
W20260810 13:54:58.553176 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 130446us
W20260810 13:54:58.553443 13384 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:58.555637 18803 raft_consensus.cc:2749] T a43ea90fc236424489a4981c32087d81 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.556346 18652 raft_consensus.cc:493] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:58.557418 18652 raft_consensus.cc:515] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.558979 18803 raft_consensus.cc:493] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:58.560165 18803 raft_consensus.cc:515] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.560964 18652 leader_election.cc:290] T 0d147e624d4243b9b330c874e0f27f6c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:58.562757 16177 tablet_loader.cc:96] loaded metadata for tablet c0e45366954740528fb37c7cfdc639c6 (table default.Table_ea28f1ec02f045c3bc16cbe36f484bb6 [id=8129beecaba3450c9041bb715af80988])
I20260810 13:54:58.563041 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc5b9e218c1f4f4083acc59a651f0cb6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.564014 16177 tablet_loader.cc:96] loaded metadata for tablet c1510cd3523646eba9333f7e6d85a5e8 (table default.Table_c39a51586fe847b990c6d2c59e2280ff [id=44428a121dc24f5ba5e5d74158f9f4d0])
I20260810 13:54:58.564242 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0567b908974da5817ed62aafecee35" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.565361 16177 tablet_loader.cc:96] loaded metadata for tablet c4a656fba31f49d99303e6a71cc4a9a6 (table default.Table_e4f9174b7de74fd79642def9d4d0fffd [id=f8ba71724c3f4068a8377462165aee32])
W20260810 13:54:58.544966 12952 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.2:35799, user_credentials={real_user=slave}} blocked reactor thread for 75741.3us
I20260810 13:54:58.553715 18695 raft_consensus.cc:493] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:58.565217 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62e88a52755140019a6d9f7041db0837" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.566289 13253 raft_consensus.cc:2393] T 62e88a52755140019a6d9f7041db0837 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:58.565980 18695 raft_consensus.cc:515] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.568394 18695 leader_election.cc:290] T 006c7409946a4122a95468288ed3aef0 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:58.570756 18410 raft_consensus.cc:493] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:58.571300 18410 raft_consensus.cc:515] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.574430 18410 leader_election.cc:290] T 97015b4984c74a4682b6dedd47dc6650 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:58.576825 13639 raft_consensus.cc:385] T ac27a168faad4542967097f909ce3997 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:58.577256 13639 raft_consensus.cc:740] T ac27a168faad4542967097f909ce3997 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:58.578168 13639 consensus_queue.cc:260] T ac27a168faad4542967097f909ce3997 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.578564 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "350b68f6c1cf48ff8e5f8521e5a4dad6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.580348 13639 ts_tablet_manager.cc:1434] T ac27a168faad4542967097f909ce3997 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.079s user 0.004s sys 0.002s
I20260810 13:54:58.580720 13268 raft_consensus.cc:2468] T efc446acced34a6c87e459c5542c1c77 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 1.
I20260810 13:54:58.555178 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bbee4f9a50342599434a2b05c0740bd" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.581724 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "587b591fb88a447b9bd5e071fa8c37e1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:58.585491 13171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:58.587759 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b82b59b066c4240a387e7de48de9c70" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.591574 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b1451bb8254fcb8c507a837d6b2fa4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.561937 13382 leader_election.cc:304] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.588430 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "393e23a9c03049a280f3ef89bdca5011" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.594436 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5114911fdf4b19afec0c71ded5ef9a" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.595116 13255 raft_consensus.cc:2468] T 7a5114911fdf4b19afec0c71ded5ef9a P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:58.595232 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bec54cb915a54949871181763ad956d5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.595914 13258 raft_consensus.cc:2393] T bec54cb915a54949871181763ad956d5 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:58.547564 13638 tablet_bootstrap.cc:654] T 67ec9aba240b49e6a78c268b20dc901b P 218e946161f64d1d92427684ac15e4fb: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:58.600823 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5836c2923aaf4c698e20b9652fcddc20" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.601104 13450 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.2:50939 (request call id 1139) took 1213 ms. Trace:
I20260810 13:54:58.602826 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51813605283e43f2b4efe6fb2fab652c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.601559 13450 rpcz_store.cc:276] 0810 13:54:57.387914 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.388870 (+ 956us) service_pool.cc:224] Handling call
0810 13:54:57.389259 (+ 389us) raft_consensus.cc:1471] Updating replica for 0 ops
0810 13:54:57.389574 (+ 315us) raft_consensus.cc:1534] Early marking committed up to index 5
0810 13:54:57.389988 (+ 414us) log.cc:844] Serialized 14 byte log entry
0810 13:54:58.513188 (+1123200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0810 13:54:58.513306 (+ 118us) raft_consensus.cc:1645] Marking committed up to 5
0810 13:54:58.593930 (+ 80624us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.600857 (+ 6927us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.601029 (+ 172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37330,"prepare.queue_time_us":3295,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":146011,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":329,"spinlock_wait_cycles":2816,"thread_start_us":1098208,"threads_started":2,"wal-append.queue_time_us":770019}
I20260810 13:54:58.605321 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1f506c6cd4222b4bd6176ccd54e56" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
W20260810 13:54:58.606204 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 52209.6us
W20260810 13:54:58.606273 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 49004.6us
I20260810 13:54:58.607442 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be536894b164edfb4310ff521e2fb42" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.614660 13382 leader_election.cc:304] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.615548 18798 raft_consensus.cc:2749] T e9840da46a92439f8c96bc3714650f17 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.616418 13258 raft_consensus.cc:1275] T 49bf6a1f14bb4513b1addc4141b71373 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Refusing update from remote peer 88ed04d733ec447583fc897e233dd4b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260810 13:54:58.620265 13639 tablet_bootstrap.cc:492] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
I20260810 13:54:58.620707 13467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.12.36.2:50939 (request call id 1141) took 1232 ms. Trace:
I20260810 13:54:58.621105 13467 rpcz_store.cc:276] 0810 13:54:57.388379 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.389679 (+ 1300us) service_pool.cc:224] Handling call
0810 13:54:57.389910 (+ 231us) raft_consensus.cc:1471] Updating replica for 0 ops
0810 13:54:57.390075 (+ 165us) raft_consensus.cc:1534] Early marking committed up to index 2
0810 13:54:57.390338 (+ 263us) log.cc:844] Serialized 14 byte log entry
0810 13:54:58.545072 (+1154734us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0810 13:54:58.603454 (+ 58382us) raft_consensus.cc:1645] Marking committed up to 2
0810 13:54:58.620336 (+ 16882us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.620439 (+ 103us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.620628 (+ 189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3362,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":126092,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":201,"thread_start_us":1120340,"threads_started":2,"wal-append.queue_time_us":1079880}
I20260810 13:54:58.625178 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15149232bd7645be840c1d223a829eb4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.627070 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf672d15f88c4f0dbdf2fdb6aefa1108" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.627596 13258 raft_consensus.cc:2468] T bf672d15f88c4f0dbdf2fdb6aefa1108 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
W20260810 13:54:58.628979 15130 leader_election.cc:336] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 1298bde14cec4cd3a9d6338c7d47f0b7 (127.12.36.60:38017): Timed out: RequestConsensusVote RPC to 127.12.36.60:38017 timed out after 0.658s (SENT)
I20260810 13:54:58.629405 15130 leader_election.cc:304] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2928f7d4503145b182d99007d240334d; no voters: 1298bde14cec4cd3a9d6338c7d47f0b7, d9666026fb7e4c85b46c6aab952932fb
I20260810 13:54:58.630383 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebb1392a98aa4af199236e4b4b4ab3c5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.631902 18803 leader_election.cc:290] T b335455cc01947a3a4ca6c368fea7bad P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:58.633942 13640 tablet_bootstrap.cc:492] T 5579f4f12fb9495390d8261d24d120d8 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:58.634531 13640 ts_tablet_manager.cc:1403] T 5579f4f12fb9495390d8261d24d120d8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 1.481s user 0.009s sys 0.026s
I20260810 13:54:58.636791 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d2d209f801b4aa0aff3137a51fc7556" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.637581 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81de7fcb3bc745a5b0ea7ffb45dbcfce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.636955 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0e45366954740528fb37c7cfdc639c6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.637660 13640 raft_consensus.cc:359] T 5579f4f12fb9495390d8261d24d120d8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.638312 13640 raft_consensus.cc:385] T 5579f4f12fb9495390d8261d24d120d8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:58.638594 13640 raft_consensus.cc:740] T 5579f4f12fb9495390d8261d24d120d8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f30dc72e9364eed80645b57ac7f0cb6, State: Initialized, Role: FOLLOWER
I20260810 13:54:58.639385 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f1df2c9593442afa84849da6874f0f4" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.640106 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a42d57a7f6e2424998f5aebf0c8407d5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.648949 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cab5c35fa6b440a7bc4ebe2709fbfc60" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.651577 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98a59da23cfa4b5a9713b135d7fa4366" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.652062 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce84eacbab61417a9497f8770b4da511" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.650930 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a7e7c310e24d8caca5756fe67631ce" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.653906 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c6686175347496093cb22ce8a3d4176" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.652647 13253 raft_consensus.cc:2468] T ce84eacbab61417a9497f8770b4da511 P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:58.655025 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d321f9c075554ffcb299d02792a0662d" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.655223 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d9e5103fe644f38d969c64182f7cbb" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.656193 13254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f425739a239144048975fb15a26d197e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.658007 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e5ad84fe2604dd2959768db31f66e7c" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.647192 13382 leader_election.cc:304] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.647337 18803 raft_consensus.cc:2749] T 48a059240c0f48ee958ef728acfcae92 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:58.661886 18798 raft_consensus.cc:2749] T d36f17094e504d80a2443dc12855c744 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.665997 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "953f83dab3ca406f8638e446911614b0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.656840 13254 raft_consensus.cc:2468] T f425739a239144048975fb15a26d197e P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88ed04d733ec447583fc897e233dd4b3 in term 0.
I20260810 13:54:58.653393 13255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "288debea4aa045d1898483cde1d4d3b1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.683564 13382 leader_election.cc:304] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.685220 13382 leader_election.cc:304] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.686029 18803 raft_consensus.cc:2749] T c1510cd3523646eba9333f7e6d85a5e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 13:54:58.686861 18803 raft_consensus.cc:2749] T 121d7abf368a4cf99fd045b8c8ba4b69 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.695801 18695 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:58.696539 18695 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.699229 18695 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:58.706332 12951 leader_election.cc:304] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:58.706744 13056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a7bddc8e6374437a37aeb755389d91f" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.707526 13027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba5b835c1bf44c59a4ea7ab4b9ea93f4" candidate_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ed04d733ec447583fc897e233dd4b3" is_pre_election: true
I20260810 13:54:58.711556 18695 raft_consensus.cc:2749] T 1ee6e694366543328526313d7018b5db P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.712926 12951 leader_election.cc:304] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:58.721194 18695 raft_consensus.cc:2749] T 98ce3cccca464b938fd45afe292b4ad8 P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.696985 18803 raft_consensus.cc:493] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:58.722395 18803 raft_consensus.cc:515] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.724553 12951 leader_election.cc:304] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:58.686888 13382 leader_election.cc:304] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.726272 18695 raft_consensus.cc:2749] T 29ace970eee349d6b669b5c531f91c8b P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.726166 13382 leader_election.cc:304] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.727542 13382 leader_election.cc:304] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
W20260810 13:54:58.715106 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:58.714572 18798 raft_consensus.cc:493] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 13:54:58.732613 18695 consensus_queue.cc:1048] T 49bf6a1f14bb4513b1addc4141b71373 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:58.733777 18798 raft_consensus.cc:515] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.736023 18798 leader_election.cc:290] T ce84eacbab61417a9497f8770b4da511 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:58.736658 18799 raft_consensus.cc:2749] T 9334ba72cfd94fa4a7062a29445c69f9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.737375 18799 raft_consensus.cc:2749] T c4ecf9abd60848f993234e98284974e8 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.738013 18799 raft_consensus.cc:2749] T bd127b3e02b54ba2a802877233c18247 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.728789 18803 leader_election.cc:290] T 5f7cac512bcd48cfb6aaba4dc7e5681e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 218e946161f64d1d92427684ac15e4fb (127.12.36.2:35799)
I20260810 13:54:58.738662 12951 leader_election.cc:304] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 88ed04d733ec447583fc897e233dd4b3; no voters: 218e946161f64d1d92427684ac15e4fb, 6f30dc72e9364eed80645b57ac7f0cb6
I20260810 13:54:58.739954 13382 leader_election.cc:304] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.740185 18695 raft_consensus.cc:2749] T f19e7aa805bd417eae45fb43ac18a66d P 88ed04d733ec447583fc897e233dd4b3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.741516 13382 leader_election.cc:304] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.742208 18653 raft_consensus.cc:2749] T b0b88e6d9f77487f8ed2cfafd702a753 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.742702 18801 raft_consensus.cc:2749] T 691aac16d50745d6965bebe94831b67b P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.742998 18695 consensus_queue.cc:1048] T cafed58a5994479e91678ddbe74cd353 P 88ed04d733ec447583fc897e233dd4b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 13:54:58.744436 13639 tablet_bootstrap.cc:654] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 88ed04d733ec447583fc897e233dd4b3: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:58.639320 13640 consensus_queue.cc:260] T 5579f4f12fb9495390d8261d24d120d8 P 6f30dc72e9364eed80645b57ac7f0cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.747161 13640 ts_tablet_manager.cc:1434] T 5579f4f12fb9495390d8261d24d120d8 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent starting tablet: real 0.112s user 0.002s sys 0.004s
I20260810 13:54:58.744354 13382 leader_election.cc:304] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.747988 18803 raft_consensus.cc:2749] T cafed58a5994479e91678ddbe74cd353 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260810 13:54:58.748711 13380 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260810 13:54:58.749704 13382 leader_election.cc:304] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.750499 18803 raft_consensus.cc:2749] T 4687f8fd44034ce28727c3b7e58e7fe9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.752208 18803 consensus_queue.cc:1048] T 41b258122c6e4de982cd95ec04ffc3ae P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260810 13:54:58.754447 13382 leader_election.cc:304] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.773300 18803 raft_consensus.cc:2749] T 2b67e5a2b5334147b9d25f2ddc73de31 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.551141 13464 rpcz_store.cc:276] 0810 13:54:57.392492 (+ 0us) service_pool.cc:167] Inserting onto call queue
0810 13:54:57.393256 (+ 764us) service_pool.cc:224] Handling call
0810 13:54:57.421537 (+ 28281us) raft_consensus.cc:1471] Updating replica for 0 ops
0810 13:54:57.442746 (+ 21209us) raft_consensus.cc:1534] Early marking committed up to index 1
0810 13:54:57.453584 (+ 10838us) log.cc:844] Serialized 14 byte log entry
0810 13:54:58.488867 (+1035283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0810 13:54:58.521472 (+ 32605us) raft_consensus.cc:1645] Marking committed up to 1
0810 13:54:58.548969 (+ 27497us) raft_consensus.cc:1697] Filling consensus response to leader.
0810 13:54:58.549173 (+ 204us) raft_consensus.cc:1691] UpdateReplicas() finished
0810 13:54:58.549472 (+ 299us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6394,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":127553,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":227,"thread_start_us":1018402,"threads_started":2,"wal-append.queue_time_us":700567}
I20260810 13:54:58.763890 13640 tablet_bootstrap.cc:492] T 45530faa785a4642b4efc18733d0d9b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Bootstrap starting.
I20260810 13:54:58.792750 13638 tablet_bootstrap.cc:492] T 67ec9aba240b49e6a78c268b20dc901b P 218e946161f64d1d92427684ac15e4fb: No bootstrap required, opened a new log
I20260810 13:54:58.793267 13638 ts_tablet_manager.cc:1403] T 67ec9aba240b49e6a78c268b20dc901b P 218e946161f64d1d92427684ac15e4fb: Time spent bootstrapping tablet: real 0.454s user 0.009s sys 0.006s
I20260810 13:54:58.794513 13382 leader_election.cc:304] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.796404 18803 raft_consensus.cc:2749] T 049416892e964159a06d5817932bbd7a P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.798259 13258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b7b408a9ad34ea39c912b33e26b49b6" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.809190 13382 leader_election.cc:304] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.809677 18827 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 2928f7d4503145b182d99007d240334d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260810 13:54:58.810093 18803 raft_consensus.cc:2749] T 1d78892783474b329e31bf2df7d2952c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.804668 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17d73c65f544b7c8566fd874ee87a25" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.807385 13638 raft_consensus.cc:359] T 67ec9aba240b49e6a78c268b20dc901b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.811551 13382 leader_election.cc:304] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.811806 13638 raft_consensus.cc:385] T 67ec9aba240b49e6a78c268b20dc901b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:58.812079 13638 raft_consensus.cc:740] T 67ec9aba240b49e6a78c268b20dc901b P 218e946161f64d1d92427684ac15e4fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 218e946161f64d1d92427684ac15e4fb, State: Initialized, Role: FOLLOWER
I20260810 13:54:58.796430 18725 raft_consensus.cc:515] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.812296 18803 raft_consensus.cc:2749] T d1ec72a86a08452fb8b390b62f8c6dec P 6f30dc72e9364eed80645b57ac7f0cb6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260810 13:54:58.812951 13638 consensus_queue.cc:260] T 67ec9aba240b49e6a78c268b20dc901b P 218e946161f64d1d92427684ac15e4fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
W20260810 13:54:58.814193 15130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.60:38017, user_credentials={real_user=slave}} blocked reactor thread for 185242us
I20260810 13:54:58.818831 18725 leader_election.cc:290] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 election: Requested vote from peers 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237), 6f30dc72e9364eed80645b57ac7f0cb6 (127.12.36.3:36001)
I20260810 13:54:58.820559 13242 raft_consensus.cc:2393] T 1bbee4f9a50342599434a2b05c0740bd P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:58.820920 16177 tablet_loader.cc:96] loaded metadata for tablet ca26c63f9dc142318b648f456f111ebb (table default.Table_5d55900f1adf4aca973dbf4e94ca29c3 [id=63c1004ec7f44526929d7b9f809c0e04])
I20260810 13:54:58.825174 16177 tablet_loader.cc:96] loaded metadata for tablet cafed58a5994479e91678ddbe74cd353 (table default.Table_93c916a2352c47b79525650ef8c0d3ca [id=eb9d4e7dfab6444ba91f07b1cec13b18])
I20260810 13:54:58.833756 13259 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67cf93d78254f15a1b89c99048110c8" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.834240 13640 tablet_bootstrap.cc:654] T 45530faa785a4642b4efc18733d0d9b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Neither blocks nor log segments found. Creating new log.
I20260810 13:54:58.835048 13254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "006c7409946a4122a95468288ed3aef0" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.836658 13268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97015b4984c74a4682b6dedd47dc6650" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.836067 13242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39514e069d6841df9fced9e62981eac5" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.836722 13253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d96232e31f46e791d739643ffb9257" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:58.838586 13253 raft_consensus.cc:2393] T 22d96232e31f46e791d739643ffb9257 P 218e946161f64d1d92427684ac15e4fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 2: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:58.838788 13638 ts_tablet_manager.cc:1434] T 67ec9aba240b49e6a78c268b20dc901b P 218e946161f64d1d92427684ac15e4fb: Time spent starting tablet: real 0.045s user 0.000s sys 0.006s
I20260810 13:54:58.845783 13382 leader_election.cc:304] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.846165 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f7cac512bcd48cfb6aaba4dc7e5681e" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb" is_pre_election: true
I20260810 13:54:58.846731 18803 raft_consensus.cc:2749] T 1122dcf7bcea4654bf29ff01fc4a350d P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.851492 13269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa17cc9fd524b0981cb2368a7265df1" candidate_uuid: "88ed04d733ec447583fc897e233dd4b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "218e946161f64d1d92427684ac15e4fb"
I20260810 13:54:58.852157 13269 raft_consensus.cc:2393] T baa17cc9fd524b0981cb2368a7265df1 P 218e946161f64d1d92427684ac15e4fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 88ed04d733ec447583fc897e233dd4b3 in current term 1: Already voted for candidate 218e946161f64d1d92427684ac15e4fb in this term.
I20260810 13:54:58.856359 16177 tablet_loader.cc:96] loaded metadata for tablet cb4dcad38c1a4269b4740a8e5247a867 (table default.Table_d3b5260520ea4849ae4aacd58dc0dd68 [id=c374f65e7c914fa1aafe16f714a51ca3])
I20260810 13:54:58.861109 13382 leader_election.cc:304] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.861994 18803 raft_consensus.cc:2749] T 3066b475871c45fdbe585947fd6800c9 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260810 13:54:58.863610 13382 leader_election.cc:304] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.864486 18803 raft_consensus.cc:2749] T fe4755e4fcfd4af087ce5831a4e02022 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.879809 13639 tablet_bootstrap.cc:492] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 88ed04d733ec447583fc897e233dd4b3: No bootstrap required, opened a new log
I20260810 13:54:58.880203 13639 ts_tablet_manager.cc:1403] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 88ed04d733ec447583fc897e233dd4b3: Time spent bootstrapping tablet: real 0.260s user 0.008s sys 0.005s
I20260810 13:54:58.883786 13639 raft_consensus.cc:359] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.884467 13639 raft_consensus.cc:385] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 13:54:58.884801 13639 raft_consensus.cc:740] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 88ed04d733ec447583fc897e233dd4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ed04d733ec447583fc897e233dd4b3, State: Initialized, Role: FOLLOWER
I20260810 13:54:58.887616 16177 tablet_loader.cc:96] loaded metadata for tablet cd3d4b038acb48ebaebef7a424f721c5 (table default.Table_57980e60ac6549c8b24861967f6cc198 [id=18ade4a3af044a498725f45a06e04b81])
I20260810 13:54:58.893386 13638 tablet_bootstrap.cc:492] T de012d382b194bf193fef76779abcf17 P 218e946161f64d1d92427684ac15e4fb: Bootstrap starting.
I20260810 13:54:58.893389 13382 leader_election.cc:304] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.894162 18803 raft_consensus.cc:2749] T 34b2314b771f41188bc8101c5ddffaf4 P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.895378 13382 leader_election.cc:304] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.896126 18803 raft_consensus.cc:2749] T fe5796052fd94c1e8fce159a6a90830c P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 13:54:58.897888 13382 leader_election.cc:304] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f30dc72e9364eed80645b57ac7f0cb6; no voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3
I20260810 13:54:58.905718 16177 tablet_loader.cc:96] loaded metadata for tablet ce84eacbab61417a9497f8770b4da511 (table default.Table_afeb77a530a74b35991ae4d4400af3e3 [id=23d722ef12c849af85d88c980f7ae3d6])
I20260810 13:54:58.909154 18803 raft_consensus.cc:2749] T 5bab4d93f7dc4c88bbed9cb83961bb2e P 6f30dc72e9364eed80645b57ac7f0cb6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 13:54:58.932034 12951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.3:36001, user_credentials={real_user=slave}} blocked reactor thread for 184355us
I20260810 13:54:58.944240 12482 catalog_manager.cc:5811] TS 88ed04d733ec447583fc897e233dd4b3 (127.12.36.1:35237) does not have the latest schema for tablet aa0567b908974da5817ed62aafecee35 (table default.Table_f95c9f662de4490cac0ad50321a985cd [id=8550046a1cf84e729bba99de4ff23879]). Expected version 1 got 0
I20260810 13:54:58.940588 13639 consensus_queue.cc:260] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 88ed04d733ec447583fc897e233dd4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1" port: 35237 } } peers { permanent_uuid: "218e946161f64d1d92427684ac15e4fb" member_type: VOTER last_known_addr { host: "127.12.36.2" port: 35799 } } peers { permanent_uuid: "6f30dc72e9364eed80645b57ac7f0cb6" member_type: VOTER last_known_addr { host: "127.12.36.3" port: 36001 } }
I20260810 13:54:58.947500 13640 tablet_bootstrap.cc:492] T 45530faa785a4642b4efc18733d0d9b1 P 6f30dc72e9364eed80645b57ac7f0cb6: No bootstrap required, opened a new log
I20260810 13:54:58.948020 13640 ts_tablet_manager.cc:1403] T 45530faa785a4642b4efc18733d0d9b1 P 6f30dc72e9364eed80645b57ac7f0cb6: Time spent bootstrapping tablet: real 0.184s user 0.014s sys 0.003s
I20260810 13:54:58.948251 13639 ts_tablet_manager.cc:1434] T ba5b835c1bf44c59a4ea7ab4b9ea93f4 P 88ed04d733ec447583fc897e233dd4b3: Time spent starting tablet: real 0.068s user 0.003s sys 0.004s
W20260810 13:54:58.948534 13167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 300513us
I20260810 13:54:58.949945 13639 tablet_bootstrap.cc:492] T f600e14cc2a64f6bb5cf8d4057ad45b5 P 88ed04d733ec447583fc897e233dd4b3: Bootstrap starting.
W20260810 13:54:58.950565 13382 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.36.1:35237, user_credentials={real_user=slave}} blocked reactor thread for 52832.1us
I20260810 13:54:58.951380 13167 leader_election.cc:304] T ff9ccbe2b9e3466dbc5fd23b2ea5a6a4 P 218e946161f64d1d92427684ac15e4fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 218e946161f64d1d92427684ac15e4fb, 88ed04d733ec447583fc897e233dd4b3; no voters:
I20260810 13:54:58.951768 18803 consensus_queue.cc:1048] T b7a45cb763a84c7aa557fde815a92c07 P 6f30dc72e9364eed80645b57ac7f0cb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ed04d733ec447583fc897e233dd4b3" member_type: VOTER last_known_addr { host: "127.12.36.1"